Scraping Stack Overflow Using Python Tutorial | Beautiful Soup

Getting Error Please solved this

from selenium import webdriver

from bs4 import BeautifulSoup

import pandas as pd
driver = webdriver.Chrome("F:/chromedriver")
products=[] #List to store name of the product

prices=[] #List to store price of the product

Decsriptions=[] #List to store rating of the product

driver.get("https://www.nike.com/w/womens-lifestyle-shoes-13jrmz5e1x6zy7ok&quot😉
content = driver.page_source

soup = BeautifulSoup(content)

for a in soup.find_all('a',href=True, attrs={'class':'product-card__link-overlay'}):

#soup.findAll('a',href=True, attrs={'class':'_13oc-S'}):

name = a.find('div', attrs={'class':'product-card__title'})

price=a.find('div', attrs={'class':'product-card__price'})

products.append(name.text)

prices.append(price.text)

Decsriptions=a.find('li', attrs={'class':'product-card__subtitle'})

#ratings.append(rating.text)

df = pd.DataFrame({'Prodduct Name':products,'Price':prices, 'Decsription' :Decsriptions})

#,'Rating':ratings

df.to_csv('D:/Flip_cart_Laptop_scraping .csv', index=False, encoding='utf-8')

—————————————————————————

AttributeError Traceback (most recent call last)

<ipython-input-11-1ac819e5282d> in <module>

6 price=a.find('div', attrs={'class':'product-card__price'})

7 #rating=a.find('div', attrs={'class':'_3LWZlK'})

—-> 8 products.append(name.text)

9 prices.append(price.text)

10 Decsriptions=a.find('li', attrs={'class':'product-card__subtitle'})

AttributeError: 'NoneType' object has no attribute 'text'

​

​

awesome

Hi! I'm using IntelliJ for mac but i can not import from bs4 BeautifulSoup

This is exactly what I wanted to learn, thanks a lot.

Can't wait for the sequels

Getting few JSON validation errors

Wonderful idea!! 👌

Great