Scraping Stack Overflow Using Python Tutorial | Beautiful Soup

///Scraping Stack Overflow Using Python Tutorial | Beautiful Soup

Scraping Stack Overflow Using Python Tutorial | Beautiful Soup

FavoriteLoadingAdd to favorites

In this video, I will explain how to do web scraping using python and we will scrap stack overflow questions in this tutorial.

#Trending #Python #Scrapper

Please give stars for this project on git and like the video.

Source Code –

Read my articles on medium –

My portfolio –

Flutter UI Kit –
Flutter Example Apps –

Instagram –

FB Group –

Slack Group –

New Channel –

Be sure to ask for help in the comments if you need any. Suggestions for future tutorials are also very welcome! 🙂

Please Subscribe my channel to motivate me.
Subscribe Our Channel:

For Fun –

Connect with us on social media:
Facebook:
Pawan Kumar –
Ask Pawan Kumar –
Instagram –
Twitter:

LIKE | SHARE | SUBSCRIBE FOR MORE VIDEOS LIKE THIS

THANKS FOR WATCHING!

source

By |2021-03-02T12:42:48+00:00March 2nd, 2021|Python Video Tutorials|17 Comments

17 Comments

  1. Chetan A March 2, 2021 at 12:42 pm - Reply

    cool

  2. Muhammad Umer Lari March 2, 2021 at 12:42 pm - Reply

    Getting Error Please solved this

    from selenium import webdriver

    from bs4 import BeautifulSoup

    import pandas as pd
    driver = webdriver.Chrome("F:/chromedriver")
    products=[] #List to store name of the product

    prices=[] #List to store price of the product

    Decsriptions=[] #List to store rating of the product

    driver.get("https://www.nike.com/w/womens-lifestyle-shoes-13jrmz5e1x6zy7ok&quot😉
    content = driver.page_source

    soup = BeautifulSoup(content)

    for a in soup.find_all('a',href=True, attrs={'class':'product-card__link-overlay'}):

    #soup.findAll('a',href=True, attrs={'class':'_13oc-S'}):

    name = a.find('div', attrs={'class':'product-card__title'})

    price=a.find('div', attrs={'class':'product-card__price'})

    products.append(name.text)

    prices.append(price.text)

    Decsriptions=a.find('li', attrs={'class':'product-card__subtitle'})

    #ratings.append(rating.text)

    df = pd.DataFrame({'Prodduct Name':products,'Price':prices, 'Decsription' :Decsriptions})

    #,'Rating':ratings

    df.to_csv('D:/Flip_cart_Laptop_scraping .csv', index=False, encoding='utf-8')

    —————————————————————————

    AttributeError Traceback (most recent call last)

    <ipython-input-11-1ac819e5282d> in <module>

    6 price=a.find('div', attrs={'class':'product-card__price'})

    7 #rating=a.find('div', attrs={'class':'_3LWZlK'})

    —-> 8 products.append(name.text)

    9 prices.append(price.text)

    10 Decsriptions=a.find('li', attrs={'class':'product-card__subtitle'})

    AttributeError: 'NoneType' object has no attribute 'text'



  3. Rishikrishna Raguraman March 2, 2021 at 12:42 pm - Reply

    Little help here,
    when i run pipenv run,
    Usage: pipenv run [OPTIONS] COMMAND [ARGS]…
    Try 'pipenv run -h' for help.

    Error: Missing argument 'COMMAND'.
    what do I do?

  4. Ranga bharath March 2, 2021 at 12:42 pm - Reply

    awesome

  5. Udit Tidu March 2, 2021 at 12:42 pm - Reply

    Is it possible to extract large amount of data. When I ran the python code I got only 50 questions

  6. Shariar Razm March 2, 2021 at 12:42 pm - Reply

    Hi! I'm using IntelliJ for mac but i can not import from bs4 BeautifulSoup

  7. Vadim Braun March 2, 2021 at 12:42 pm - Reply

    Great! I love Python for very simple but powerful syntax. Hope to see more Python Scraping Tutorials.

  8. Vatsa March 2, 2021 at 12:42 pm - Reply

    This is exactly what I wanted to learn, thanks a lot.

  9. Jimmy Medina March 2, 2021 at 12:42 pm - Reply

    Excellent video and very useful content, thanks for your help, I'm very interested in integration for flutter.

  10. Joshua Mawuli March 2, 2021 at 12:42 pm - Reply

    Can't wait for the sequels

  11. Rabindra Joshi March 2, 2021 at 12:42 pm - Reply

    Wonderful.
    How did you become so much knowledged?
    ..
    Update:
    I think using Jupyter will be very convenient and quick for developing a prototype script or web scraping, what do you think?

  12. Anirudh Jwala March 2, 2021 at 12:42 pm - Reply

    Getting few JSON validation errors

  13. Joshua Mawuli March 2, 2021 at 12:42 pm - Reply

    One question though, how do you get all the tags for each question please?

  14. Anirudh Jwala March 2, 2021 at 12:42 pm - Reply

    Wonderful idea!! 👌

  15. Joshua Mawuli March 2, 2021 at 12:42 pm - Reply

    This is awesome. Exactly what i needed for a project I'm working on

  16. SKD March 2, 2021 at 12:42 pm - Reply

    Great

  17. Youssef ELMOUMEN March 2, 2021 at 12:42 pm - Reply

    thanks sir 😛

Leave A Comment

*