20 – web scraping with python using beautiful soup & requests (Python tutorial for beginners 2019)

///20 – web scraping with python using beautiful soup & requests (Python tutorial for beginners 2019)

20 – web scraping with python using beautiful soup & requests (Python tutorial for beginners 2019)

FavoriteLoadingAdd to favorites

How to Automate Stuff with Python…

Join the 3-part epic masterclass that shows you how to become a 6-figure developer…

Enroll for exercises, tutorials, courses, and projects…

Enroll in Learn Python™ course

==================================================
Connect With Me!

Website ►
Facebook ►
Twitter ►
Instagram ►
Snapchat ► Rafeh1
iTunes Podcast ►
Google Podcast ►
Support (Patreon) ►
Youtube ►
Github (Code) ►

source

By |2020-12-23T11:25:19+00:00December 23rd, 2020|Python Video Tutorials|45 Comments

45 Comments

  1. Mian Ali December 23, 2020 at 11:25 am - Reply

    We are providing services Web scraping (web harvesting or web data extraction) is a computer software technique of extracting information from websites. Usually, such software programs simulate human exploration of the World Wide Web by either implementing low-level Hypertext Transfer Protocol (HTTP), or embedding a fully-fledged web browser, such as Internet Explorer, Google Chrome and Mozilla Firefox

    Contact Us
    https://aitomation.com/data-web-scraping/

  2. Riya Bisht December 23, 2020 at 11:25 am - Reply

    Awesome explanation sir. I am using this in my python GUI project and it's really helping me to generate beautiful ideas:)

  3. Muhammad Usama Qamar December 23, 2020 at 11:25 am - Reply

    What if something is none we can't get_text() if something is none so how we should avoid that?

  4. Mushh December 23, 2020 at 11:25 am - Reply

    I have an error in this code:
    import requests

    from bs4 import BeautifulSoup

    page = requests.get('https://forecast.weather.gov/MapClick.php?lat=37.498545000000036&lon=-122.250475#.X8SB581KhPY&#39😉

    soup = BeautifulSoup(page.content, 'html.parser')

    week = soup.find(id='seven-day-forecast-body')

    # print(week)

    items = week.find_all(class_='tombstone-container')

    # print(items[0])

    print(items[0].find(class_='period-name').get_text())

    print(items[0].find(class_='short-desc').get_text())

    print(items[0].find(class_='temp').get_text())

    period_names = [item.find(class_='period_name').get_text() for item in items]

    print(period_names)

    error: AttributeError: 'NoneType' object has no attribute 'get_text'

  5. Thomas Bracken December 23, 2020 at 11:25 am - Reply

    Awesome video. Thanks a lot, it really help me to understand scraping

  6. John Barrett December 23, 2020 at 11:25 am - Reply

    great tutorial, thanks so much!

  7. PK Avenger December 23, 2020 at 11:25 am - Reply

    i watch Corey Cheffer tutorial and then your for the same topic and its a very good combo.

  8. Kristian Frroku December 23, 2020 at 11:25 am - Reply

    you are total trash

  9. Ratul Hossain December 23, 2020 at 11:25 am - Reply

    Thank You it was really helpful …..

  10. Musab Abdelkareem December 23, 2020 at 11:25 am - Reply

    It is amazing and helpful, it exactly what I looking for. but I have a question: Is that possible to requests multiple webpages at once and read those links for that webpage from a txt file? Thanks in Advance Qazi 💕💕

  11. Floyd Fernandes December 23, 2020 at 11:25 am - Reply

    What modules we need to install before installing beautiful soup .

  12. Anson Chng December 23, 2020 at 11:25 am - Reply

    thank you very much! liked and subscribed

  13. Mike December 23, 2020 at 11:25 am - Reply

    27:12 lol

    great video. learned a shit ton!!!

    if anyone is having issues with panda uses python 3.8 and not 3.9 (as of oct 25 2020)

  14. Jay Ram December 23, 2020 at 11:25 am - Reply

    VERY GOOD AND INSPIRING VIDEO

  15. Jay Ram December 23, 2020 at 11:25 am - Reply

    BAD

  16. Akhil Senthil December 23, 2020 at 11:25 am - Reply

    What editor is this

  17. Harry Trueman December 23, 2020 at 11:25 am - Reply

    Awesome

  18. Danny T December 23, 2020 at 11:25 am - Reply

    Beautifully explained. Understood everything from beginning to end. If you need to learn programming, this is the guy!

  19. Ozan Güven December 23, 2020 at 11:25 am - Reply

    this is the most valuable video on the whole internet

  20. Byron Tapia December 23, 2020 at 11:25 am - Reply

    do we need pycharm pro to get the CSV file?

  21. Khoa Cao December 23, 2020 at 11:25 am - Reply

    I really love your video. I have been struggling to understand the whole process of scrapping for over three years ago.

  22. Ameena Khalam December 23, 2020 at 11:25 am - Reply

    why we use class_(with this underscore) ,"?why simply class = not working

  23. Imran Shaikh December 23, 2020 at 11:25 am - Reply

    why the default installer of python is of 32 bit….when mostly now a days user has 64 bit OS and processor….but in python.org's download section 64 bit is for AMD not intel processor …so should intel 64 bit machine go for 32 bit python….if anyone has any answer plz share

  24. Qwerty December 23, 2020 at 11:25 am - Reply

    Hey, can someone help… For the temperature, the Farenheit wasn't getting displayed as it should. I get output like this

    ['Low: 56 xc2xb0F', 'High: 78 xc2xb0F', 'Low: 59 xc2xb0F', 'High: 68 xc2xb0F']

    How to fix it so output looks like it is shown in the video at 21:37?

  25. Prabaharan P December 23, 2020 at 11:25 am - Reply

    If inspect element disabled for a page how could we extract

  26. Daniel December 23, 2020 at 11:25 am - Reply

    Excellent Video Bro, You use a simple laguage for teach us ¡ PERFECT ! So clear all concepts

  27. Ben Brown December 23, 2020 at 11:25 am - Reply

    great video! cant tell you how many videos I had to watch in either broken english, something way too complex or abstract or just not relevant. A simple example like this of pulling the fields is what I needed. The other videos they are constantly making mistakes and typos just further confusing the viewer(maybe edit your videos before new people are trying to learn???). Thanks for explaining clearly!!!

  28. Diyar Mahmoud December 23, 2020 at 11:25 am - Reply

    This video is brilliant!

  29. nSane Gaming December 23, 2020 at 11:25 am - Reply

    very cool. this help a lot. definitely want to continue down the snake path

  30. faith ojeabulu December 23, 2020 at 11:25 am - Reply

    i cant get the code to show the csv file i dont know why!!!.. can someone help?

  31. Adwait Dathan R December 23, 2020 at 11:25 am - Reply

    Thank you for this great Explanation !!!

  32. J. C. December 23, 2020 at 11:25 am - Reply

    I just created my first scraper ever thanks to your video. Thank you!

  33. Ash December 23, 2020 at 11:25 am - Reply

    great video, super clear and easy to follow!

  34. Disgruntled Vet December 23, 2020 at 11:25 am - Reply

    This is awesome, I love it! Thank you!

  35. Disgruntled Vet December 23, 2020 at 11:25 am - Reply

    I hate list comprehensions. It doesn't make the code easier to comprehend lol

  36. Sunil Tirupathi December 23, 2020 at 11:25 am - Reply

    excellent explanation sir..

  37. Rafael Martins de Castro December 23, 2020 at 11:25 am - Reply

    Good stuff!

  38. Tatsuya Hori December 23, 2020 at 11:25 am - Reply

    omg this content is so great and the clearest and easiest to understand how beginners can work on web-scraping. I've been through so many contents to learn web-scraping with python, but there is nothing better than this one. Thank you so much!!!

  39. najmath beegum December 23, 2020 at 11:25 am - Reply

    I am getting this eror.. Traceback (most recent call last):

    File "c:/Users/ent/Desktop/CSS/Grpjoiner/pricescraper/test.py", line 13, in <module>

    period_names = [items.find(class_='period-names').get_text() for item in items]

    File "c:/Users/ent/Desktop/CSS/Grpjoiner/pricescraper/test.py", line 13, in <listcomp>

    period_names = [items.find(class_='period-names').get_text() for item in items]

    File "c:UsersentDesktopOnline Class FilesComputerlibsite-packagesbs4element.py", line 2160, in _getattr_

    raise AttributeError(

    AttributeError: ResultSet object has no attribute 'find'. You're probably treating a list of elements like a single element. Did you call find_all() when you

    meant to call find()?

  40. Barzhikev Il December 23, 2020 at 11:25 am - Reply

    Very useful stuff, dude. Thanks a lot!

  41. Rohit nain December 23, 2020 at 11:25 am - Reply

    which is the software? you used in this video for scrapping

  42. Yazan Sirriyeh December 23, 2020 at 11:25 am - Reply

    You're great man

  43. kunal kamble December 23, 2020 at 11:25 am - Reply

    mindblowing. explain very nicely. thank you so much

  44. Adnan Zafar December 23, 2020 at 11:25 am - Reply

    Hi everyone. I have created Python Web Scraping WhatsApp group, You can join https://chat.whatsapp.com/HzX1DzO5IAg1x0FBB7mLUT

  45. Denis Santos December 23, 2020 at 11:25 am - Reply

    Hey guy, it's really friendly and helpful. THANK YOU VERY..VERY…VERY MUCH, I saw tons of videos regarding this subject, but it was the only one that really explain in a simple words and good examples. Thanks a lot for sharing the knowledge.
    Can you please explain how can use this but to login in web site?

Leave A Comment

*