Python Requests Tutorial: Request Web Pages, Download Images, POST Data, Read JSON, and More

My next video will be a real-world example of a script I wrote to monitor my personal website. We'll use the Request library to monitor the site, and if it is down then we will learn how to send an email and automatically restart the server. I hope everyone finds this useful! Hope you're having a great week!

This Video is so helpful. I can not thank you enough

I was looking for a video tutorial for httpbins.org but I could not find one. You should add the keyword httpsbins as well so people can find your video.

Concise, clear, explanation and examples. Always hitting the key points with any fluff, thanks!!!

Awesome, now i don't have to save each page 1 by 1 when downloading comics, just add the link and presto!

great piece of work

Did he ever do the requests-html video? Can't find it. Edit – oh yes he did: https://youtu.be/a6fIbtFB46g

I didn't see the email of the job im applying for for a few days.

They need python to request and download using python.

Thanks for this!

No words can define Corey <3

Awesome Tutorial!

I'm crying inside cause that's exactly what I was looking for

Mind fucking blown man. I wrote my two py scripts today. Have limited experience with JS and AHK. I'm so excited to get more into python now. This video was so informational you just don't even know.

<3 <3 <3 . Thanks a lot. Great Video !

this video is worth watching. full of knowledge

10:04 Yeah, I think that same thing every time I open any library. Respect to those guys

Hi Corey! thanks for this video.
Can you please upload video about how to parse html page after login and save the cookies?
I tried to take some value from http page each day and it gives me error since the cookies change (using on curl)

Genial Corey, me gusto el video y era lo que buscaba, una explicación rápida y clara de que es requests y ademas lo haces con profesionalidad (+sub)

hi Corey, I have a question: How do i determine the download speed using requests library through a script? I don't wanna use pyspeedtest.

How could you import text files from sharepoint to python and save it as an excel file in a folder

Hi Corey, can you do a video on http redirects and how to capture the tokens that are generated in the url… your response is much appreciated

is this good if I want to learn RESTFUL API?

For anyone who needs the most of the code written in this session :

#pip install requests

import requests

r=requests.get("https://xkcd.com/353/&quot😉

print(r)

print(dir(r))

print(r.text)

#downloading images
r=requests.get("https://imgs.xkcd.com/comics/python.png&quot😉

print(r.content)

#writing a downloaded image to system

with open ('comic.png', 'wb') as f:
f.write(r.content)

print(r.status_code)

#200 is success
#300 is redirects
#400 are client errors .ie. if you don't have access or permission for you
#500 are server errors

print(r.ok)
#Return true for anything less than 400

payload= {'page':2,'count':25}
r=requests.get('https://httpbin.org/get&#39;, params=payload)
print(r.text)
print(r.url)

payload= {'username':'corey','password':'testing'}
r=requests.post('https://httpbin.org/post&#39;, data=payload)
#data is used for payload to be more likely in a form

print(r.text)
#no args as it is a url parameter
#form is uploaded
#to know what values the 'form' url expects, we need to look at the source code
#of the url

#most of the times the output we get will be in json, so we have method we could use

print(r.json())
#created a python dictionary from json response

#to capture that in a variable
r_dict=r.json()
print(r_dict['form'])

#the authentication done above is form based authentication
#there are other types of authentication like basic authentication
#'https://httpbin.org/basic-auth/corey/testing&#39; this a url which basic authentication
#and accepts only username= corey and password=testing

#in auth, we provide a tuple for input parameters

r=requests.get('https://httpbin.org/basic-auth/corey/testing&#39;, auth=("corey","testing"))
print(r.text)
print(r)

r=requests.get('https://httpbin.org/basic-auth/corey/testing&#39;, auth=("coreyms","testing"))
print(r.text)
print(r)
#<Response [401]> , so unauthorized response

#when checking if website is working or not it is good practice to keep "timeout"
#or else it might hand indefinitely, exceptions if api's in website take too much time to load

#'https://httpbin.org/delay/{delay} is used to delay the site by certain time
r=requests.get('https://httpbin.org/delay/6&#39;, timeout=3); print(r)

r=requests.get('https://httpbin.org/delay/1&#39;, timeout=3) ; print(r)