How to Rotate Proxies with Python

How to Rotate Proxies with Python

John Watson Rooney

3 года назад

118,270 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

Tips4Tat
Tips4Tat - 30.08.2021 17:33

Great video.
I think 3 things are REALLY worthy of note because the answer to the failures isn't necessarily that the proxies were blocked:
- Sometimes the proxies weren't able to be connected to in the first place
- Sometimes the Server can't handle so many back to back requests

AND
Some proxies are set up by malicious actors to gain unauthorized access to connecting hosts.

Ответить
KERRY-ANNE M MARTIN
KERRY-ANNE M MARTIN - 11.08.2023 23:06

Why would you say there is only one ip

Ответить
KERRY-ANNE M MARTIN
KERRY-ANNE M MARTIN - 11.08.2023 23:05

There are two IP addresses one is identification of the device and the other identified the ISP ip

Ответить
TECH WIZARD
TECH WIZARD - 26.07.2023 07:48

Checked more than 10 videos, all videos are awesome
Thanks Bro

Ответить
emma_Geal12
emma_Geal12 - 08.07.2023 01:53

Thanks! Do you know any services with rotating proxies that rotate every 60 seconds and were you can choose mix geo or a specific country? I have mine from proxy-stоrе but this is my first service, want to have cheap alternatives and to find out other options

Ответить
Light Blue
Light Blue - 03.07.2023 02:37

Thanks chief, informative and easy to understand tutorial

Ответить
Nanda Fadhli
Nanda Fadhli - 15.06.2023 12:08

Hi John, do you have any recommendation of the best paid proxy provider?

Ответить
ok
ok - 15.04.2023 20:22

Thanks so much for this video, I've had alot of problems with rate limits thank you John Watson Rooney

Ответить
Артем Коваленко
Артем Коваленко - 13.04.2023 23:32

Great Explanetion. Thank you!

Ответить
Đình Toản
Đình Toản - 22.02.2023 18:15

Thanks you so much❤

Ответить
Alex Presley
Alex Presley - 09.02.2023 23:58

Nice ❤ Thank you 🙏

Ответить
why amihere123
why amihere123 - 23.12.2022 19:24

Hello, is there a way to make it so the proxies are constantly changing via a api?? For example you have a 10k list of proxies with numerous sources, but the proxies get updated every 5 minutes

Ответить
Raph?
Raph? - 20.11.2022 22:40

"hopefully not get blocked" lol

Ответить
Marx Lenin
Marx Lenin - 01.11.2022 21:54

Ive been binging your content because of an amazon scraper I'm working on.

Can't help but giggle at the consistent struggle you have in typing "requests"

All in good fun! Keep up the great content!

Ответить
Edu Prata
Edu Prata - 01.10.2022 00:21

Excelent !!!! Very Nice Video John !!!!

Ответить
Atul Tanna
Atul Tanna - 07.09.2022 17:23

Can we use these for Scrapebpx?

Ответить
Atul Tanna
Atul Tanna - 06.09.2022 18:42

Can we create a proxy script Purpose is to use them for scrapebox

Ответить
shayan hdry
shayan hdry - 09.08.2022 13:01

thanks that was awesome thank you 
do you suggest any method for searching around 20000 words in a day in google and get the results? without getting blocked?

Ответить
ahmed abdulrazzaq
ahmed abdulrazzaq - 06.08.2022 11:05

How do you approach creating a bulk Instagram account? No API is available to create an account only way is scripting in the browser.

Ответить
Breadurite
Breadurite - 03.08.2022 21:59

How do I do this with proxies that use a username and password

Ответить
TaczankoV13 G
TaczankoV13 G - 29.07.2022 19:10

Couldn't agree more!

Ответить
Vamsi Vvc
Vamsi Vvc - 29.07.2022 17:09

i have soft soft trial version .7.1

Ответить
mehdi smaeili
mehdi smaeili - 29.07.2022 16:54

Excellent. thanks.

Ответить
Cl3mzer92
Cl3mzer92 - 29.07.2022 05:41

Totally agree, bro!

Ответить
ΠΑΝΑΓΙΩΤΗΣ ΓΑΤΙΔΗΣ
ΠΑΝΑΓΙΩΤΗΣ ΓΑΤΙΔΗΣ - 27.07.2022 17:19

I'm doing a bot traffic,and in authentication (log-in) i get a 429 error....I try to put some delays but nothing happent..Do you have any idea?

Ответить
ZH Crypto
ZH Crypto - 26.07.2022 05:47

plz make a video on proxies with selenium

Ответить
ZH Crypto
ZH Crypto - 26.07.2022 05:46

you deserve Millions of subscribers❤❤

Ответить
KOMO KOMO
KOMO KOMO - 15.07.2022 10:25

why my {'origin': 'myip'} just showing my real ip

Ответить
Future corpse
Future corpse - 08.07.2022 21:04

Beautiful content as always! I tried scraping the site in this video using bs4 as it's the only framework I know as of now. I hope you make a video on scraping this site as you said in the video.

Ответить
Henrique Crachat
Henrique Crachat - 04.05.2022 21:51

What if i want to send a POST instead of get, how can i use proxies with post ?

Ответить
anuraj ms
anuraj ms - 26.04.2022 19:04

thank you

Ответить
Nacho Eigu
Nacho Eigu - 21.03.2022 20:46

Is secure to use a free proxy page? In terms of cybersecurity I mean. Thank you

Ответить
Z.A Jafari
Z.A Jafari - 08.03.2022 11:00

Hi John, great video and thank you for your time and effort for creating these videos for us. I was wondering if you added the updated version of this video as you mentioned because I could not find any other tutorial on proxy on your site.

Ответить
imam suryadinata
imam suryadinata - 24.02.2022 17:53

How to rotate proxy and rotate payload login use selenium or use faster than selenium with cookies enable, sir give me sample pls 😥

Ответить
Ryu Higashi
Ryu Higashi - 22.02.2022 05:44

Hey bro, how are u?
I'm looking to buy a rotate proxy ip, would you know where you have it?

Ответить
Nelson Gomez
Nelson Gomez - 20.02.2022 19:49

Congrats John, it amazing video :)
Regards, Nelson

Ответить
Hypebeast Uchiha
Hypebeast Uchiha - 13.02.2022 12:36

Every time I have a python scraping problem I search your name
Great channel mate 👍

Ответить
jaspal patel
jaspal patel - 19.01.2022 06:29

how to use proxy and open 5 chrome browser at same time with different proxy and give individual task to them?

Ответить
Wuhan University
Wuhan University - 15.01.2022 20:52

It's really helping material. Thanks dear professor

Ответить
Wang Danny
Wang Danny - 14.01.2022 06:05

thanks for your video. so is it possible to rotate headers?

Ответить
Alistair Nakhai
Alistair Nakhai - 07.01.2022 02:38

Thanks John for yet another useful video - I'm new to web scraping & have been blocked from a site I want to scrape, I was wondering & Im sure there are packages out there to save the full content of a website locally so we can scrape with no issues & Im not talking about big sites such as Amazon - do you think this is possible if so why no one else is talking about it? how would you go about it please?

Ответить
Emiljan Mrizaj
Emiljan Mrizaj - 21.12.2021 17:35

Can you do a video on this but with scrapy?

Ответить
Heidi K
Heidi K - 14.12.2021 05:48

Mine keeps failing... any ideas why? Good video!

Ответить
BB
BB - 24.11.2021 21:53

Hey, add this if you want to scrape data without getting caught in google
.

sleep = random.randint(3,9)
time.sleep(sleep)

.
a little slow but when you send random requests, google thinks you are human :)

Ответить
Продюсер Мс Клоуна
Продюсер Мс Клоуна - 18.11.2021 18:30

thank you very much

Ответить