Advanced Web Scraping with Puppeteer: Avoid Looking Like a Bot and Pass Authentication!

i am passing html as string to it and making pdfs, but images are not getting load, but same thing works in nodejs

Thx Kevin. Just wondering if one can use the same code with puppeteer-core

How do we solve captcha with puppeteer KDB?

How convert multiple script Node.js & Puppeteer to one file?

That's really helpful, thanks a lot

Thank you this video helped me do some not so savory things you r the goat!!!!

Im gonna change from Manucian to the citizéns

Can you show the case where you log in with Google

Never knew Josh was German 😂

great video

Hi Josh just wondering how you used cjs modules along with es6 modules, cos i can't seem to make it work

After 2 or 3 requests amazon fails.
Tested the modifying to the plugin and stealth in de video, and still failing the same amount.
Gonna have to learn and test with Crawlee.

where can i find the code please ?

What's the ultimate solution for resolving captcha?

life saver

+1

“well… we look like a bot. maybe because we are a bot” 🤣

legend. great video

Im a laravel dev and was really strugling with a scraping task .. but Allah (God) sent you for my help :) Thanks a lot
Love u

I have a question, instead of manual passing authentication, why can't I just login manually and then pass the cookie into the script. Is that harmful or something?

Would this still work in 2024? Or have big companies came up with the 'defence' already?

do you know any similar plugins for python

Got myself unstuck because of this video. Thanks man,

Have you tried doing the same on ebay and try log in? They still detect even if you use stealth!?

Thank you so much! This helped me out on a very important project.

thank you so much!

First of all nice video ! What can we do about two factor authentication ?

Looks like waitforTimeout will soon be deprecated. Is it a way to enforce headless true?🤔

source code😭😭

svvveet, works great with python pyppeteer also. thanks for the vid

So i guess if the login required to use gmail to login, it wouldn't work because the browser that is opened doesnt seem to allow gmail login api

can you explain how the secret.ts file is structured if we wanted replicate feeding in the login credentials from a different file vs hardcoding?

you're awesome!

It is not working on production server, What can i do?

perfect content ,thats what i need to learn ,in case i use it some day in some CTF ;)

Thanks Kevin De Bruyne

bro, I actually found out that u can set headless to false in the launch options and it works

thx i search how to fix the err in min 5 ,very helpful

How to send a form and catch, rename, save a file?

Each video adds something "advanced". Let's continue. Thank you.

is there any way to type like a real human does? with random key taps?

Your videos idea is mind blowing keep going mate

That’s so interesting. I didn’t even know we could have this report as an image. We’ll I think that I’ll spend my weekend working on my bot - however how to host them? Do you have a raspberry pi at home or do you use a regular host online?