Python Web-scraping with Selenium vs Scrapy vs BeautifulSoup | Witcher project ep. #1

The website I am scraping from gives me captcha to check whether I am human or not. Is there any way to avoid this??

Why it returns an empty list in book_categories when I typed "book_categories = driver.find_elements(By.CLASS_NAME, 'category-page_member-link')"

Hi Thu, how can i support you besides making purchases on your affiliate links. Let us know

any advice with crawling through a website with a lot of "a href" elements, especially when they are child elements. using selenium it seems to struggle. is selenium even the right tool.

Thanks!

Such a good video . I loved it 🙌🙌🙌🙌🙌

Thanks for the video
I'm having issues in this project, it keeps giving me


AttributeError: module 'selenium' has no attribute 'Chrome'

Please what can I do? Your input will be highly appreciated

You're so rush

Very good content, congratulations for the videos and for the didactic. It's a lot of fun to study and follow your content, it made me enjoy using Python again

Awesome :)
part 2 please :D

driver.get(pageURL) is showing error. can you help me.

How to write code to scrap information from websites on first 3 pages of google search engine. I mostly see solution for single URL but to extract information. I need something comprehensive. Can I give website as argument?

BTW find_element_by_class_name is deprecated. Should be find_element(By.CLASS_NAME, "class name"). Like you used for the xpath

Hi Thu, I have one question - the Wiki Terms and Conditions page forbids any kind of scrape of its content. Isn't this a little, let's say not legal? Thanks <3

Ah yeah i love the Witcher books! And showing how solve real problems in your process is great since i learn better with visuals this is a great series!

This confiemd some doubts I had about what types of framework/libraries I'm using. Thanks!

Thank you so much for this video! I've struggled with data scraping for my project, but with your tutorial, I managed to get the data I needed!

Thanks for sharing you knowleage Thu! Besides training my English, I learn more about data science. :)

I can not for the life of me get past this error: "WebDriverException: Message: chrome not reachable" whenever I try and run driver.get(page_url)

Thanks for that ! thanks to you I managed to use it for the lore of a game I love !