How To Scrape Multiple Pages on Websites | Web Scraping using BeautifulSoup

mam it's showing error code 500 on trying to print the request how to resolve it

it worked for me when i inspected the total number of pages:total_pages = int(soup.find("div", class_="_2MImiq").find("span").text.split("of")[-1].strip()) , instead of the "next" button and looped for it , added each number to the url

It's very difficult process. I think

In my case it shows page not found
how to fix it?

mam in case of while loop, problem is that when our code find("a",class_="_1LKTO3") tag it's find previous button link because class is same as next button tag. so it's again and again jump page no 1 and page no 2.

Will it work for Amazon

Great job!!!

can you please tell how to use while loop in case of different link in detailed

great explanation and she has good knowledge about this topic