I am trying to fetch the details from the list integrated within a web page.
i can successfully scape the first page but when moving to next page the data is lost or is limited
Note: I’ve implemented the same as reference :https://youtu.be/xCwLmKMIn3c?si=wNxOTtwu_f0t3Ucr&t=187
As seen in the screenshot, the page link stays same(no change in query)
Hi there,
Thank you for sharing all the details! I see that page link is not being changed once “Next” button is clicked. Unfortunately this is why scraping is not working as intended, it relies highly on fetching the unique links. In order to perform scraping in this specific environment I suggest you try running the playbook on every page manually and remove pagination from scraper settings. I’m afraid this will be the only solution.
Let us know how it goes or if you have any other questions.
Victoria
Customer Support - bardeen.ai
Knowledge Base https://www.bardeen.ai/tutorials
Explore | @bardeenai | Bardeen Community
This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.
