Web scrapping : Infinite scroll and than click expand, than infinite scroll, than expand

Hello :slight_smile:

Here’s the problem I’m trying to solve:

  1. I need to scrap a list, and for the first part of it, it’s an infinite scroll. This part works perfectly.
  2. But at some point the infinite scroll stop working and I’m ask to click on an expand button to see more of the list.

Is there a way to handle both an infinite scroll, and then click on an expand button, and the resume with the infinite scroll, so on and so forth?

Thank you!!

1 Like

yeah ive got a similar issue of needing click plus infinite scroll

Thanks for bringing this to our attention. Could you share what platform you are scraping this from so we can try to reproduce it and help you find a solution ?

If the platform you are scraping sits behind a paywall, you could try setting the pagination selector as ‘Click Pagination’ instead and select the expand button for pagination.

Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community

It is indeed behind a paywall. I’ll try to do it as pagination see if it works. Thank you!

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.