Web scrapping : Infinite scroll and than click expand, than infinite scroll, than expand

❓Help and questions
1

Hello :slight_smile:

Here’s the problem I’m trying to solve:

  1. I need to scrap a list, and for the first part of it, it’s an infinite scroll. This part works perfectly.
  2. But at some point the infinite scroll stop working and I’m ask to click on an expand button to see more of the list.

Is there a way to handle both an infinite scroll, and then click on an expand button, and the resume with the infinite scroll, so on and so forth?

Thank you!!

1 Like
2

yeah ive got a similar issue of needing click plus infinite scroll

3

Thanks for bringing this to our attention. Could you share what platform you are scraping this from so we can try to reproduce it and help you find a solution ?

If the platform you are scraping sits behind a paywall, you could try setting the pagination selector as ‘Click Pagination’ instead and select the expand button for pagination.

Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community

4

It is indeed behind a paywall. I’ll try to do it as pagination see if it works. Thank you!

5

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.