List scraper with 'show more' caret needing to be clicked

Hey Tj

I’m guessing you’re using the list scraper here, which will allow you to get the specified fields.

We should treat the “show more” as a pagination button in this case.

So instead of running the “click” option, change the pagination to the “next button” type and click on “show more”.

We might need to refine it with CSS selectors if it’s not working.

I guess that’s your case, which can be tricky.

We gave a masterclass recently on how to use CSS selectors.

But for us to help further we will need the link to the page, or the HTML file of the page so we can take a look.

To do so, get the page HTML file like this:

Share the HTML file of a page . compressed

Tagging @dan who can help us check this further.

Yet consider this is a custom check we need to do, and we’re not sure how long it’ll take.

Other options are to learn how to refine this case with the CSS masterclass I shared or search for help on :briefcase: Jobs and Gigs to refine your scraper. If you’re on Bardeen pro you can also share the case to our premium so we can give it a faster push :slight_smile: