I am having a similar issue with linked search results using the bardeen template. I have had 4 searches with 56-241 possible results to scrape, and only one of them has scraped the full amount of results (147 results). The rest have returned 50-80 results. I’ve tried rerunning the results as well and I get different number of results every time.
I’ve watched the scraper function. The list function is able to paginate and grab all of the results. And based on the amount of time it takes to load and scrape each page, it seems the scraper is running through all the accounts, but only 40-60 actually get posted to my google sheet.
I believe the issue has to do with me interfering with the active browser window…is there anything I should avoid doing so that I don’t interfere with the headless browser?
Also is there anything I can do to free up the headless browser to go faster?