How to deal with cookie popups? When scraping a list of homepages?

If i want to automate the process of opening a homepage and then scraping the infos, sometime there comes a pop up with accept the cookies.

Any ideas of how i can solve this?
Its always a different popup on every new homepage

Hi @0xdogged

If you’re scraping on active tab it you can manually remove the pop up. If you remove it once the page shouldn’t ask it again.

The struggle would be for scraping many different pages on the background, and all of them having these pop ups. What would be the use-case here.

We don’t have any features or precise workarrounds for this case, yet you can experiment with the scraper’s “click” action, yet the cookie pop up changes from page to page, so won’t work all the time.

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.