Scraping with a Click Feature

Hi, I need to scrape this: Covered California But apart from a bunch of stuff from the main page, I need out of pocket maximum that appears after clicking on Plan Details. I’ve tried using the “Click” action (I added a delay after) but whenever I add “Click” and then try to use it, it keeps saying that my last command returned no results. I’m not sure what I’m doing wrong. This is my template: Scraping apply.coveredca.com | Bardeen Community Playbook Thank you in advance!

Hi @anna.gmaj

To accomplish this in Bardeen, you actually need to use two scrapers. (This is what Bardeen calls “Deep Scraping”)

  1. the first scraper to get the URL on the “Plan Details” pages (List scraper to grab them all from the main page)
  2. Then use a second scraper (single page) (Scrape data in the background) to scrape the URLs in step 1 to get the “Out of Pocket Maximum”

I hope this helps!

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.