Scraping wellfound.com

[chris1]

I am trying to scrape www.wellfound.com/jobs for sales executives and account managers. It looks like it is scraping the information but not adding it to Google Sheets. I have Sheets set up correctly.

I have tried several times with different setups, and it is not working. I am unsure if I got my IP blocked or if they make scraping difficult.

[Jess]

Hi @chris1, could you please share your automation?

If you show results on your scrape action, you’ll be able to determine if the scrape is pulling data or not.

I hope this helps!

[chris1]

I have it set up to ask me every time how many job posts I want to scrape. 100 is the number I gave it on the last scrape attempt.

[Jess]

Thank you for that extra information. Are you able to share the automation?

[chris1]

Shared Playbook | Bardeen

Thank you for the help.

[Jess]

Thanks @chris1 - your automation is not setup correctly for the following:

@chris1

I have it set up to ask me every time how many job posts I want to scrape. 100 is the number I gave it on the last scrape attempt.

• 100 is being input into cell A:1 because the “ask for data” is input on the “Add text to Google Sheet” action:
  
  
• the “ask for data” should be inside of the “Scrape data on active tab” on one of the two fields here:
  
  
  
  – these tell you the number of items to scrape OR the number of pages to scrape, only choose one. It sounds like in your case you would choose the first one - items.

You also then would need to update the “Add text to Google Sheet” action to pull in the scraped data from the previous action like so:

Here’s your updated automation:

Shared Playbook | Bardeen

I hope this helps!