I am trying to scrape data lists from a competitors job posting website but whenever I try to scrape it scrapes the same data everytime it runs. How can I make it only to make it scrape new data that gets posted and not scrape datas that I already have scraped?
Hey @ksw09061995 this can be achieved though the
- “monitor when website data changes” trigger - and getting the updated items from the trigger
Or
- Using the updating commands from Google Sheets or Notion, so data is not duplicated.
Here’s an example of a sales automation that uses this logic.
If this sounds like it would make a big impact on your business, my agency offers automation power hours where we can get you set up quickly.
Let’s discuss your needs further on LinkedIn or schedule a strategy session.
This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.