Hi everyone I scraped a list from a website and put it in a google sheet, now i need to deep scrape all these links o pages that I’ve collected.
I’ve built the scraper and created this playbook:
The problem is that the scraper put as output in the apposit sheet only the data’s of the last page in the row of each page as shown in the loom bottom here:
Hi Giacomo,
Thank you for sharing the video, it helped a lot! I can suggest you try our designed flow for deep scraping which would look like below for your case:
Get table from google sheet > Scrape in the background > Update rows of a google sheet. To assist you further, here are some resources that might be helpful:
Hope this helps!
Victoria
Customer Support - bardeen.ai
Knowledge Base https://support.bardeen.ai/hc/en-us
Explore | @bardeenai | Bardeen Community
Since I have a server where I run Bardeen makes no sense to run in background because it’s extremely expensive. I have around 150k rows to scrape
Il giorno lun 30 set 2024 alle 08:26 Victoria from Bardeen (Support) support@bardeen.ai ha scritto:
You can try to use “navigate to URL in the current tab” and then do an active tab scrape. Honestly, though, if you are using the product for work (which it sounds like), you should be paying for it :).
I understand and I could agree but if there is a freemium version it should work. I use premium accounts for more complex stuff or scheduled autobooks.
For this specific needs would be nice to can use it since i’ve aserver just to run bardeen (autobooks ecc).
Anyway I’ve shared my playbooks and its already using navigate to URL in current tab, you can also see the loom to better understand the situation. Why its not taking each page even if I use the loop node?