I´m doing some big scrapping with Bardeen, but its slow (need around 10 data bases and it takes around 1 hour and a half per database), if I get a better computer would it run faster?

[ivan]

Question: I´m doing some big scrapping with Bardeen, but its slow (need around 10 data bases and it takes around 1 hour and a half per database), if I get a better computer would it run faster?

Reply from @ivandavidescobar1:

In general, yes, if your computer has better features it should be faster.

Yet maybe there’s ways we can optimize this automation. If you can share the automation link we can explore it.

Also, @Deyan_Petrov recenlty shared a hack on how to scrape data in chunks , which might be very useful in this case:

Scrape in Chunks

Hello everyone! I’d like to share the resources from the Bardeen Workout that focus on scraping data in smaller portions. For those who couldn’t attend the Bardeen Workout, I will create a video tutorial on how to use the accompanying book. Stay tuned for that! To access the materials, please make a copy of the Google Sheet provided. You can find the book at the following link. In the workshop, we utilized a specific website as an example, which you can visit here. I want to mention that dur…

(Imported from Slack)