Iād be willing to pay $50 for someone to create a video creating the following custom automation to scape data from a specific tab into Google Spreadsheets
Thank you - if you can do it 2 days I can certainly pay you for the job. Will pay once you simply take a screenshot of the result before you deliver the final video product.
Hi @mpressusa, please find the automation, video, and GSheet links for this use case below:
Please note the execution of the playbook took longer than the video shows as I paused throughout most of it. In total, it was probably around 40 minutes. Video - Furniture Stores in Houston TX from Yelp
Please note, there 240 rows that matches the total search results.
Thank you Jess for working on this. I went ahead and issued the donation for your help!
I do have an issue though - it looks like the scraper is stuck partially. Is it because I have to open specific windows or have google spreadsheets open and have it as an active tab in order for the scraper to work?
As mentioned above, it took about 40 minutes or so to actually fully run so please be patient. The google sheet will not be populated until the completion of the automation - this is normal behavior.
Just make sure youāre executing it properly while on the active tab to scrape and it will work.
I ran it for about an hr and half and it is still stuck.
I think there is an error somewhere after you scrape the 24 pages in the initial active tab. The spreadsheet doesnāt get populated at all and it looks like the scraper is opening 1 tab in the background but isnāt doing anything after that.
Is it because I need to have a spreadsheet named āFurniture Stores - Houston, TXā created prior to running? Thank you
Ahh, yes! Create the google sheet and name it whatever you like and provide the column headers as well. Then go into the automation and complete each input field on the last action.
I tried recreating the steps at least 5 times already.
For this step it just opens a new tab in the background and the bottom right of the new tab shows āstop scrapeā. It looks like it isnāt running on the tab I have open already?
I see in your video that after say 3-5 minutes it starts moving. I waited about 10 it is still not moving. I am pretty sure something is broken unfortunately
Itās not broken, I paused the video so it wouldnāt be a hour long just waiting for it to scrape. Just let it run and do its thing. Remember it is deep scraping 240 links with a 2 second delay in between each page load so it will take some time.
If you want to share your playbook with me, Iād be happy to take a double look to check its setup correctly.
Hi Jess - Unfortunately I left it for 3 hrs and it is still stuck. My internet and computer CPU is very fast so it should not take this long. I am pretty sure something is not working correctly unfortunately. Can you please make the adjustment to scrape data in Dallas in a quick video please?
I would recommend running it on chunks if itās a very large list.
Yet there isnāt much Jess can do in this case, if youāre scraping hundreds of rows at a time it might take time since Bardeen currently runs on your browser.
Weāre soon releasing Cloud Supported automation which will solve this.
