I met a website which need roll down to get the informtion I want to scrape, is there any instruction I can use in Bardeen? now I need to roll down by myself everytime…
Thanks for advice.
Before posting:
Take 5 minutes to search among the forum for existing questions. The answer might already be there!
If you’re trying to build automation, try describing your workflow into Bardeen’s Magic Box (main search bar on the extension), Bardeen’s AI will try to build it for you
To automate the scrolling process, you should configure the Infinite Scroll as your pagination setting. Please refer to the screenshot below for guidance.
Additionally, I recommend reviewing our general guide on using Bardeen’s scraper, which you can find here: How to use Bardeen scraper.
Thanks for reply, but I'm using single page model, and need roll down before scrape, it reports no result if I use list mode and infinite scroll.
Is there other way to roll page down before scrape, in single page case?
Thanks you!
I’m using single page model, and need roll down before scrape, it reports no result if I use list mode and infinite scroll. Is there other way to roll page down before scrape, in single page case?
Thanks.
Victoria from Bardeen (Support) support@bardeen.ai 於 2024年8月19日 週一 下午3:42寫道：
Sure ^ ^
https://www.bardeen.ai/playbook/community/2-()-6zWOzfCUueVy5hubUO
In this website, it just show part of information firstly (1724231373811.jpg), and only when we roll down, it shows all page content (we can observe this form the bar show at right side)
=============================
R I Y A 芮亞國際有限公司
蔡 林 龍
TEL:02-86682697 FAX:02-89423279
MOB:0953-165-897 VAT No. 54712575
ADD: 23572 新北市中和區中正路755號6樓之二
=============================
Victoria from Bardeen (Support) support@bardeen.ai 於 2024年8月21日 週三 下午4:02寫道：
Sure ^ ^
https://www.bardeen.ai/playbook/community/2-()-6zWOzfCUueVy5hubUO
In this website, it just show part of information firstly (1724231373811.jpg), and only when we roll down, it shows all page content (we can observe this form the bar show at right side)
=============================
R I Y A 芮亞國際有限公司
蔡 林 龍
TEL:02-86682697 FAX:02-89423279
MOB:0953-165-897 VAT No. 54712575
ADD: 23572 新北市中和區中正路755號6樓之二
=============================
Victoria from Bardeen (Support) support@bardeen.ai 於 2024年8月21日 週三 下午4:02寫道：
Generally for single page scraping, you don’t need to scroll down scraper will take the page as a whole. Unfortunately I could not access the website to check what you are referring to, so could you please explain the problem here?
When setting up a scraper, you can select elements that are at the bottom of the page as well, is there a problem with it? It could be possible that page is not getting loaded completely due to insufficient delay, you can increase the delay to resolve this:
Report an issue category and follow this tutorial: READ ME: How to report a bug in Bardeen
