Not able to Scrape the Website

❓Help and questions
1

We are trying to scrape a Website. We have created a playbook but it is only letting us scrape 30 contacts after that it is crashing up and saying “Access Restricted due to exceeded limit”. We have tried including time delays of 10 seconds in the scrape actions but it is not helping.

Our Playbook is here - WCA Website Scraper | Bardeen Community Playbook

2

Hi Victoria,

We are running on a trial and we plan on purchasing the tool because the use case of scraping is alot.

There are few websites that we want to scrape. If we are not able to scrape it then its going to be difficult for us purchase it.

If you can help me with this.. Its going to be very helpful.

Regards,

Shaz Khan
Digital Transformation Manager

shaz.k@sky2c.com

Sky2C Logo
www.sky2c.com

Version 1_2 New.png

CONFIDENTIALITY NOTICE: The information contained in this email, including any attachments, is intended solely for the use of the individual or entity to whom it is addressed and may contain confidential, proprietary, or legally privileged information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, copying, or use of this email or its contents is strictly prohibited. If you have received this email in error, please notify the sender immediately and permanently delete the original message and any copies.

3

Hi Shaz,

Thanks so much for your patience, and I apologize for the delay in getting back to you.

I’ve been looking into your issue and wanted to share a few things:

  1. I don’t immediately recognize the error message “Access Restricted due to exceeded limit” — could you clarify whether this is appearing within Bardeen or on the target website itself? That would help me better understand where the block is happening.
  2. I also reviewed the playbook and noticed a conflict in the configuration (see attached screenshot). Both the number of items and the number of pages were set — Bardeen expects you to choose only one. Once I corrected this, I was able to successfully scrape up to 50 items, but couldn’t go beyond that.
  3. Upon deeper inspection, it looks like the pagination button in the scraper isn’t functioning properly. The website you’re scraping seems to require a custom CSS selector for pagination, which makes it incompatible with general-purpose scraping tools. Unfortunately, I’m not able to assist with custom code or selector development directly.

That said, if you’re considering a Teams plan or higher, our engineering team can build a fully functional playbook tailored to your website for you — including the necessary custom logic.

Let me know what plan you’re considering or if you’d like help exploring the options!

Best regards,
Victoria

Customer Support - bardeen.ai
Knowledge Base https://support.bardeen.ai/hc/en-us
Explore | @bardeenai | Bardeen Community