Hey! Scraping a directory site - best practice +method please

Hey Team Bardeen, hope everyone is okay.
I am looking to scrape directory sites - think this will involve be deep scraping as I want to go into the page as well as the list.

Is there a playbook or some guidance on this please?
Kind thanks

Hi Sam!

Deep scraping is certainly possible.

Here’s 2 in depth resources that will help you learn about it:

The Ultimate Scraper Tutorial | Extract Data Without Code

Our community masterclass on advanced scraping.

We need more details on which directory you want to scrape though.

Would love to see your :raising_hand_man: Introduce Yourself :D, maybe update your username to “sam”!

1 Like

Hey Ivan, thanks so much for getting back! I was watching you in youtube yesterday! My use case is specifically - futurepedia.io

Would appreciate some help, so we can get started.
Kind thanks

Love the use-case!

I’ve been a user of Futurepedia before.

What’s your use-case, just scraping it for directory purposes?

Or you plan to do certain workflow with it?

For this website there isn’t much complexities arround it :slight_smile:

You can setup a scraper for the general page or the category pages like this one:

Hey Ivan, thanks for getting back to me :slight_smile:
I have an AI blog and wanted to feature some of the tools on there.
Would be super grateful for a little guidance on making this happen. :pray:
Warm regards

Hi @Sam, Welcome to the Bardeen Community :slight_smile:

I’ve created the below video to get you started on this exact use case. It goes through creating the scraper templates you’ll need. Have a look and let us know if you have any questions:

Video Upload & Annotation - Gemoo

I hope this helps!
Thank you,


Thanks so much Jess! - that’s really kind and helpful.

We’ll try that and get back to you with any questions.

Warm regards
sam +Mari

1 Like

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.