Ecommerce store product pages informations scrapping

[Loic]

Hello, thank you for all these contents

I’m still looking for scrap all informations (images,price,descriptions,size etc…) for my ecommerce store from a supplier website.

For example this one : https://burgschneider.eu/accessoire-medieval/headgear-medieval.html

I succeed to scrap the first image, title and price. But i need more informations who need to clic on the product and scrap inside.

After that, i need to do one click to go back to the next product.

How can i do with bardeen please ? Do you have a tutorial for this case ?

Thank you by advance

[ivan]

Hi Loic

This is the perfect example of deep scraping

This video will walk you though it.

The Ultimate Scraper Tutorial | Extract Data Without Code

It’ll be much clearer afterwards

It should be possible to do by:

1. Getting the links to all the products on the first list scraper. Use a list scraper for this.
2. With the links, you can “scrape data in the background” to get the title, price and other details. You’ll need to build a single page scraper for this page, for example
3. Run another “scrape data in the background” with a list scraper that gets the image list. This will be a list scraper.
4. Save all fields into a Google Sheets

Here’s an example automation that you can edit:

Shared Playbook | Bardeen

Demo walkthough

[Loic]

Thank you very much for your help !

Will try immediatly !

[ivan]

Following up, let me know if it worked!

Clossing this on some days

[Loic]

Hello Ivan,

Yes almost perfect !

in fact I’m still struggling to automate the whole thing.
Let me explain:
I extract the links with the list scraper but I get a list of links to download. They’re not directly in the google sheet.
So I download them, then copy/paste them into the google sheet.
I then use the data just scrapped with “find all links in text” and continue the process.
When the rest of the information is extracted from the links, there are two problems:
1/ The information is put in a row and not in the same lines as the links (see screenshot 1 ). I don’t understand why.

2/ The first image is not usable, the format is different from the image link. (see screenshot 2) . Why is this?

[Loic]

Hi again

I have another issue with Amazon comment scrapping.

I received this message :

Do you know, what that means please ? I don’t know what check to solve this error…

Thank you by advance,
Loïc

[ivan]

@Loic

1/ The information is put in a row and not in the same lines as the links (see screenshot 1 ). I don’t understand why.

Is it possible that you’re missing column names?

Or that the field mapping is not setup for this spreadsheet?

Basically, if you don’t configure it to map the data to a specific column, it’ll create other columns and fill them with the scraped data.

If you don’t find the cause please share the automation or a loom so we can check further.

Click on share → Unshare → Share so you send me your own updated version.

@Loic

2/ The first image is not usable, the format is different from the image link. (see screenshot 2) . Why is this?

It’s probably because of the page html layout.

You can refine the css selector to get the link you need. I’ll tag our team if they can check it out, but it might take some time.

Maybe ask for help on the selector on this post:

Bardeen's First-Ever Scraper Contest! Practice your skills and get credits

[image] Bardeen’s First-Ever Scraper Contest: Are You Up for the Challenge? Hello Bardeen Community! We hope you’re as excited as we are after the success of our recent Bardeen Masterclass event! Now, we’re thrilled to announce something special – Bardeen’s first-ever Scraper Contest! What’s in it for You? Participating in this contest is not just about winning; it’s an opportunity to: Practice Your Scraping Skills: Put …

…so you can participate on the scraping contest and share your usecase on Showcase

You can also join our upcoming scraper contest

Bardeen Workout: Mastering Bardeen's Scraping - Class 2: Deep dive! · Luma

[Loic]

Hello thank you very much
1/ you’re right ! but I don’t know how doing it, I don’t see any specific column to choice

2/ yes… the image was the zoomed image, my mistake. thank you

3/ lol yes, will try to do a correct extraction for me almost one time to start

[ivan]

Hi @Loic

Sorry about the delay. Wanted to follow up and check on your case!

Based on the images the mapping seems well done.

We still need more details to know what can be wrong.

1. A loom on what’s happening
2. Or the automation link (updated, as I mentioned) with some steps for us to run it

Cheers
Ivan

[Loic]

Hello Ivan,

Thank you !

here my try in video :

https://www.loom.com/share/2bab8be0f9394f1085affdd994ed8e76?sid=9a78b48d-931c-428b-a516-1deeb4768053

https://www.loom.com/share/869129743fd340be861139382425025b?sid=ddb1f468-c307-448e-9d91-e030c20abafc

here the playbook :

https://www.bardeen.ai/playbook/community/Ajout-produit-BDD-VKNG-rTqTYkRl7ZEux6J8cV

Here the scraper : https://www.bardeen.ai/playbook/community/scrap-images-VKNG-Nw8aLxg0SXENiqzhoK

Here the website page collection i try to scrap : https://www.vkngjewelry.com/fr-french/collections/new-products

Many many thanks by advances,
Loïc

[ivan]

Hi Loic

While seeing your videos I noticed you’re trying to do a deep scraper to get data from this viking website.

Deep scraping in this case is certainly possible.

Here’s 2 in depth resources that will help you learn about it:

The Ultimate Scraper Tutorial | Extract Data Without Code

The Ultimate Scraper Tutorial | Extract Data Without Code

Our community masterclass on advanced scraping.

Advise in your case:

This is not going to work.

The flow you need to follow is:

Step 1: Make sure you scrape this page with “scrape data in the active tab” and get the urls of each product.

Step 2: Then "scrape data in the background " for the urls collected on step 1.
This will allow you to get data from each one of these pages individually.

Step 3: Then you need to link the results from step 2 in the Notion database.

Also noticed this small fix: