Scraping photos URLs from gallery

❓Help and questions
1

Hello!
I’m trying to scrape full gallery photo URLs of a given Zillow listing
For example:

tried different ways but I’m trying to get:

  1. ALL photos from the gallery and not just the few first ones on the detailed page.
  2. the high-resolution photo URLs and not the lower-resolution photos.

Thank you!

2

Hi @sefibartov

I just created this quick playbook with a list scraper that you can recreate in your own automations. I was able to get all 54 URLs from the Zillow listing example url you’ve provided above with this playbook:

image
image645×583 27.7 KB

It’s kind of a tricky one, but essentially you need to use the special “Click” action on the button labeled “See all 54 photos” located here:

image
image1038×731 86.7 KB

Then you can created the container of the scraper on all of the photos you are looking grab. Container CSS Selector specifics below:

section#viw-modal:first-of-type > div:first-of-type > div:first-of-type > ul:first-of-type > li

I also added a delay after it scrapes the image to account for the other images to load upon infinite scroll before scraping the next image.

I hope this helps!
Thank you,
Jess

3

Thank you, Jess!
few issues:

  1. I tried out your playbook but it seems that the click action isn’t working and the message I get is :
    image
    image756×361 24.9 KB

it does work if I run your playbook after pressing the “all photos” button first by myself

  1. I need the higher resolution photos, that can be found in the gallery itself, after pressing on the first photo, it will pop up a new view with one pic at time. those pics are in higher resolution and those are what I need.

please advice,
thanks!

1 Like
4

@sefibartov oh I see, I was missing the correct navigation to the high resolution photos via clicking the first photo. In this case, here’s what we can do this in two automations:

  1. Execute this first automation from the below URL to add the URL to a GSheet and begin building the final URL to Scrape from to use in the second automation. Also get the total Photo Count:
    image

Results in GSheet: Zillow - High Resolution Photos for sefibartov - Google Sheets

image
image926×941 36.9 KB

The second sheet is building the final URLs via a concatenate formula:

image
image1187×936 45.3 KB

  1. Step 2 is a tad manual, but doesn’t take long - simply drag and drop the two columns in Sheet 1 in order to equal your total number of photos to grab (54 in this case, but the final photo is always just an add it appears so I’m doing 53): Manual Drag & Drop in GSheet to build URLs
  2. Execute the final Automation to scrape the high resolution photo urls in the background of the built URLs from GSheet:
    image
    image1411×928 179 KB

FWIW, I would’ve expected Bardeen to be able to use scrape in the background with a list scraper using pagination via the first URL link to get these results, but for some reason, I was unsuccessful taking this route initially. Therefore, this is my workaround.

I hope this helps!
Thank you,
Jess

5

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.