Deep scraper on youtube not working properly, single page model works once then breaks

Deep scrape playbook - Shared Playbook Template

single page scraper - Shared Playbook Template

This playbook is supposed to:

  1. Scrape youtube search results
  2. Go through the list and fetch the socials from the youtube channel page (instagram, tiktok, etc)
  3. It will display them as text

The single page “about” youtube channel model works on the profile its designed on and then stops working and grabs a random recommended video from the youtube hompage.

Am i using the wrong selectors? I dont know whats going on here I spend all day on this, any help would be appreciated.

Here are the steps and selectors i’m using for a youtube channel:
(Lets use the bardeen youtube channel for example)

  1. When on a channel click the element with the id of #content this opens up the detail view of all of the links and additonal bio
  2. use div ID of #link-list-container and copy all of the text in the link div

Thats it

Hi Nick,

Thanks for sharing this request. Just reaching out to say we are looking into it and will get back to you soon. Thanks for your patience

Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community

Hi Nick,

Thanks for your patience. We’ve created a playbook template for you that scrapes youtube search results and then opens each profile and scrapes the about page of that profile. This was a tricky one as the pop up that contains all the links takes some time to open up when loaded in the background, so we had to add a 40s custom delay.

If you would like to add additional fields to the scraper, feel free to edit the scraper template in the playbook we have created just for you.

Here you go: https://www.bardeen.ai/playbook/community/Youtube-profile-deep-scrape-iwx2TzqiogXanZUMBO

Cheers,
Vin

Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.