LinkedIn message scraping infinite scroll problems

[sam3]

I am trying to create a LinkedIn message scraper that scrapes all messages in a conversation. I would like to use a message scraping template with infinite scroll that it will always capture all messages however then if I pass the data on to google sheet a separate row is created for each message. However, when i use a single page template that i have used to map the message it works fine. However, i only created the template by mapping up to 14 messages, so if i want to capture conversation longer than that it wont work and i dont wont to be adjusting my template everytime for a different scenario. Is there a way to make infinite scroll work?

Message Scraper as List with infinite scroll:

{{playbook_title}}

Message Scraper with up to 14 messages mapped:

{{playbook_title}}

[Bardeeni]

Hello Sam,

Scraping LinkedIn messages can indeed be tricky due to the page’s inconsistent structure. To help you, I’ve created a playbook that attempts to implement infinite scroll for your needs. Please give it a try and see if it resolves the issue: https://www.bardeen.ai/playbook/community/LinkedIn-Infinite-messages-vIn7F7o5cWMcT8SgU2

The process involves initially scraping the messages as a list and then merging them.

Hope this helps!
Victoria

Customer Support - bardeen.ai
Knowledge Base https://support.bardeen.ai/hc/en-us
Explore | @bardeenai | Bardeen Community

[sam3]

Gives this error every time and nothing gets passed on to google sheets