I am scraping LinkedIn company about pages
I created a specific scraper to capture 2 fields of the ‘Funding via Crunchbase’ blocks
The Scraper works on active pages but the automation misses these 2 fields
Please advise
Link to the playbook: Shared Playbook Template
Hi Nicolas,
Thanks for raising this issue. I’ve shared it with the engineering team who are looking into it. I’ll get back to you once it has been fixed.
Just so I understand you correctly, when you say the automation misses the two fields, you’re referring to scraping in the background correct ? or do you mean that even scraping in the active tab misses the crunchbase field ?
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community
This is correct. The scrapping works in the active tab for these two fields, but not when I’m running a batch with tabs in the background.
Nicolas de Kouchkovsky
+1 415-378-6734
On Nov 29, 2023, at 04:39, Vinohar Kumar (Support) support@bardeen.ai wrote:
After reviewing your issue in detail, we believe that it requires additional expertise for a resolution. Therefore, we have escalated your ticket to our higher-level support team. This team specializes in handling more complex issues and has the necessary resources to provide you with the best possible solution.
Please rest assured that we are committed to resolving your concern as swiftly and efficiently as possible. The advanced support team will review your case and contact you directly with further updates or if they need any additional information from you.
Your patience and understanding are greatly appreciated as we work to resolve your issue. In the meantime, if you have any more questions or additional information to provide, please feel free to reply to this email. We are here to help!
Cheers!
vin
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community
Hi Nicolas,
Sending you a quick update that our engineers have discovered some recent changes to Linkedin that make background scraping of certain fields more difficult. Scraping in the active tab is still possible.
They are working on releasing a fix in our next updte and I will keep you up to date when that is out. Sorry I don’t have better news.
Regards,
Vin
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community
This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.
Hi Nicolas,
Sorry for the delay but we are still working on this. Thanks for your patience
Cheers,
Vin
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community
Hi Nicolas! Just a quick check in to let you know that the team is still looking into this and we should have it fixed shortly. Thanks for your patience. cc: @vin_bardeen
Hi Nicolas,
The team have identified some issues with Linkedin not loading the full page when loading in the background. The temporary fix is to scrape these pages in the active tab and get URLs from a google sheet if you have a list of them. I’ve created a playbook with a scraper template that gets the funding information.
Playbook: https://www.bardeen.ai/playbook/community/Scrape-Linkedin-about-jhLUFN8JZTyw0ag6wm
I understand this might not be the solution you are looking for, however the team is working hard to address this problem.
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community
I understand you created a new scraper ‘Linkedin about Extended’ but I don’t have access to it if I try to create a new playbook as suggested
Nicolas
Hi Nicolas,
In the scraper action, if you click the little pen to edit the scraper, then edit the name and save it, it should save a version of the template under your account. You can then edit the scraper template and use it across playbooks.
Customer Support - bardeen.ai
Explore | @bardeenai | Bardeen Community