I am embarking on a project where I need to scrape the experience section of LinkedIn profiles, encompassing company names, roles, and durations. However, I have hit a roadblock due to the variable nature of the HTML structure of LinkedIn, which seems to fluctuate from profile to profile. The conventional methods Iāve tried so far are falling short in capturing all the necessary details consistently.
I am reaching out to see if anyone here has tackled similar challenges and could share insights or strategies.
It can be the case that those fields are not available on our Bardeen pre-built scrapers.
It thatās the case, then you might need to refine the CSS selectors from those fields (bardeen advanced features) so you get the expected information.
We recently did 2 classes teaching about this topic, check them here: