Hi,
Iâve been using Bardeen for a while now and have come across a little issue I hope you can help with. I am trying to scrape a specific element on a page, but it doesnât seem to have a selector, so wonât allow me to scrape that one element, I have to scrape the whole block. Iâve tried to use xpath, but that doesnât seem to work either. The video below will hopefully better explain what Iâm trying to convey.
Hi Daniel
Sorry about the delay, the team was offsite and some conversations slipped thought the cracks!
Seems like youâre trying to scrape the location from Jobs.
Tried to get the selector myself and prooved to be tricky!
This selector gets you to the section:
â[class*=âjobs-unified-top-card__primary-descriptionâ] divâ
But Iâm blocked on how to capture the text
Involving our engineers @dan @manvel so they can teach us how we can approach this case.
Example:
Hi @ivan
Thanks for coming back to me. I have tried a number of times, in a number of different ways, but it seems like it doesnât have a selector if you look at my video.
I am able to copy the XPath and full XPath which provides the below, however when you paste that in the advanced options section it doesnât recognise it. If you could help at all @manvel or @dan it would be very much appreciated. Hope to hear from you soon.
//*[@id=âmainâ]/div/div[2]/div/div[2]/div[1]/div/div[1]/div/div[1]/div[1]/div[2]/div/span[2]
/html/body/div[7]/div[3]/div[4]/div/div/main/div/div[2]/div/div[2]/div[1]/div/div[1]/div/div[1]/div[1]/div[2]/div/text()
Hey @daniel
This is a very custom case, where the scraper is working fine, but you want a specific field.
So unfortnately, Iâm unsure how long it can take them to respond back
Consider these alternatives:
- Getting the location from the original text.
We have regex commands âfind values using regular expresionâ.
Iâve tried prompting ChatGPT to give you the regex you need and has worked quite well!
There might also be ways to extract the location with Google Sheets formulas, might be worth a try!
- Refining the scraper yourself
We recently did 2 workshops teaching about these topics if you want to learn:
Sept 14 - Bardeen Workout! Mastering Bardeenâs Scraping - Class 1: The Overview
- Finding a user who can give custom advise at
Jobs and Gigs
Hey @daniel this is an amazing use-case and we added support for it, lately. Now you can select text Nodes using XPath, should be available in the upcoming release.
Hey @manvel Thatâs awesome news! When is the next release? This is something Iâll definitely be implementing. Would you be doing a webinar or some sort of video explaining how to implement it once itâs ready to be used?