How to get the link for each profile

❓Help and questions
1

Hello guys, i have been working ti get the link for each profile on the KW website and i could not find it.

can someone help me if there is a way?
List website Keller Williams

2

Hi @emmanuelsanchez20 , unfortunately, I believe this exact use case is a current limitation of Bardeen as the website is using jquery to call the links for each profile card instead of within the html.

With list scrapers at this time, the “Click” action does not loop through all of the profile cards so we wouldn’t be able to tell it to click and then grab the page link and then go back to the previous page.

However, Bardeen is currently working on implementing a web agent that will be able to accomplish this use case easily. I hope this helps!

I should also mention from my perspective - For this specific use case, I’m not seeing an easy way to build the URLs ourselves to scrape from within Google Sheets using a formula.
Aaron Aad - Profile Link Structure:

https://www.kw.com/agent/UPA-6587385417814085640-0

I can’t find UPA-6587385417814085640-0 in the html of the original page so we cannot list scrape it from here:

https://www.kw.com/agent/search/TX/houston

However, it does look like both pages have the Name (Aaron Aad), and the LICENSE # (692211). I would also scrape the Market Center (KELLER WILLIAMS MEMORIAL).

If we scrapped the full list of Name, LICENSE #, and Market Center from the original page, added to GSheets, and created a formula to build the URL off of a search on Google where the profile url being the very first result. We could then scrape from those Google URLs, creating a deep scraper single page template to scrape the very first result of the search to get the profile URL from Keller Williams for all agents.

I was able to return Aaron Aad’s profile link as the top google search result with the following input:

Keller Williams Agent 692211 Keller Williams memorial

Here’s the Google Search URL for the input:

https://www.google.com/search?q=Keller+Williams+Agent+692211+Keller+williams+memorial&sca_esv=562216108&biw=1529&bih=699&sxsrf=AB5stBi4D95eHGQajWxZuHx6JFC8LjDw7w%3A1693678336865&ei=AHvzZM2zNKKsptQP__qJ6AQ&ved=0ahUKEwjNs4e9w4yBAxUilokEHX99Ak0Q4dUDCBA&uact=5&oq=Keller+Williams+Agent+692211+Keller+williams+memorial&gs_lp=Egxnd3Mtd2l6LXNlcnAiNUtlbGxlciBXaWxsaWFtcyBBZ2VudCA2OTIyMTEgS2VsbGVyIHdpbGxpYW1zIG1lbW9yaWFsMgUQABiiBDIFEAAYogQyBRAAGKIEMgUQABiiBEivJFCOBlj1InABeAGQAQCYAYQBoAGPFaoBBDYuMTm4AQPIAQD4AQHCAgoQABhHGNYEGLADwgIIEAAYiQUYogTCAgUQIRirAuIDBBgAIEGIBgGQBgg&sclient=gws-wiz-serp

This video at 23:37 will help show you how to build the URL inside of Google Sheets using some formulas =Encode and =Concatenate.

1 Like
3

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.