Wanted to share something interesting I built with Bardeen + ChatGPT. I work in marketing and my employer shared a website of around 22500 companies (400+ pages) he wanted to have a team in India scrape and manually update missing information. The project would have cost north of $1-2k.
I figured I would have a go at it using Bardeen’s web scraping → Google Sheets. Thanks to Deyan Petrov’s help I was able to build the scraper and scraped 400+ pages and roughly 22500 records. It was actually super easy and took about an hour to scrape everything.
Then, once I had my list in google sheets, I used an extension called chatGPT for sheets to find rows that had incomplete information (ie. missing the website) and do a web search for the best website that matched the company name. The results were pretty incredible.
Love bardeen and can’t wait to discover more use-cases that would be helpful for marketers. If anyone has any questions about how I built this I’d be happy to share details.
“The project would have cost north of $1-2k.” – my instant though was, YOU SHOULD CHARGE easily 20%-30% of that and put that money into your pocket you still saved the company you work for at least a $1000 so you should get some bonus, my opionion.
22,000+ records later as I looked through the data I saw that many websites were missing as the firms hadn’t shared their website. I then used GPT for sheets with a prompt along the lines of “find this companies website” and ran the prompt for all of the companies that were missing their website.
I am curious how the same would have been done with bardeen? GPT for sheets is capped at knowledge of up to 2021 and cannot web search. Perhaps there is a way to use bardeen to access GPT-4 with plugins somehow?
Another option is to leverage our “Get HTML from page” + “Get text from url” combo, so you can get data from a company website, then extract what you need using the AI actions.