Have you used a good general purpose LLM-powered scraper?

Question

I'm looking to either build or use a model or SaaS that could be used with a prompt like:Find the 10 biggest realtors in [CITY], then extract all their listings within [BUDGET] in JSON with all the data you can find.I'm looking for a tool that can use search inputs on any website, click next page buttons or handle infinite scroll.Is there a tool like that on the market that actually delivers?What I've seen for now doesn't seem good enough.

coderatlarge · Accepted Answer

One precursor question would be whether an LLM can extract the data you want from raw html even when copy-pasted manually. In my limited experience we&rsquo;re not quite there yet, but I&rsquo;d be curious to hear of others have different experience - or better yet, actual measurements against a baseline scraper.

mdev23 · Answer

I am working on an LLM agents tool that could probably help with this: https://recurai.comReach out and i'll try to get you setup: matt@recurai.com