HACKER Q&A
📣 ofermend

Challenges with RAG


RAG seems to be the winning methodology for building Chat-with-your-data applications.

HakcerNews: what do you find to be the most challenging issue when migrating RAG applications from simple prototypes to enterprise scale?

  👤 samstave Accepted Answer ✓
Knowing how to do it?

AI / GPTs have splatted so much additional user-space-knowledge requirements its astounding.

What we should be asking is "how are we going to teach the youngsters faster" and that looks like a path diverged between two woods.... The one less followed by.

--

@ofermend - in the words of Jony Ive, if its so perfectly designed, you wouldnt need a case" (Tell that to IfixIt (YC alum) you Muppet. (Ive is the muppet in this, not @ofermend.)

And then the billions spent on putting more plastic and electronic boron in the waste. Visionary.

You always have to recognize a Visionary who brings amazing products to market without an exit plan for planned obsolescence.

👤 ofermend
What about data types? Are your RAG pipelines mostly using text data from structured data, from document stores, or unstructured data like PDF files, website content and the like? Or maybe enterprise applications like Salesforce, HR, project management, etc?
👤 billconan
even with RAG, it could hallucinate badly