HACKER Q&A
📣 jonathan_ds

Has someone come up with an unified protocol for LLM communication?


Has someone come up with an unified protocol or standard for LLM communications?

Something like webstandards or TCP, because I feel like the same thing for each vendor, agents are becoming a thing, embeddings are well defined, streaming responses is pretty much standard all around.

I understand there are libraries like langchain and vertex AI SDK, but I'm surprised I could not find any draft or paper around the subject.

I guess there's the argument on why would the vendors follow such standards protocol, but then again the same could be said about many standards.

My best guess is that with the current market we are in the very begining of the technology and vendors simply did not have the motivation to do something like that.


  👤 TowerTall Accepted Answer ✓
This was posted yesterday: Local TypeScript Super SDK to Call 200 LLMs

https://news.ycombinator.com/item?id=41844517


👤 newaccountman2
Text is such a protocol.