I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM).
LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://github.com/danny-avila/LibreChat/discussions/3760#discussioncomment-10445600
My Questions:
1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users.
2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable?
Update: It would be great to run a self-hosted open source stack.
I don't use typingmind as a team, but they do have a team product and typingmind can be hooked into any LLM service.
Is a good tool.
Built around teams so you can build and share AI assistants based on your data.
Additionally, would love to chat about your use case. Seems really interesting. My co-founder and I are building out a solution to a similar problem.
Ping me, email is in the bio.