What are some good APIs to interact with large language models?

Going through middle layers has pros and cons. You'll likely find better docs and experience by going through the official APIs directly. Maybe start with OpenAI and/or Claude official libraries, both provide pretty good docs.

If you really must use a wrapper, a strategy I use is to look into open-source apps I like and see what they are using. Aider for instance seems to be using this "litellm" thing... If I were to need cross API support for AI, I would probably look into that [1]. llm uses opeanai directly [2]. Etc, etc.

--

1: https://github.com/Aider-AI/aider/blob/e76704e261647348fd7c1...

2: https://github.com/simonw/llm/blob/d654c9521235a737e59a4f1d7...

I used runpod.io prior to buying a pair of 3090s. They make it easy to run vllm too so you can experiment with different models.

I also rented a GPU vm from them and ran huggingface models on it. That did require lot more coding and learning.

https://docs.runpod.io/serverless/workers/vllm/get-started

Openroute.ai works very well; we use it for everything.

Unstract, if you are into automating document processing > https://github.com/Zipstack/unstract?tab=readme-ov-file#-eco...

https://github.com/simonw/llm

I'm using Lemonfox for barebones speech-to-text translation.

Replicate.com? Has a good variety of models

lmstudio.io