HACKER Q&A
📣 tikkun

What open source LLM and diffusion projects do you rely on?


The a16z grant program is cool!

My favorites from the a16z batch were: TheBloke, vLLM, oobabooga.

My suggestions would be:

ExLlama, MLC LLM, an open source fork of text-generation-inference, AutoGPTQ.

What other projects do you rely on?


  👤 PaulHoule Accepted Answer ✓
SBERT