HACKER Q&A
📣 theogravity

Prompt manager for developers / services?


I'm working on a system that utilizes OpenAI / ChatGPT and hard-code a lot of prompt or chunks of prompts that would be combined together in variables.

Is there a product out there that allows me or a product person to:

  - Store a list of prompts in a key/value like fashion
  - Has an API where I can request a list of keys back and get the prompts corresponding to them
  - Has version history
  - Can assign a version of a prompt to a particular environment (eg dev, prod)
  - Lets others edit prompts
  - (Optional) Can test prompts against an LLM
  - (Optional) Can listen for updates to prompts like how Launch Darkly can push flag changes in real-time.
I've searched for "prompt manager", "ai prompt manager", "prompt management tool", and variants. The tools that do come up seem to be geared for non-developers or has no API for me to just fetch plain text prompts for use in our own LLM in our own infrastructure.

The core of it is probably a hosted versioned K/V system with ACL, and an API to access that K/V wrapped around a GUI.

  👤 breckenedge Accepted Answer ✓
Like promptfoo? https://github.com/promptfoo/promptfoo
👤 colesouth
I'm building a consumer facing prompt manager (https://promptfolder.com/ - no API yet), but I've looked at most of the other tools... unfortunately I haven't seen anything that is a solid fit for what you're looking for.

You might want to contact the devs behind PromptPal (https://github.com/PromptPal/PromptPal), they seem to be some of the more technically advanced and fast moving people building in this area... maybe they can hack something together for you.

AIPRM is one of the more popular prompt managers, but as of May they don't have a public API (https://forum.aiprm.com/t/use-aiprm-prompt-templates-api/382...).

👤 juntao
Maybe you can try https://flows.network/, which supports environment variables when creating an app. You can also manage the environment variables later with their UI. Click on https://flows.network/flow/createByTemplate/Telegram-ChatGPT, you can see you could set up system_prompt.