Where to learn the cutting edge of prompt engineering?

Please stop trying to academize and intellectualize and nerdify what is simply questions/conversation. Prompt engineering is a forced meme, that's all it is.

Do customer support for OpenAI, lol. https://community.openai.com/

Answer enough questions, stay active enough, and you'll see the same patterns emerge. You'll probably make a lot of mistakes. You'll be corrected by other regulars and people you try to help will send you angry messages saying your prompt didn't work when utilised in the industry. It's a good way to learn. As a little bonus, if you do it constantly enough, OpenAI will give you this little "Regular" rank with a secret forum and such.

Langchain feels a little outdated IMO. I feel like OpenAI's in built tools might be a little ahead of it. It was originally designed to handle memory on the old completion API, but since OpenAI's chat API was released, it's not as useful. There's still good reason to use their completion models though - it performs higher quality responses for some creative uses. Agents built on them don't seem very impressive and OpenAI has their own "assistants" for agent-like stuff: https://platform.openai.com/docs/assistants/how-it-works

My opinion is if you want to find out what works best is to come up with a bunch of different variations in a context-free environment to not influence prior results, determine some metrics you are targeting, and start prompting away.

Then you will find the answer that works for you, and probably well more thought out than 3/4 of the articles you will find regarding this sort of thing.

  - https://arxiv.org/
  - https://www.microsoft.com/en-us/research/group/dynamics-insights-apps-artificial-intelligence-machine-learning/articles/prompt-engineering-improving-our-ability-to-communicate-with-an-llm/
  - https://cloud.google.com/blog/products/ai-machine-learning/how-to-use-grounding-for-your-llms-with-text-embeddings
  - https://amatriain.net/blog/hallucinations

  and general resources:
  - https://learnprompting.org
  - https://www.promptingguide.ai
  - https://github.com/dair-ai/Prompt-Engineering-Guide

Here's a great article that links to a lot of research: https://lilianweng.github.io/posts/2023-03-15-prompt-enginee...

This is something that came out last week: https://open.substack.com/pub/aitidbits/p/advanced-prompting

Annoying that is for subs only but If nothing else the graphic representation is good.

Is there a "cutting edge"? The space seems pretty pseudo-sciency

I'm reading some papers on arxiv right now, and trying to implement them in our codebase at work. Those papers usually involve doing some common sense thing and measuring the results. Anyone could have come up with it, but they did the data science and showed some evidence it worked.

If there is a better way, I would love to know lol