HACKER Q&A
📣 supportengineer

What AI role is this?


I don't have firsthand experience, but I imagine there is a job role like the following:

1. You have a standardized set of GPT prompts, and you can run them with a script and collect the results.

2. You analyze the results using some metrics (including subjective, manual analysis)

3. You want to change or improve the results, or if you are satisfied you stop/exit this loop.

4. You create, add, or modify the original source material training docs

5. You run the process that creates a new model (weights)

6. You go back to step 1 and repeat.

Is this a role in the real world? How do you find such positions?

  👤 minimaxir Accepted Answer ✓
Those are complementary skills for data scientists/machine learning engineers who know about LLMs and their advantages/disadvantages. It is not a job role on its own.
👤 mfalcon
I think that the description fits what a data scientist usually does. LLM knowledge could be considered as part of the stack.