What do you find most difficult about fine tuning AI models?

Question

Those of you who have fine tuned NLP (GPT-X/Llama) or diffusion models, what was the most difficult or annoying part about the process?I'm trying to help solve problems in this field, so I'm curious about your experiences.

tlack · Accepted Answer

On the LLM side: the cost / amount of resources that need to be brought to bear for long periods of timeOn the Stable Diffusion side: labeling, best practices, file management, quality control

What do you find most difficult about fine tuning AI models?

Those of you who have fine tuned NLP (GPT-X/Llama) or diffusion models, what was the most difficult or annoying part about the process?
I'm trying to help solve problems in this field, so I'm curious about your experiences.

On the LLM side: the cost / amount of resources that need to be brought to bear for long periods of time
On the Stable Diffusion side: labeling, best practices, file management, quality control