HACKER Q&A
📣 indigoabstract

Can ChatGPT be trained on a specific project's codebase?


Does anyone know if it's possible to feed a project or parts of it(a few files) to ChatGPT so it can have the proper context when giving answer?

I think I would find it a lot more useful, if this was possible.


  👤 PaulHoule Accepted Answer ✓
Right now it has a limited attention window (short term memory) of up to 30,000 or so tokens so it can fit at most that.

If you could fine-tune the model you could feed in your code base and bake it into the network weights (long term memory)

With fine-tuning you could get good results with a less powerful foundation model than you would otherwise.