I think I would find it a lot more useful, if this was possible.
If you could fine-tune the model you could feed in your code base and bake it into the network weights (long term memory)
With fine-tuning you could get good results with a less powerful foundation model than you would otherwise.