How to run LLM-based experiments in lab environment? I'm a PhD student focusing on system security, and recently we are trying to catch the trend and find some security issues in LLM training. However, it seems tricky to me on how to set up the environment or simulations. We can buy few A100/H800, is there a standard way to get started?
Because you can afford a few A100/H800, it sounds like you have a descent budget. Do the maths first though. It may be cheaper to rent.
Also you may have access to large scale cluster through your lab. If you are located in Europe and work on European research projects, you may be able to play with one of the EuroHPC supercomputers for example.
https://eurohpc-ju.europa.eu/supercomputers/our-supercompute...