What desktop to buy for home based AI/ML in 2023

Question

This year I started running some AI/ML experiments at home using Google Colab. However, I want to start using my own compute for some of these.I was thinking of buying the following PC: https://www.palicomp.co.uk/amd-velocity-fac10 and upgrading to a 3080 and i7 as I do a lot of image analysis and it would be helpful to be able to parallelism some operations.What does HN think of this and these specs? Any recommendations? I'm trying to keep my budget under &pound;2000 unless going a bit over that would allow for a real increase in processing power.

KuriousCat · Accepted Answer

I would recommend a card with higher RAM, may be a 3090ti coupled with an AMD Ryzen 9 processor. Recently, I got one for around 2000 USD. https://store.nvidia.com/en-gb/geforce/store/gpu/?page=1&lim...

augasur · Answer

I would pick AMD Ryzen CPU and any Nvidia GPU with more ram.
If budget allows, I would pick RTX3090, if budget is too tight, look at RTX3080 or RTX3080Ti 12 Gb vram models. 10 gb vram models can be too small in the future or if you plan to use it for image processing.
I also am working mainly with image processing and segmentation, we mainly use RTX3080 and RTX3080Ti GPUs.
It should also be cheaper to pick components and build PC yourself.

version_five · Answer

I strongly recommend using colab or a crappy gpu for experimentation and just paying for compute when you want to run jobs that need it. Most tinkering doesn't need any special gpu, so whatever you buy is going to mostly sit idle. Paying for cloud GPUs obviously costs more per hour, but you then only pay for what you need and can scale however you want

navjack27 · Answer

Are you planning on making money doing this? Invest in a 7950X and all the RAM you can and either a:409030903090 TiA30A40A100H100