My issue is that the jobs usually come in batches and should be processed in a somewhat timely manner. Each job needs roughly 2GB peak RAM and some cpu cycles.
My question now is: How can I host this as cost efficient as possible? Something like google cloud run would be ideal but I'd really like to avoid migrating my perfectly working queue to googles' proprietary solution.
Right now I have a couple of small VPS which are idling 70% of the time.
Ideally would be a service that lets me deploy a docker container and only charge for used RAM and CPU cycles. Does this exist?