The server seems fine but it seems quite slow.
Anyone else using these free servers? What has your experience been with performance?
It's not "forever", it's "for as long as we want to offer it", they can stop offering it or terminate you whenever, and if you go under any of these for 7 days they will "reclaim" it:
> CPU utilization for the 95th percentile is less than 20%
> Network utilization is less than 20%
> Memory utilization is less than 20% (applies to A1 shapes only)
The memory and disk speeds are really slow, but there's plenty of memory to keep whatever you need loaded. I can mmap massive models and get decent inferencing performance without spending a dime.
One of these days I feel like we'll draw too much attention to the program, and they'll have to shut it down. Until then...