S3/Cloudflare R2/GCS/Wasabi/B2/Bunny or Minio/Seaweed/Garage/Ceph?

Question

Seems like a few of the non-AWS S3 object storage services (even big ones like R2) have had some production issues.Anyone care to describe their experiences?I'd like to store billions of smallish files (photos etc) in production. Price (incl bandwidth) is important, but uptime and latency (where S3 does suffer) are more important.

speedgoose · Accepted Answer

I would add https://github.com/gaul/s3proxy and https://lakefs.io/ to your list.

gramakri2 · Answer

Cloudflare DNS seems to be down at the moment :-) The API calls return "null" as the result like `'{"result":null,"success":true,"errors":[],"messages":[],"result_info":{"page":1,"per_page":100,"count":0,"total_count":0,"total_pages":1}}'`

antongribok · Answer

You're mixing software defined storage options with public cloud offerings, which is kind of strange.
If you have your own hardware, Ceph is solid.
I wouldn't put more than 200 million objects in a single bucket, but other than that it can be very reliable.
I have ~ half an exabyte on-prem, and sleep very well at night.

colesantiago · Answer

I always trust S3, tried and tested. The others aren't really production ready or proven.