Ask HN: S3/Cloudflare R2/GCS/Wasabi/B2/Bunny or Minio/Seaweed/Garage/Ceph?

Seems like a few of the non-AWS S3 object storage services (even big ones like R2) have had some production issues.

Anyone care to describe their experiences?

I'd like to store billions of smallish files (photos etc) in production. Price (incl bandwidth) is important, but uptime and latency (where S3 does suffer) are more important.

7 comments

[ 3.9 ms ] story [ 32.9 ms ] thread

gramakri2 2y ago ↗

Cloudflare DNS seems to be down at the moment :-) The API calls return "null" as the result like `'{"result":null,"success":true,"errors":[],"messages":[],"result_info":{"page":1,"per_page":100,"count":0,"total_count":0,"total_pages":1}}'`

gunapologist99 2y ago ↗

So, Cloudflare DNS API is down!?

It might be irrelevant but their core product (of returning results), i.e. dig google.com @1.1.1.1 seems to be working fine here.

gramakri2 2y ago ↗

Looks like this was just some random failure! All looks good now. I was looking at HN for cloudflare errors and your was the first :)

Well, it turns out https://developers.cloudflare.com/api/operations/dns-records... now returns "null" in result . I think it returned empty array before.

speedgoose 2y ago ↗

I would add https://github.com/gaul/s3proxy and https://lakefs.io/ to your list.

gunapologist99 2y ago ↗

Thanks, checking them out now!

colesantiago 2y ago ↗

I always trust S3, tried and tested. The others aren't really production ready or proven.

antongribok 2y ago ↗

You're mixing software defined storage options with public cloud offerings, which is kind of strange.

If you have your own hardware, Ceph is solid.

I wouldn't put more than 200 million objects in a single bucket, but other than that it can be very reliable.

I have ~ half an exabyte on-prem, and sleep very well at night.