6 ms·
MinIO is an option as well and would allow you to transition from testing in S3 to your own MinIO cluster seamlessly.
by monstrado 5y ago
MinIO is an option as well and would allow you to transition from testing in S3 to your own MinIO cluster seamlessly.
- dividedbyzero 5y agoDoes it scale that far?
- pas 5y agoLikely not that "gracefully". But Ceph absolutely does, and has an S3 gateway.
- tempest_ 5y agoUsing Ceph like S3 could be a bit tricky if all of that 10pb is very small files. Redhat did an interesting series of blog posts about Ceph and getting it to 1 billion objects https://www.redhat.com/en/blog/scaling-ceph-billion-objects-and-beyond https://www.redhat.com/en/blog/scaling-ceph-billion-objects-...
- goliatone 5y agoI wonder if anyone can comment if they have experience running minio at scale. It would be a pleasant surprise if a “simple” minio cluster could handle such workload