5 ms·

What is the best alternative that can run as a Docker image that mimics AWS S3 to enable local only testing without any external cloud connections? For me, my

by rietta 7mo ago

What is the best alternative that can run as a Docker image that mimics AWS S3 to enable local only testing without any external cloud connections? For me, my only use for Minio was to simulate AWS S3 in docker compose so that my applications were fully testable locally. I never used it it production or as a middle ware. It has not sat well with me to use alternative strategies like Ruby on Rails' local file storage for testing as it behaves differently than when the app is deployed. And using actual cloud services creates its own hurdles of either credential sharing among developers and gets rid of the "docker magic" of being to run a single set up script and be up and running to change code and run the full test suite. My use case is any developer on the team can do a Git clone and run the set up script and then be fully up and running within minutes locally without any special configuration on their part.

zackify 7mo ago
for me its rustfs https://rustfs.com/ https://rustfs.com/
victormy 7mo ago
S3 is evolving rapidly. While sticking with the old MinIO image might work for the immediate short term, I believe it is not a viable strategy for the long haul. New standards and features are emerging constantly—such as S3 over RDMA, S3 Append, cold storage tiers, and S3 vector buckets. In at most two or three years, relying on an unmaintained version of MinIO will likely become a liability that drags down your project as your production environment evolves. Finding an actively maintained open-source alternative is a must.
- rietta 7mo ago
  Hence my question.
gregfurman 7mo ago
Have you heard of LocalStack’s AWS emulator? [1] It’s runnable within a docker container and has a high fidelity S3 service. Disclosure, I’m a SWE at LocalStack. [1] https://github.com/localstack/localstack https://github.com/localstack/localstack
- wlonkly 7mo ago
  I like(d) LocalStack fine, but you've got the same kind of problem that Minio has. > As a result of this shift, we cannot commit to releasing regular updates to the Community edition of LocalStack for AWS. https://blog.localstack.cloud/the-road-ahead-for-localstack/ https://blog.localstack.cloud/the-road-ahead-for-localstack/
  - gregfurman 7mo ago
    That’s fair. There’s still a free tier that you can use. https://blog.localstack.cloud/the-road-ahead-for-localstack/#will-i-need-to-start-paying-for-localstack-for-aws https://blog.localstack.cloud/the-road-ahead-for-localstack/... But IMO, LocalStack community’s S3 service is pretty stable, so I’m doubtful there’ll be much parity drift in the short to medium term.
chrislusf 7mo ago
I work on SeaweedFS. I am trying to support AWS S3 APIs as complete as possible. Recently added support for Table Bucket, besides myriads of details, such as policies, STS, IAM, OIDC, WORM, lock and versioning, governance, etc.

by rietta 7mo ago

zackify 7mo ago

for me its rustfs https://rustfs.com/ https://rustfs.com/

victormy 7mo ago

S3 is evolving rapidly. While sticking with the old MinIO image might work for the immediate short term, I believe it is not a viable strategy for the long haul. New standards and features are emerging constantly—such as S3 over RDMA, S3 Append, cold storage tiers, and S3 vector buckets. In at most two or three years, relying on an unmaintained version of MinIO will likely become a liability that drags down your project as your production environment evolves. Finding an actively maintained open-source alternative is a must.

rietta 7mo ago
Hence my question.

gregfurman 7mo ago

Have you heard of LocalStack’s AWS emulator? [1] It’s runnable within a docker container and has a high fidelity S3 service. Disclosure, I’m a SWE at LocalStack. [1] https://github.com/localstack/localstack https://github.com/localstack/localstack

wlonkly 7mo ago
I like(d) LocalStack fine, but you've got the same kind of problem that Minio has. > As a result of this shift, we cannot commit to releasing regular updates to the Community edition of LocalStack for AWS. https://blog.localstack.cloud/the-road-ahead-for-localstack/ https://blog.localstack.cloud/the-road-ahead-for-localstack/
- gregfurman 7mo ago
  That’s fair. There’s still a free tier that you can use. https://blog.localstack.cloud/the-road-ahead-for-localstack/#will-i-need-to-start-paying-for-localstack-for-aws https://blog.localstack.cloud/the-road-ahead-for-localstack/... But IMO, LocalStack community’s S3 service is pretty stable, so I’m doubtful there’ll be much parity drift in the short to medium term.

chrislusf 7mo ago

I work on SeaweedFS. I am trying to support AWS S3 APIs as complete as possible. Recently added support for Table Bucket, besides myriads of details, such as policies, STS, IAM, OIDC, WORM, lock and versioning, governance, etc.