8 ms·
When I hear numbers like this I wonder what percentage of the compute and memory resources of that 18-32 node cluster — not to mention the engineering that went
by rcoder 4y ago
When I hear numbers like this I wonder what percentage of the compute and memory resources of that 18-32 node cluster — not to mention the engineering that went into making it work — goes into the “hard” problems of horizontal scaling, cramming stateful services into an architecture designed for stateless ones, etc.
You can actually get a couple of pretty beefy bare metal boxes for that budget. Or a couple of more modest ones for app servers plus a nice big RDS instance with all the trimmings. Based on past experience, that’ll get you to a few hundred rps for even a fairly complicated, poorly-tuned Rails or PHP app; your well-factored Go API server should handle 10x that pretty easily.
You might have to write some Bash or systemd unit files instead of a bunch of YAML, which may or may not bug you. I find shell easier to understand and debug than YAML-based scripting but YMMV.
- roflyear 4y agoRight, I don't think you can beat buying the machines, of course.
- Nextgrid 4y agoYou don't have to buy - Hetzner, OVH, etc will happily rent you these machines dirt-cheap and that includes hardware maintenance & replacement.
- roflyear 4y agoSure, that sounds some problems. Try to get your average CTO on board, though!
- unity1001 4y agoOVH may be problematic if you don't speak French (their English support sucks), but Hetzner is pretty famous and well regarded. Their network is great. They provide a lot of automation. The provide little tooling compared to AWS, but what is there works and it works great. Its an engineering-minded provider. Also, its VM pricing is the lowest. What's best is their egress pricing cannot be matched by anyone else in the US or Europe.