10 ms·
We used a deterministic aperture load balancing to solve this at twitter - https://blog.x.com/engineering/en_us/topics/infrastructure/2019/daperture-load-balanc
by nepthar 2y ago
We used a deterministic aperture load balancing to solve this at twitter - https://blog.x.com/engineering/en_us/topics/infrastructure/2019/daperture-load-balancer https://blog.x.com/engineering/en_us/topics/infrastructure/2....
Cool to see some other approaches, although I believe they've complicated theirs a bit more than necessary.
- renewiltord 2y agoVery cool. Low-state approaches are always more interesting.
- deleted 2y ago[deleted]
- jauntywundrkind 2y agoAh nice, a "Power of 2 (random) choices" strategy. Article credits "The power of two choices in randomized load balancing" (1996) by Michael Mitzenmacher. PDF link: https://www.eecs.harvard.edu/~michaelm/postscripts/mythesis.pdf https://www.eecs.harvard.edu/~michaelm/postscripts/mythesis.... I heard about someone using PO2C for cache eviction recently. Maybe Oxide talking about their storage work? Seems obviously smart. No need to keep LRU or carefully track & decide, just use statistics to compare two random elements and drop the least used one.