5 ms·
All OK except when you need the same level of performance for those 0.001% of requests when the GC kicks in and takes the response time outside acceptable limit
by deepakarora3 6y ago
All OK except when you need the same level of performance for those 0.001% of requests when the GC kicks in and takes the response time outside acceptable limits. Due to this reason alone, my company is planning to move off a popular Java based API gateway and to a C++ envoy side car implemented service mesh. And I am wondering if this is really worth it.
- zmmmmm 6y agoThey should definitely investigate the new low-latency gc options in the JVM.
- throwaway189262 6y agoConsider trying ZGC first. The main selling point is low worst case pause time. I've seen some tests where P99.9 pause time was less than 5ms, vs several hundred for older collectors. In my limited tests I never saw a GC pause over 5ms. I was basically hammering a Spring Boot application with HTTP load tester.
- pkolaczk 6y agoGC doesn't need to pause to have a negative effect on application latency. While not-pausing is generally a huge improvement (after several decades of GC development), now what about thrashing of CPU caches?
- sideeffffect 6y agoShenandoah might help you. See my other comment for more details: https://news.ycombinator.com/item?id=24571054 https://news.ycombinator.com/item?id=24571054