Nginx introduced least_conn lb method in 1.3.1 which makes it a bit better. http://nginx.org/en/docs/http/ngx_http_upstream_module.html#least_conn http://nginx.

Nginx introduced least_conn lb method in 1.3.1 which makes it a bit better. http://nginx.org/en/docs/http/ngx_http_upstream_module.html#least_conn http://nginx.org/en/docs/http/ngx_http_upstream_module.html#... ha-proxy is a lot better than nginx + more flexible if you want to introduce non-http to your stack. Shouldn't the request be canceled on all levels if you cut the HTTP connection to the frontend?