HTTP (L7) proxy benchmark · open-loop ramp · c1k

request throughput 20260802-081742

Every proxy driven through the identical linear ramp (zrk, open-loop, coordinated-omission corrected) at 1000 connections. Throughput and CPU span the full ramp. The table's p50 / p99 are each proxy's latency at a common 2k req/s reference load — a shared, light, sub-knee rate where the number reflects per-request cost rather than queueing.

proxy	max sustained req/s	p50 @ 2k	p99 @ 2k	peak mem	status
zoxy0.0.9 @b29f3b5ed	52.2591k	0.41ms	2.32ms	75.1MiB	ok
nginx1.27	21.3109k	0.46ms	3.62ms	57.2MiB	ok
haproxy3.0.26	19.6562k	0.44ms	1.27ms	74.2MiB	ok
pingora0.8	12.379k	0.46ms	1.87ms	53.1MiB	ok
envoy—	8.0277k	0.57ms	3.81ms	72.1MiB	ok

zoxy compiled for this host's CPU with SIMD (release-parity ReleaseFast x86_64-linux-musl cpu=native (SIMD)); stock images in this comparison are generic x86-64 builds
zoxy dropped 5074789 access-log lines (47.32% of completed requests) instead of blocking on stdout; the other proxies block or buffer, so this much logging work was skipped here and not by them
nginx latency histogram saturated at 60s; tail percentiles are a floor, not a value
haproxy latency histogram saturated at 60s; tail percentiles are a floor, not a value
pingora compiled for this host's CPU with SIMD (release target-cpu=native); stock images in this comparison are generic x86-64 builds
pingora latency histogram saturated at 60s; tail percentiles are a floor, not a value
envoy latency histogram saturated at 60s; tail percentiles are a floor, not a value

Successful req/s vs offered

open-loop ramp; dashed gray = perfect keep-up

Proxy CPU vs offered

container cores sampled from cAdvisor at 1Hz, on the ramp's own clock

p99 latency vs offered (while keeping up)

per-window tail (log scale); each line stops where that proxy stops keeping up

Load shed vs offered

offered load the proxy couldn't serve (1 − achieved/offered); the first few seconds include the generator's own ramp-up shortfall, which is not the proxy's

Latency distribution · HdrHistogram (whole run)

zoxy

latency by percentile · raw zoxy.hgrm

haproxy

latency by percentile · saturated at 60s — tail percentiles are a floor, not a value · raw haproxy.hgrm

nginx

latency by percentile · saturated at 60s — tail percentiles are a floor, not a value · raw nginx.hgrm

pingora

latency by percentile · saturated at 60s — tail percentiles are a floor, not a value · raw pingora.hgrm

envoy

latency by percentile · saturated at 60s — tail percentiles are a floor, not a value · raw envoy.hgrm