6 ms·
Where are the benchmarks that show <1ms p99 overhead? That seems intense to me.
by paulwarren 2y ago
Where are the benchmarks that show <1ms p99 overhead? That seems intense to me.
- GabrielBianconi 2y agohttps://www.tensorzero.com/docs/gateway/benchmarks https://www.tensorzero.com/docs/gateway/benchmarks :)