benchmarks/qps_output.csv at main · dstackai/benchmarks · GitHub

40 lines (40 loc) · 11.9 KB

1	num_prompts	request_rate	burstiness	max_concurrency	duration	completed	total_input_tokens	total_output_tokens	request_throughput	request_goodput	output_throughput	total_token_throughput	mean_ttft_ms	median_ttft_ms	std_ttft_ms	p99_ttft_ms	mean_tpot_ms	median_tpot_ms	std_tpot_ms	p99_tpot_ms	mean_itl_ms	median_itl_ms	std_itl_ms	p99_itl_ms	num-scheduler-step	qps	enable-chunked-prefill	max-num-batched-tokens	max-num-seqs	max-seq-len-to-capture	enable-prefix-caching	filename