Data

All the numbers, open

Everything on this site is generated from the public silybench-data repository: measured runs, dated price tables and the cost model. Download it, query it, or check our math.

Downloads

Latest build of tgarg01/silybench-data (main)

silybench.sqliteAll tables below in one SQLite database
cost.jsonHosted vs API cost model: deployments × offers, comparisons
index.jsonOne entry per published deployment
csv/runs.csvDeployments: hardware, provider, price, model revision, engine, provenance
csv/perf_points.csvEvery workload × concurrency point: p95/p99 latencies, throughput, power
csv/capacity.csvMax concurrent users within the SLO, and the KV-cache limit
csv/accuracy.csvlm-evaluation-harness scores per task
csv/hosted_costs.csvEach deployment priced with every provider renting that GPU
csv/comparisons.csvCheapest self-hosted vs cheapest API per model × request shape
csv/gpu_prices.csvGPU rental list prices with source and date
csv/api_prices.csvAPI list prices for the same models
schema.jsonJSON Schema of a run result

Column definitions and units: the data dictionary.

Query it

curl -LO https://raw.githubusercontent.com/tgarg01/silybench-data/main/derived/silybench.sqlite
sqlite3 silybench.sqlite "select model, workload, hosted_provider, hosted_usd_per_1k_requests, api_provider, api_usd_per_1k_requests, savings_at_capacity from comparisons"

GPU prices used

USD per GPU-hour, list prices. Taxes, storage and egress excluded.

GPUProviderProduct$/GPU-hChecked
H100-80GBrunpodH100 SXM, Community Cloud$2.692026-09-25
H100-80GBrunpodH100 SXM, Secure Cloud$3.492026-09-25
H100-80GBvastH100 SXM, marketplace median$2.402026-10-19
H100-80GBnebiusHGX H100$3.852026-09-25
H100-80GBlambda1x H100 SXM$4.292026-09-25
H100-80GBlambda8x H100 SXM · min 8 GPUs$3.992026-09-25
H100-80GBgcp (spot)a3-highgpu-1g Spot, us-central1$6.572026-09-26
H100-80GBgcpa3-highgpu-1g, us-central1$10.982026-09-26
H100-PCIe-80GBrunpodH100 PCIe, Community Cloud$1.992026-09-25
H100-PCIe-80GBrunpodH100 PCIe, Secure Cloud$2.892026-09-25
H100-PCIe-80GBlambda1x H100 PCIe$3.292026-09-25
H100-NVL-94GBrunpodH100 NVL, Community Cloud$2.592026-09-25
H100-NVL-94GBrunpodH100 NVL, Secure Cloud$3.192026-09-25
H200-141GBrunpodH200, Community Cloud$3.592026-09-25
H200-141GBrunpodH200, Secure Cloud$4.592026-09-25
H200-141GBnebiusHGX H200$4.502026-09-25
B200-180GBrunpodB200, Community Cloud$5.982026-09-25
B200-180GBrunpodB200, Secure Cloud$6.792026-09-25
B200-180GBlambda1x B200 SXM6$6.992026-09-25
B200-180GBnebiusHGX B200$7.152026-09-25
GH200-96GBlambda1x GH200$2.292026-09-25
A100-80GBrunpodA100 SXM, Community Cloud$1.392026-09-25
A100-80GBrunpodA100 SXM, Secure Cloud$1.592026-09-25
A100-80GBlambda8x A100 SXM 80GB · min 8 GPUs$2.792026-09-25
A100-PCIe-80GBrunpodA100 PCIe, Community Cloud$1.192026-09-25
A100-PCIe-80GBrunpodA100 PCIe, Secure Cloud$1.592026-09-25
A100-40GBlambda1x A100 SXM 40GB$1.992026-09-25
L40S-48GBrunpodL40S, Community Cloud$0.792026-09-25
L40S-48GBrunpodL40S, Secure Cloud$1.092026-09-25
L40S-48GBnebiusL40S (Intel)$1.552026-09-25
A10-24GBlambda1x A10$1.292026-09-25
RTX4090-24GBrunpodRTX 4090, Community Cloud$0.342026-09-25
RTX4090-24GBrunpodRTX 4090, Secure Cloud$0.742026-09-25

API prices used

USD per 1M tokens for the same open models.

ModelProviderInputOutputWeightsFetched
Qwen3-14BFireworks$0.2$0.2not stated2026-09-25
Qwen3-14BNextBit$0.1$0.22int42026-10-19
Qwen3-14BDeepInfra$0.12$0.24fp82026-10-19
Qwen3-8BFireworks$0.2$0.2not stated2026-09-25
Qwen3.8-27BTenstorrent$0.02$0.5fp42026-10-19
Qwen3.8-27BChutes$0.039$1.25fp82026-10-19
Qwen3.8-27BNear AI$0.04$1.35fp82026-10-19
Qwen3.8-27BCerebras$0.99$1.49fp162026-10-19
Qwen3.8-27BDeepInfra$0.15$1.875bf162026-10-19
Qwen3.8-27BIonstream$0.04$1.95fp82026-10-19
Qwen3.8-27BAkashML$0.225$1.98fp82026-10-19
Qwen3.8-27BDarkbloom$0.035$2.2fp42026-10-19
Qwen3.8-27BParasail$0.24$2.2fp82026-10-19
Qwen3.8-27BReka$0.04$2.2fp82026-10-19
Qwen3.8-27BWafer$0.04$2.3fp82026-10-19
Qwen3.8-27BDekaLLM$0.04$2.5not stated2026-10-19
Qwen3.8-27BMancer 2$0.2$2.5fp82026-10-19
Qwen3.8-27BModelRun$0.2$2.5fp42026-10-19
Qwen3.8-27BPhala$0.2$2.5not stated2026-10-19
Qwen3.8-27BAlibaba$0.425$2.55not stated2026-10-19
Qwen3.8-27BCoreWeave$0.4$3fp82026-10-19
Qwen3.8-27BNovita$0.42$3not stated2026-10-19
Qwen3.8-27BCloudflare$0.45$3.2not stated2026-10-19
Qwen3.8-27BVenice$0.45$3.2fp82026-10-19