MyColo measured local AI inference

Share card

bundle 4 · measured result · 27B

269.5 tok/s

hardware
NVIDIA GeForce RTX 5090
model
qwen2.5-7b-instruct · 845dbda0ea48ed74…
engine / quant / ctx
ollama · Q4_K_M · ctx 4096
workload
—
trust
measured · lone · test · 2026-09-20 16:30:46

Throughput comparison

269.5 tok/s · baseline n/a · n=0

Not enough comparable prior runs yet (same handle · hardware · track · recipe).

Same handle, hardware class, size track, and recipe version. Current run excluded.

hash
227e55f8fc174b6a6340f9515bff08e465acccb91d07138344c9e0545c313bb4

Hardware class

{
  "driver": "580.126.18",
  "gpu_or_soc": "NVIDIA GeForce RTX 5090",
  "stack": "cuda",
  "vram_or_unified_mib": 32607
}

Sign-offs

hardware receipt · JSON · measure