Ollama Benchmark CLI¶
A tool for benchmarking local models running on Ollama.
Description¶
It measures tokens-per-second and response latency for different models on your specific hardware.
Links¶
- GitHub Repository (Example implementation)
Alternatives¶
Backlog¶
- Compare performance of TrueNAS SCALE with GPU passthrough vs CPU-only.