2 benchmarks · no accounts · no judgment
77.9 tok/s decode · 107 ms first token · 12th Gen Intel(R) Core(TM) i5-12600K · 31GB · linux/x64
166 tok/s decode · 131 ms first token · Apple M5 Ultra · 256GB · darwin/arm64
Or from the CLI: llmprobe localhost:8080 --upload https://slop.mlxserve.com
llmprobe localhost:8080 --upload https://slop.mlxserve.com