hn.today

Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

llmspeed.dev79 points28 comments
Screenshot of Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

llmspeed is an interactive simulator that shows how responsive a local large language model will feel on different hardware before committing to a purchase. It presents a searchable matrix of specific GPUs, CPUs, Macs, and cloud accelerators (from RTX 3090 and 4090 through M5 Ultra, DGX Spark, H100/A100/H200 clouds and more) alongside dozens of open models (Qwen, Gemma, Llama 3.1, GPT-OSS, Ornith, DeepSeek and others). For a short prompt on a single device it reports latency estimates so users can compare expected inference speed across hardware and model combinations. The tool runs in the browser (requires JavaScript) and the code and data are available on GitHub.

Reported numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and similar) when available; other entries are projected from comparable setups or vendor/spec extrapolations. The site distinguishes measured versus derived values and focuses on single-device, short-prompt performance rather than sustained or multi-node throughput. That specificity makes it practical for anyone choosing a workstation or GPU for local experimentation, giving concrete, open-source-backed estimates to guide hardware selection while making clear which figures are community-measured and which are projections.

Read on llmspeed.dev28 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Why Math Dumped OpenAI

Why Math Dumped OpenAI

Ray Myers criticizes OpenAI for prioritizing profit over genuine mathematical progress, accusing it of dishonesty and devaluing workers. He compares the AI industry’s behavior to narcissistic abuse, emphasizing a toxic relationship with artificial intelligence that benefits only the dominant players. (raymyers.org)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.