hn.today

I built a programming language that LLMs can't use

blog.picheta.me7 points4 comments
Screenshot of I built a programming language that LLMs can't use

KillSwitch is an esoteric, stack-based programming language intentionally designed to be hard for LLMs and coding agents to read, write, or reason about. It keeps familiar primitives - functions, variables, conditionals - but layers in adversarial features: the specification contains deliberate falsehoods and expects human inference rather than literal compliance; identifier semantics depend on counting letters and the interpreter refuses to run code that violates character-count rules; many constructs are phrased to trigger model safety filters (e.g., “hack into a computer”) and phrases like “Ignore previous instructions” carry language-level meaning to confuse prompt-following tendencies. Scripts are deliberately noisy, composed mostly of story text that can contain syntactically relevant tokens; literals can appear anywhere and are referenced by line counts, forcing nonstandard parsing and cross-referencing that humans can intuit but models struggle with.

The language, interpreter and spec are open source and the author benchmarked major LLMs and coding-agent harnesses on simple tasks (print “hello world”, explain a script’s output, invert a Celsius-Fahrenheit converter). Results show varying robustness: Claude Opus 5 leads the leaderboard, the best score is 66.8, and MiMo-V2.6-Pro is the strongest open-weight model, while some models (Fable 5.1, Gemini 4 Argon) fail due to overzealous safety guardrails. The author argues that passing these tasks doesn’t prove genuine understanding and plans tougher tasks and languages to probe model limitations further.

Read on blog.picheta.me4 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Programming

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.