hn.today

Launch HN: Laminar (YC S24) – We trained a model to catch silent agent failures

news.ycombinator.com39 points19 comments
Screenshot of Launch HN: Laminar (YC S24) – We trained a model to catch silent agent failures

Two founders launched an open-source observability stack for multi-step AI agents and released flow-1, a model trained with reinforcement learning to detect silent agent failures - errors that occur even when every call returns successfully (wrong clicks, incorrect citations, unfinished checkouts). On their benchmark flow-1 matches GPT-6-sol in detection quality while running 23× cheaper, making it affordable to analyze every production trace rather than sampling. The model was finetuned from a small OSS base and post-trained with RL on thousands of synthetic investigations across software, legal, and support workflows to specialize in trace analysis at low cost.

flow-1 runs inside a harness called Signals that treats an agent trace like a code repository: each span (LLM call, tool call, etc.) is a file, traces are compressed, and the model greps and reads relevant spans to answer general prompts. Outputs are structured JSON “signal events” in user-definable schemas, and similar events are automatically clustered so teams can find recurring failures, build eval datasets from clusters, iterate fixes with coding agents, and verify regressions before shipping. The stack includes 20× trace compression, a custom SQL query engine, automatic task extraction, is Apache 2.0 and self-hostable, and the company offers a managed cloud as its commercial product.

Read on news.ycombinator.com19 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Inception "Mercury 3", 1000 tok/s diffusion LLM

Inception "Mercury 3", 1000 tok/s diffusion LLM

Mercury 3 is the most advanced diffusion-based large language model, outperforming models like GPT-6 Luna and Claude Haiku 5.5 in speed and capabilities, processing over 1,000 tokens per second. It is already used for real-time applications such as web navigation, voice support, and education, demonstrating that diffusion models can scale effectively for commercial use. (inceptionlabs.ai)

How Grok Bot Works

How Grok Bot Works

Grok Bot processes messages using distributed systems components like queues, workflows, and caching to ensure responsiveness and reliability. When a user sends a message, it is immediately shown locally, then queued and handled with priority, with the system maintaining state and recovering from crashes using Temporal. (peterp.me)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.