hn.today

Show HN: We built open OpenRouter that distills usage into a better model

github.com214 points46 comments
Screenshot of Show HN: We built open OpenRouter that distills usage into a better model

Experiential is an open-source gateway and router that exposes a single OpenAI-compatible API to orchestrate hosted, BYOK, and local models for agent workflows. It lets teams centralize provider keys (OpenAI, Anthropic, Gemini, Azure, AWS Bedrock, Fireworks, OpenRouter), enforce who or which agent can call which models, set per-identity budgets, and route traffic for cost, latency, or quality goals. Deployable locally via pip and an exp CLI or used as a managed hosted gateway, it issues short-lived keys, supports both OpenAI-style chat completions and Anthropic Messages, and provides ready commands and code samples (curl examples, exp.load_router in Python) to start routing requests through a chosen public alias like opus-5.

The platform’s distinctive capability is turning observed agent traffic into optimized routing decisions and into improved models: collect OpenTelemetry traces (or use a public dataset), build a project router with exp build, then fine-tune or distill a fitted model with exp optimize model and Tinker to trade off speed, cost, and quality. Anonymous aggregate telemetry is enabled by default but excludes prompts, raw content, and credentials. Documentation, setup guides, and CI/dev tooling accompany the Apache-2.0-licensed codebase, which aims to give engineering teams a unified control plane for experimentation, governance, and production routing of multimodel AI workloads.

Read on github.com46 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.