MCPJam is a testing and evaluation platform that exercises MCP servers across real AI clients (ChatGPT, Claude, Copilot, Cursor, VS Code and others) to reveal where behavior diverges and why. It provides an Inspector to run prompts simultaneously in multiple clients, an OAuth & EMA debugger to pinpoint auth breakdowns, and cross-client traces that show tool calls and UI differences. Tests can run locally via a CLI/Inspector, in code via an SDK, or in the web/desktop app. Simulated “swarms” run agent personas through user journeys across chosen clients and servers, while a user-testing mode invites real people into sandboxed chats to measure sentiment and usability. Core components (Inspector, CLI, SDK, local evals and conformance checks) are open source; enterprise features include SSO, audit logs, and a DPA, and MCPJam asserts it never touches live traffic in pre-production usage.
The platform integrates into CI/CD to gate merges: suites score goal completion, tool choice and arguments across repeated runs so non-deterministic behavior is evaluated rather than brittle-asserted. Example suite outputs show run-by-run health (e.g., Payments operations averaging 98% across 12 runs) with per-run metrics like latency, tokens, calls, and pass rates; failing checks block PRs until MCPJam evals meet set thresholds. Target users include developers, product and engineering managers, AI/platform leads and enterprises that need assurance that MCP servers behave correctly across every major client.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.
Yantra is an LALR(1) parser generator designed for C++ that helps developers create parsers efficiently. It is available as an open-source project on GitHub with ongoing development and community support. (github.com)
Jevotron is a command-line tool for integrating multiple Jev workflows, enabling anomaly detection and data assessment across various file formats. It offers features like preview, scoring, review, and caching to streamline data analysis and review processes. (cmungall.github.io)
EDG C++ Compiler has been released as open source on GitHub, allowing developers to access and contribute to its codebase. The project includes extensive commits, files, and development activity. (github.com)
PLDB catalogs over 33,000 programming languages papers from 1973 to 2026, covering top venues like POPL, PLDI, and ICFP. It allows searching by topics such as concurrency, effect handlers, and ownership types. (pldb.kirancodes.me)
Perspica is a tool that provides a semantic diff for reviewing code changes. It aims to improve code review accuracy by analyzing the meaning of code differences. (github.com)
Halfspace is an experimental IDE for solid modeling using distance fields, allowing real-time rasterization and mesh export. It aims to simplify working with implicit surfaces by providing both a shape library and tools for incremental model building. (mattkeeter.com)
Today's best Hacker News stories, summarized and screenshotted, one email a day.