hn.today

Jev in 25 Lines of Python

nobodywho.ai138 points48 comments
Screenshot of Jev in 25 Lines of Python

A 25-line Python example reproduces the core of a Jev-style multiple-choice classifier: it loads a local GGUF model (Qwen3-0.6B-GGUF) via llama_cpp with n_ctx=512 and logits_all=True, builds a prompt that asks to classify an email into A/B/C (Legitimate/Spam/Phishing), runs a forward pass, then reads the final-token logits for the label tokens. The script tokenizes each label, extracts the corresponding logits from model.scores at the last token, computes log-probabilities by subtracting logaddexp.reduce(choice_logits), exponentiates to get probabilities, and prints logits, log-probs, and probabilities (example output shows Phishing ≈88.5%). Dependencies are numpy and llama-cpp-python and the code assumes any compatible GGUF model.

The write-up argues that this minimal implementation shows Jev is not a mystical new paradigm but a straightforward decision model that outputs choice probabilities, can run fast and locally, and keeps data off remote APIs. It explicitly rejects training tricks like synthetic data or RL-based calibration in this demo, labels the piece a parody, and points readers to fuller open implementations (OpenJev, openjev-sglang, OpenJev on DiffusionGemma). The project is presented as open-source and privacy-conscious, with an invitation to check the repository.

Read on nobodywho.ai48 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.