hn.today

Show HN: Qwen3-4B with the AI writing tics trained out

100toolkit.com144 points105 comments
Screenshot of Show HN: Qwen3-4B with the AI writing tics trained out

Erik Markus Kannike trained Qwen3-4B-Instruct to remove common AI writing tics - em dashes, "not X, but Y" constructions, lists of three, rhetorical signposts - and released the result as qwen3-4b-deslop, a 2.5 GB quantized GGUF that runs locally with Ollama or llama.cpp. On 40 held-out prompts the custom "slop" detector score dropped from 121 to 12.5 per 1,000 words, em dashes went from 20.5 to zero, and 68% of answers landed in the human-writing range; factual accuracy remained intact on a 30-question quiz and genre/length compliance matched the original. Prediction drift on human prose was substantially lower than runtime steering.

The training pipeline combined a small LoRA adapter (rank-16) with a four-neuron sign-flip edit and iterative distillation: a teacher produced filtered answers, a student learned from them, and task-fit rule checks were added after an intermediate model produced errors (opinion pieces without stance, invented studies, and excessive sentence-joining like ", which"). The final model was trained on 161 kept answers and restored task fit to about 80% while keeping slop low. Limitations include a flat, declarative voice, residual hallucinated names/places, tendency to run long, testing limited to short English prose, and reliance on a regex-based style detector; planned next steps are higher-quality human teachers, scaling to larger models, and blind reader evaluation.

Read on 100toolkit.com105 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Inception "Mercury 3", 1000 tok/s diffusion LLM

Inception "Mercury 3", 1000 tok/s diffusion LLM

Mercury 3 is the most advanced diffusion-based large language model, outperforming models like GPT-6 Luna and Claude Haiku 5.5 in speed and capabilities, processing over 1,000 tokens per second. It is already used for real-time applications such as web navigation, voice support, and education, demonstrating that diffusion models can scale effectively for commercial use. (inceptionlabs.ai)

How Grok Bot Works

How Grok Bot Works

Grok Bot processes messages using distributed systems components like queues, workflows, and caching to ensure responsiveness and reliability. When a user sends a message, it is immediately shown locally, then queued and handled with priority, with the system maintaining state and recovering from crashes using Temporal. (peterp.me)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.