hn.today

GLM Models Cut AI Coding Costs 90% for 2k Engineers

finance.biggo.com8 points0 comments
Screenshot of GLM Models Cut AI Coding Costs 90% for 2k Engineers

Revolut has made self-hosted open-weight GLM models its default for coding across roughly 2,000 engineers, reserving tools such as Claude Code, Codex and Gemini for harder tasks. AI operations lead David Abitbol reports a blended cost of about 30 cents per million tokens - around one-tenth of the company’s previous spending on Anthropic and OpenAI. In the year-long comparison, Gemini improved engineering lead time by 10% and coding time by 20%; self-hosted GLM later improved them by 70% and 60%, respectively. The larger lead-time gain reflects time saved on work around coding, such as searching documentation and handling inboxes or project-management tasks. Low costs also let engineers use AI more routinely instead of rationing expensive requests.

Revolut serves the models on 56 Nvidia B200 GPUs, but improved performance by tuning rather than expanding the cluster: from April to August 2026, time to first token fell from over 10 seconds to about 1.6 seconds as demand rose 76%. Abitbol emphasizes practical configuration - shorter contexts, FP4 precision, high cache-hit rates and optimized inference - and argues that simply adding hardware is not the answer. For regulatory compliance, Revolut downloads model weights and runs inference in approved locations rather than sending company data to Chinese endpoints. Human approval controls, sandboxing, data-retention limits and detailed logging support that approach. The experience suggests self-hosting can reduce costs and provide predictable bills and control, though Revolut’s results come from one company and depend on its workload and infrastructure.

Read on finance.biggo.com0 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

ChatGPT Wallet

ChatGPT Wallet

ChatGPT Wallet lets ChatGPT agents make purchases using tokenized card details, with users reviewing each purchase and approving it through a security check. Launching first for US ChatGPT Pro subscribers, it is built with major payment networks and preserves eligible card rewards and protections. (openai.com)

Friends at Frontier Labs

Friends at Frontier Labs

Working at frontier AI labs offers friends the author cares about prestige, purpose, and collaboration, while raising serious concerns about the labs’ work. The author encourages them to keep reassessing whether to stay, recognizing that stress, loyalty, and sharp criticism make the choice difficult. (jenn.site)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.