hn.today

AI chatbots give wrong answers to financial queries 'most of the time'

ft.com122 points58 comments
Screenshot of AI chatbots give wrong answers to financial queries 'most of the time'

Commenters focused on whether large language models can be trusted for financial advice. SyneRyder pointed to an alternative summary and highlighted a claim that Opus 5 failed 39% of questions. Several users - lukeify, ehe78qhe and NitpickLawyer - argued models are useful for general personal-finance principles and can outperform typical casual advice if guided by authoritative sources, though ehe78qhe warned against relying on them for transactions affected by up-to-date tax or market rules. 01100011 and NitpickLawyer emphasized that reasoning-enabled modes and supplying authoritative texts reduce hallucinations, while sixtyj and some others said they prefer agent-assisted Python scripts for verifiable calculations.

Opinion divides on methodology and reliability. simianwords criticized the report’s reliance on weak models like Haiku and its lack of reproducible tests, while 74gee argued plainly that models without tools to look up current markets will be inaccurate. in_absentia raised concern about conflicting reports and personal biases shaping which studies people trust. Demibabs complained about access and paywall friction, and jb1991 (with Wololooo noting a language quibble) expressed annoyance at certain tool-based workflows, showing that practical usability and trust remain contested.

Read on ft.com58 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.