hn.today

Gemini 4 Argon for Robotics

developers.googleblog.com143 points36 comments
Screenshot of Gemini 4 Argon for Robotics

Gemini 4 Argon is a multimodal model that advances physical understanding, code generation, and visual-semantic reasoning to support a wide range of robotics workflows. It achieves top performance on the Embodied Reasoning (ERQA) benchmark (87%) and is presented as a general-purpose physical reasoning engine that can be applied across robot control, real-to-sim reconstruction, detailed physical understanding, and research-driven self-improvement. Key design themes are closed-loop visual reasoning, iterative verification, and the ability to generate actionable control plans and simulation assets.

Representative demonstrations show how Argon constructs and uses simulation twins and action primitives to solve real tasks: it builds a MuJoCo twin of a foot-pedal trash bin so a Boston Dynamics Spot practices stepping and dropping cans with a 2-agent foot/hand verification swarm; it performs zero-shot arm control to reorient a mug and place a napkin using a visual coordinate harness and curl-based motion primitives (robot.look_at, grasp, place_until_contact, etc.); it steers a Gemini Omni video world model in timestamped action beats to rearrange Scrabble tiles; and it converts robot teleop episodes, egocentric human videos, or pen-and-paper sketches into calibrated 500 Hz MuJoCo scenes (retargeting to a 76-DoF humanoid with 22-DoF hands) while enforcing visual and physical match objectives and forbidding post-hoc sim “cheats.”

Read on developers.googleblog.com36 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in AI

Chabuduo World

Chabuduo World

AI has reached a level where good enough outputs can replace human effort across many fields, leading to a world where most people rely on basic tools rather than developing advanced skills. This shift risks diminishing the pursuit of mastery, as the effort required to become an expert becomes less necessary with accessible AI assistance. (tracingwoodgrains.com)

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.