hn.today

Researchers track whole body movement with just a smartwatch

news.cornell.edu3 points0 comments
Screenshot of Researchers track whole body movement with just a smartwatch

EchoMotion is a smartwatch-based system that estimates a person’s full-body pose using ultrasonic sound rather than cameras or multiple wearable sensors. The watch’s speaker emits inaudible signals that bounce off the wearer’s limbs, and its microphone records the echoes. A compact AI model interprets those patterns to estimate the positions of 12 joints, from head to ankles. The approach aims to make body tracking practical on ordinary commercial watches while reducing privacy concerns, data demands and power use. In tests, the prototype used about 12 milliwatts; a 30-minute session on a Samsung Galaxy Watch 6 consumed 5% to 6% of its battery.

Researchers trained the system using recordings from volunteers performing 18 exercises, then evaluated it on an unmodified Galaxy Watch 6 with new users. Initial joint-location error averaged under four inches; a one-time 12-minute calibration reduced it to about 2.4 inches. The same model also worked on a Galaxy Watch 7 and Google Pixel Watch 3 without retraining. Furniture and road noise had little effect in trials, though reflections from people in a narrow hallway slightly reduced accuracy. The team is developing fitness applications such as counting repetitions and correcting exercise form, and is exploring pairing the system with smartglasses. More training data may help it handle crowded settings.

Read on news.cornell.edu0 comments on Hacker News

Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.

More in Hardware

The daily digest

Today's best Hacker News stories, summarized and screenshotted, one email a day.