A sonar based AI system enables smartwatches to track full hand and finger movements in three dimensions, potentially transforming how wearables interact with users far beyond tiny touchscreens.

This new generation of AI powered watches may soon eliminate the need for tapping tiny screens by turning existing wearables into gesture sensing devices.

Researchers from Cornell University have demonstrated how sonar based hand tracking can capture complex finger poses and movements in real time.

The technology relies on acoustic signals and neural networks to decode the subtle echoes returned by the hand into precise three dimensional trajectories.

If refined, the system could enable natural gesture controls for navigation and interaction without gloves or cameras.

This approach may complement or replace touch based inputs on future smartwatches, expanding accessibility and reducing the size and cost of the devices.

Researchers emphasize ongoing work to improve accuracy latency and robustness while exploring ethical and privacy considerations for always on sensing.