Facebook has offered a glimpse inside its plans for a new augmented reality interface, based on technology from CTRL-Labs, the startup it acquired in 2019. In a video, it shows off wristbands that use electromyography (EMG) to translate subtle neural signals into actions — like typing, swiping, or playing games like an archery simulator. The bands also offer haptic feedback, creating a system that’s more responsive than basic hand tracking options.
Facebook Reality Labs published a blog post detailing its work on a prototype of the wristbands. At its simplest, the bands would track basic gestures Facebook calls “clicks,” which are supposed to be reliable and easy to execute. They’re a little bit like the all-purpose Microsoft HoloLens “air tap” gesture but tracked with the nerve signals that run along your arms, rather than visual sensors mounted on a headset.