gesture recognition technology

5

Getting Smartphones To Understand In-Air Gestures

by Michael Keller

Sometimes getting your smartphone to do what you want requires feats of phalangeal gymnastics. And other times, a bag in one hand and a not-quite-long-enough thumb on the hand holding the device mean turning gymnastics into juggling.

Now researchers at Microsoft and the Federal Institute of Technology in Zurich, Switzerland, (ETH) say they’ve got a solution to your manual mauling of that otherwise user-friendly piece of electronics. They’ve developed an app that harnesses the phone’s camera to translate hand gestures in front of it into input commands. 

Pinching and opening the thumb and pointer finger can open a magnifying glass on a map. Making the gun gesture can advance a page in a document or fire the weapon in your video game. See the video below.

Keep reading