Wave hand. Turn any surface into a touchscreen


New technology makes it possible to create touch-based interfaces almost at will, with just the swipe of your hand.

The system goes beyond previous work that allowed a depth camera system such as Kinect to be combined with a projector to turn almost any surface into a touchscreen.

The WorldKit system enables someone to rub the arm of a sofa to “paint” a remote control for the TV or swipe a hand across an office door to post a calendar from which subsequent users can “pull down” an extended version. These ad hoc interfaces can be moved, modified, or deleted with similar gestures, making them highly personalized. (via – Wave hand. Turn any surface into a touchscreen)

WorldKit is a system that projects digital interfaces on the world around you, creating a truly ubiquitous computing experience and paving the way for more Digital Overlay devices. Learn more on iQ by Intel. 

The Future of Entertainment series by iQ by Intel and PSFK Labs will highlight the latest in entertainment innovation. Over the course of 10 weeks, we will showcase new products, services and technologies, exploring the changing face of how we consume, share and create content and get reactions from Intel experts. 


Creating interfaces in the world, where and when we need them, has been a persistent goal of research areas such as ubiquitous computing, augmented reality, and mobile computing. In this work, we describe the WorldKit system, which makes use of a paired depth camera and projector to make ordinary surfaces instantly interactive. Using this system, touch-based interactivity can, without prior calibration, be placed on nearly any unmodified surface literally with a wave of the hand, as can other new forms of sensed interaction. From a user perspective, such interfaces are easy enough to instantiate that they could, if desired, be recreated or modified “each time we sat down” by “painting” them next to us. From the programmer’s perspective, our system encapsulates these capabilities in a simple set of abstractions that make the creation of interfaces quick and easy. Further, it is extensible to new, custom interactors in a way that closely mimics conventional 2D graphical user interfaces, hiding much of the complexity of working in this new domain.

Also see Meet WorldKit, the projector that turns everything into a touchscreen.

This is similar to Ubi Interactive, which creates interactive surfaces using Microsoft Kinect and a data projector.