Google's Project Soli: Controlling devices using hand gestures​

Okay, lets all at the watch,you can see as my hand approaches, it dynamically start to react, [LAUGH] [APPLAUSE] note that the responsiveness and precision of reader, enable us to create this continuous fluid and interaction Okay, so what if I wanna interact with more detail? That's easy. I just move my hand closer to the watch and I can use a virtual dial gesture to interact with a complication. [APPLAUSE] [APPLAUSE] So here you can see I'm using a virtual dial gesture to rotate through these various complications so we've got the messages, the weather, and the calendar. These gestures represent interactions with physical controls such as using an analogue dial. Because I don't have to touch the screen, we can get a lot more information on the display. And of course, just because they're micro gestures doesn't mean I have to do them right next to the device. They also work at a distance. [APPLAUSE] Let's select one of the other applications, the weather for example. I'll remove my hand, and now when I come back in, I can instantly look at what the next weather information is. So you can see with just a few silly gestures, we can already start to build these rich interactions. Solely imbedded, fully on a smart watch. [APPLAUSE] So he controls home devices from a distance without touching them. This is the very first prototype. It's here with speaker. Very early work, but the idea here is exactly the same introduction principles and the same gestures that we designed for watch. Also allow us to control the speaker. You can see. [APPLAUSE] It's a different embodiment, but the principles are the same. Are the [UNKNOWN] hand, you can see that the speaker recognizes and reacts to is. So what are you gonna do next? Note that the interactions here are much larger than the watch. They are several feet. The sensor actually can sense up to around 15 meters, [APPLAUSE] so we can do some pretty amazing stuff with this. And this is the same thing that's in the watch. Same algorithms. So as I approach I can now use the virtual tool to turn it on. [MUSIC] Okay, let's try another track. [MUSIC] What do you think? Next one? [MUSIC] Yeah, that's pretty cool. Okay, but I can also do other gestures, more immediate ones, [SOUND] like shut it up. [LAUGH] Great.