I don't have the answer for you but if you'd like a real-world PoC the Kinect does exactly what you're describing only with the word "Xbox." Does it quite well

I don't have the answer for you but if you'd like a real-world PoC the Kinect does exactly what you're describing only with the word "Xbox." Does it quite well too I might add...