What happens in the Xbox stays in the Xbox

This is a demo of what the Xbox sees through the Kinect depth camera.  It is a complex reconstruction of a lot of data generated by sending infrared or laser light out as point patterns, and timing their return.  This process allows the Kinect software to send gaming software some high level information about the location of limbs, etc.

The title of this post refers to the very non-intuitive raw data returned from the Kinect.  It must be massaged considerably to make sense to the gaming software.

This video represents an intermediate step, whereby the hands, head and arms are reduced to manageable, if inconsistent, points which can then be used to locate weapons and make game choices based on gestures.   I am messing with it.  Seeing limits of its ability to make sense of the physical arrangements.