Camera based orientation for mobile devices

A system in accordance with an exemplary embodiment of the present invention utilizes an on-board camera as a con troller for a hand-held device. Control information is pro vided to an application, Such as a game application, on the hand-held device via video captured by the camera. The video is processed to determine relative motion of the hand-held device. Specific features sensed by the camera are tracked. As the hand-held device is moved, the relative motion between the hand-held device and the sensed features is determined