728x90

Kinect on Android

Kinect is awesome and so is Android. So it would be wonderful to see them work together. I have tries to do this since January 2012 and to my surprise I was able to get preview and a sample game controlled by kinect sensor by the end of February 2012 :). It was amazing to see them work together.

Currently I am trying to control the Android using the Kinect sensor by attaching the Kinect events to Android framework and run a kinect service.

How I got started?
Kinect has an open-source library (libfreenect) for running Kinect in LINUX platform. libhfreenect depends on libusb. Since, Android has LINUX kernel I thougt it would not be difficult to port it to Android. So now I needed to port libusb and libfreenect for android. This can be done by modifying the same codes and changing the build mechanism for building in Android. Android uses Android.mk files.

The main task involved in the project was:
  • having the root access to access the USB OTG device.
  • Writing a JNI layer to provide an interface for Java layer to access the native C API provided by libfreenect.
  • writing a simple KinectService.java to use Kinect with Android Framework.
728x90

+ Recent posts