Saturday, January 29, 2011

3D modelling with Kinect VIMP resources


Time Efficient Reconstruction of 3D Models With Kinect and RGBD-SLAM
- Very recent. (Submitted on 7th Feb 2011)
-They describe it as:
"We extract SURF features from the camera image and localize them in 3D space. We match these features between every pair of acquired images, and use RANSAC to robustly estimate the 3D transformation between them. To achieve real-time processing, we match the current image only versus a subset of the previous images with decreasing frequency. Subsequently, we construct a graph whose nodes correspond to camera views and whose edges correspond to the estimated 3D transformations. The graph is then optimized to reduce the accumulated pose errors."

Juergen Hess ( and Felix Endres ( from the University of Freiburg own this work.

Got the Next Pointer

Felix Endres pointed me to two great resources:
1) The source code of the for the above -mentioned algorithm is available here.
2) Dieter Fox, who's a professor at University of Washington has a publication and some work in modelling with Kinect. His publication is titled "RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments". I will go through it shortly.

RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments

What is the paper about?

Is it about/applicable to Kinect?

How does it relate to my work?

Kinect Calibration : Depth and Color


(1) RGB camera Calibration
If you already are familiar with usual camera calibration techniques, then the Kinect RGB camera is no different.

(2) RGB-Depth Cross Calibration
There is no hardware registration performed on the images. In other words, the pixels in both the buffers do not correspond to each other one-to-one at hardware level by default. So unless you explicitly come up with an affine matrix that does the correspondence for you Kinect (it differs from one Kinect to another), the depths and colors are going to look inconsistent.
Nicholus Burrus's 'RGB-Demo' helps you calibrate your Kinect. More information here. It can be downloaded and compiled easily.

More Links
* Basics of calibration here.

Kinect FAQ

1) How to get openKinect to work on Windows?

- describes the procedure. If you already are using OpenKinect on Linux, then getting it on Windows can be done by using the corresponding wrapper( in the /wrappers directory).

New to Kinect? Start here!!

The OpenKinect wiki - contains tons of information for new Kinect users who want to explore the project and for developers alike.

How can I install libfreenect, where is the walkthrough?

How can I ask for help on list and in the channel? I'm getting this error message ... ?

Who is involved with the project?

How should I get started to contribute code to the project and which wrapper?

How does the Kinect USB protocol works? Image size? 0x0002 @ 0x001a does what?

Under which licenses is libfreenect released?

What have people been doing with the Kinect, what demos, what's the project roadmap?

And what about that laser illuminator there?

How did the project start?

Other issues?
And group mailing list is also a great resource to search for posts on a specific subject.

( Borrowed from OpenKinect mailing list : credits go to bankP (

Things to come...

I haven't been updating this blog at all. Which I guess in a couple of days I should.
At this point I think following would be the first three things I should be talking about in first few posts:

I have assumed a Linux system (I use Ubuntu 10.10 Maverick currently for my Kinect experiments)
1) Installing Kinect on a Linux system.
2) Making use of Kinect with the help of a few demo programs.
3) Important resources for further reading and wooing :)
4) Understanding the camera model ( Kinect Calibraition)

I am hoping to find some good time to spend on writing this stuff. It will be here very soon.

C ya :)

Wednesday, January 26, 2011

Kinect VIMP Source Links

OpenKinect's knowledge base has all the theory/experiments/explanations , that are constantly added/updated.

Tech-tree has kept a really sharp track of Kinect developments.

KinectHacks maintains good updates on very interesting Kinect hacks.

This tech-tree page also talks about a very impressive use of Kinect for creating 3D road-maps of cities.

And here are Kinect Tutorials provided by ROS!! Note : it has calibrating the kinect camera

Following are really really really important and MUST_GO_THROUGH web resources....

0) Nicolas Burrus's Post on Kinect calibration ( both color and depth )

1) The RGB Demo software ( opensource code )
- it has source code downloadable
- it has documentation

2) A small post for give links on Kinect Calibration