Real-time robust body part tracking for augmented reality interface

Authors:

Jinki Jung

Kyusung Cho

Hyun S. Yang

KAIST - interaction lab in korea

Link to paper

Summary:

Goal: to model the 3D body from the 2D detected body parts. a step towards more intuitive interaction in AR environment. (project NATAL)

- system deletes the background to get one single body blob.

- uses skin texture to detect face and 2 hands.

- uses lower body contour to detect leg and feet.

- users particle tracking to track the head through the frames.

The 3D pose is then estimated from the body parts recognized. An adaptive color detection is used to provide clothing and illumination independent detection of body parts. The 3D location is calculated based on the center point camera and its distance to head , and 2 feet.

Discussion:

There is one more person in MIT media lab with strange name doing the same kind of research. The skin texture detection independent of clothing color is cool.

Comments: Franck, Murat