Attractor-Guided Particle Filtering for Lip Contour Tracking

Abstract

We present a lip contour tracking algorithm using attractor-guided particle filtering. Usually it is difficult to robustly track the lip contour because the lip contour is highly deformable and the contrast between skin and lip colors is very low. It makes the traditional blind segmentation-based algorithms often fail to have robust and realistic results. But in fact, the lip contour is constrained by the facial muscles, the tracking configuration space can then be represented by a lower dimensional manifold. With this observation, we take some representative lip shapes as the attractors in the lower dimensional manifold. To resolve the low contrast problem, we adopt a color feature selection algorithm to maximize the separability between skin and lip colors. Then we integrate the shape priors and the discriminative feature into the attractor-guided particle filtering framework to track the lip contour. The experimental result shows that we can track the lip contour robustly and efficiently.

Demo Video

Demo 1 Demo 2 [Presentation]

Reference:

Yong-Dian Jian, Wen-Yan Chang, and Chu-Song Chen
Attractor-Guided Particle Filtering for Lip Contour Tracking
Proceedings of 7th Asian Conference on Computer Vision, LNCS 3851, pp. 653-663, Hyderabad, India, 2006 (ACCV2006, Oral)
[Paper PDF]

Wen-Yan Chang, Chu-Song Chen and Yong-Dian Jian
Visual Tracking in High-Dimensional State Space by Appearance-Guided Particle Filtering
IEEE Transactions on Image Processing, vol. 17, no. 7, pp. 1154--1167, 2008