Pictorial Structures-based Upper Body Tracking and Gesture Recognition

Tracking the articulated human body has been a difficult research because body poses change so dynamic and vary in visual appearance. Pictorial Structures (PS) with dynamic programming (particle filtering) has been widely used for tracking human body, which is highly articulated and moves dynamically. In this paper, we use PS and a particle filter for upper body tracking. However, a Markov-process-based dynamic motion model for particle filtering cannot adequately predict the particles. We propose a key-pose-based proposal distribution that uses similarities between the input silhouette image and the key poses to effectively predict the particles. We select relatively few example poses from the pose space as key poses, train for embedded features, and formulate the proposal distribution with key pose similarities and a Markov-process-based dynamic model. We experimentally evaluate our proposal method and an observation model and test gesture recognition for human-robot interaction. C. Oh, M. Islam, C. Lee, Pictorial Structures-based Upper Body Tracking and Gesture Recognition, 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV 2011), Feb. 2011