Publication

Depth-supported real-time video segmentation with the Kinect

Conference Article

Conference

IEEE Workshop on Applications of Computer Vision (IEEE-WACV)

Edition

2012

Pages

457-464

Doc link

http://dx.doi.org/10.1109/WACV.2012.6163000

File

Download the digital copy of the doc pdf document

Authors

  • Alexey, Abramov

  • Pauwels, Karl

  • Papon, Jeremie

  • Wörgötter, Florentin

  • Dellen, Babette

Projects associated

Abstract

We present a real-time technique for the spatiotemporal segmentation of color/depth movies. Images are segmented using a parallel Metropolis algorithm implemented on a GPU utilizing both color and depth information, acquired with the Microsoft Kinect. Segments represent the equilibrium states of a Potts model, where tracking of segments is achieved by warping obtained segment labels to the next frame using real-time optical flow, which reduces the number of iterations required for the Metropolis method to encounter the new equilibrium state. By including depth information into the framework, true objects boundaries can be found more easily, improving also the temporal coherency of the method. The algorithm has been tested for videos of medium resolutions showing human manipulations of objects. The framework provides an inexpensive visual front end for visual preprocessing of videos in industrial settings and robot labs which can potentially be used in various applications.

Categories

pattern recognition.

Scientific reference

A. Alexey, K. Pauwels, J. Papon, F. Wörgötter and B. Dellen. Depth-supported real-time video segmentation with the Kinect, 2012 IEEE Workshop on Applications of Computer Vision, 2012, Breckenridge, CO, USA, pp. 457-464.