Combining Color, Depth, and Motion for Video Segmentation

This paper presents an innovative method to interpret the content of a video scene
using a depth camera. Cameras that provide distance instead of color information are
part of a promising young technology but they come with many diff culties: noisy signals,
small resolution, and ambiguities, to cite a few.
By taking advantage of the robustness to noise of a recent background subtraction
algorithm, our method is able to extract useful information from the depth signals. We
further enhance the robustness of the algorithm by combining this information with that
of an RGB camera. In our experiments, we demonstrate this increased robustness and
conclude by showing a practical example of an immersive application taking advantage
of our algorithm.