[en] Given a video sequence acquired with a fixed camera, the generation of the stationary background of the scene is a challenging problem which aims at computing a reference image for a motionless background. For that purpose, we developed our method named LaBGen, which emerged as the best one during the Scene Background Modeling and Initialization (SBMI) workshop organized in 2015, and the IEEE Scene Background Modeling Contest (SBMC) organized in 2016. LaBGen combines a pixel-wise temporal median filter and a patch selection mechanism based on motion detection. To detect motion, a background subtraction algorithm decides, for each frame, which pixels belong to the background. In this paper, we describe the LaBGen method extensively, evaluate it on the SBI 2016 dataset and compare its performance with other background generation methods. We also study its computational complexity, the performance sensitivity with respect to its parameters, and the stability of the predicted background image over time with respect to the chosen background subtraction algorithm. We provide an open source C++ implementation at http://www.telecom.ulg.ac.be/labgen.
Research center :
Montefiore Institute - Montefiore Institute of Electrical Engineering and Computer Science - ULiège
Laugraud, Benjamin ; Université de Liège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Dép. d'électric., électron. et informat. (Inst.Montefiore)
Pierard, Sébastien ; Université de Liège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications
Van Droogenbroeck, Marc ; Université de Liège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Télécommunications
Language :
English
Title :
LaBGen: A method based on motion detection for generating the background of a scene
Publication date :
2017
Journal title :
Pattern Recognition Letters
ISSN :
0167-8655
Publisher :
Elsevier Science
Special issue title :
Special Issue on Scene Background Modeling and Initialization
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M., Interactive digital photomontage. ACM Trans. Graph. 23:3 (2004), 294–302.
Barnich, O., Van Droogenbroeck, M., ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20:6 (2011), 1709–1724.
Bouwmans, T., Traditional and recent approaches in background modeling for foreground detection: an overview. Comput. Sci. Rev. 11–12 (2014), 31–66.
Cristani, M., Farenzena, M., Bloisi, D., Murino, V., Background subtraction for automated multisensor surveillance: a comprehensive review. EURASIP J. Adv. Signal Process., 2010, 2010, 24pages.
De Gregorio, M., Giordano, M., Background modeling by weightless neural networks. International Conference on Image Analysis and Processing Workshops (ICIAP Workshops) Lecture Notes in Computer Science, 9281, 2015, 493–501.
Elgammal, A., Harwood, D., Davis, L., Non-parametric model for background subtraction. European Conference on Computer Vision (ECCV) Lecture Notes in Computer Science, 1843, 2000, Springer, Dublin, Ireland, 751–767.
Goyat, Y., Chateau, T., Malaterre, L., Trassoudaine, L., Vehicle trajectories evaluation by static video sensors. IEEE Intelligent Transportation Systems Conference (ITSC), Toronto, Canada, 2006, 864–869.
Heikkilä, M., Pietikäinen, M., A texture-based method for modeling the background and detecting moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 28:4 (2006), 657–662.
Hofmann, M., Tiefenbacher, P., Rigoll, G., Background segmentation with feedback: the pixel-based adaptive segmenter. IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, Rhode Island, USA, 2012, 38–43.
Laugraud, B., Latour, P., Van Droogenbroeck, M., Time ordering shuffling for improving background subtraction. Advanced Concepts for Intelligent Vision Systems (ACIVS) Lecture Notes in Computer Science, 9386, 2015, Springer, 58–69.
Laugraud, B., Piérard, S., Braham, M., Van Droogenbroeck, M., Simple median-based method for stationary background generation using background subtraction algorithms. International Conference on Image Analysis and Processing (ICIAP), Workshop on Scene Background Modeling and Initialization (SBMI) Lecture Notes in Computer Science, 9281, 2015, Springer, 477–484.
Laugraud, B., Piérard, S., Van Droogenbroeck, M., LaBGen-P: a pixel-level stationary background generation method based on LaBGen. IEEE International Conference on Pattern Recognition (ICPR), IEEE Scene Background Modeling Contest (SBMC), Cancun, Mexico, 2016.
Maddalena, L., Petrosino, A., A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans. Image Process. 17:7 (2008), 1168–1177.
Maddalena, L., Petrosino, A., The SOBS algorithm: what are the limits?. IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, Rhode Island, USA, 2012, 21–26.
Maddalena, L., Petrosino, A., Background model initialization for static cameras. Background Modeling and Foreground Detection for Video Surveillance, 2014, Chapman and Hall/CRC, 3.1–3.16.
Maddalena, L., Petrosino, A., Towards benchmarking scene background initialization. International Conference on Image Analysis and Processing Workshops (ICIAP Workshops) Lecture Notes in Computer Science, 9281, 2015, 469–476.
Manzanera, A., Richefeu, J., A robust and computationally efficient motion detection algorithm based on sigma-delta background estimation. Indian Conference on Computer Vision, Graphics and Image Processing, Kolkata, India, 2004, 46–51.
Piérard, S., Van Droogenbroeck, M., A perfect estimation of a background image does not lead to a perfect background subtraction: analysis of the upper bound on the performance. International Conference on Image Analysis and Processing (ICIAP), Workshop on Scene Background Modeling and Initialization (SBMI) Lecture Notes in Computer Science, 9281, 2015, Springer, 527–534.
Reddy, V., Sanderson, C., Lovell, B., A low-complexity algorithm for static background estimation from cluttered image sequences in surveillance contexts. EURASIP J. Image Video Process., 164956, 2011, 13pages.
Sobral, A., BGSLibrary: an OpenCV C++ background subtraction library. Workshop de Visao Computacional (WVC), Rio de Janeiro, Brazil, 2013, 1–6.
Sobral, A., Bouwmans, T., h. Zahzah, E., Comparison of matrix completion algorithms for background initialization in videos. International Conference on Image Analysis and Processing Workshops (ICIAP Workshops) Lecture Notes in Computer Science, 9281, 2015, 510–518.
St-Charles, P.-L., Bilodeau, G.-A., Bergevin, R., SuBSENSE: a universal change detection method with local adaptive sensitivity. IEEE Trans. Image Process. 24:1 (2015), 359–373.
Stauffer, C., Grimson, E., Adaptive background mixture models for real-time tracking. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2, 1999, 246–252 Fort Collins, Colorado, USA.
Wang, H., Suter, D., A novel robust statistical method for background initialization and visual surveillance. Asian Conference on Computer Vision (ACCV) Lecture Notes in Computer Science, Berlin, Heidelberg, 3851, 2006, 328–337.
Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., Ishwar, P., CDnet 2014: an expanded change detection benchmark dataset. IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, Ohio, USA, 2014, 393–400.
Wang, Z., Simoncelli, E.P., Bovik, A.C., Multiscale structural similarity for image quality assessment. Asilomar Conference on Signals, Systems and Computers, 2, 2003, Pacific Grove, California, USA, 1398–1402.
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A., Pfinder: real-time tracking of the human body. IEEE Trans. Pattern. Anal. Mach. Intell. 19:7 (1997), 780–785.
Yalman, Y., Ertürk, I., A new color image quality measure based on YUV transformation and PSNR for human vision system. Turk. J. Electr. Eng.Comput. Sci. 21:2 (2013), 603–613.
Zivkovic, Z., Improved adaptive Gaussian mixture model for background subtraction. IEEE International Conference on Pattern Recognition (ICPR), 2, 2004, 28–31 Cambridge, UK.
