Research

Introduction

I am currently working on the stationary background generation problem. This problem (also known as stationary background estimation, reconstruction, or initialization problem) consists in generating a unique image estimating the stationary background of an input video sequence acquired from a fixed viewpoint. In this context, the stationary background is defined as the set of elements that are motionless for the duration of the whole sequence (note that this definition excludes the elements subject to periodic movements). Generating an estimation of the background is helpful for many applications including surveillance, segmentation, compression, inpainting, privacy protection, and computational photography [5]. As an example, background subtraction algorithms, able to classify any pixel of a sequence as belonging to the background or not, could benefit from such an estimation to initialize their model. We provide several methods for the generation of a background image: LaBGen and other variants.

LaBGen

LaBGen is an award-winning background generation method combining a pixel-wise median filter and a patch selection mechanism based on a motion detection performed by a background subtraction algorithm. It was introduced in [1], and is extensively described in [2]. It appears to be the best method among the ones submitted to the Scene Background Modeline and Initialization (SBMI) 2015 workshop, and has been ranked number one during the IEEE Scene Background Modeling Contest (SBMC) 2016. Its C++ source code, provided with a ready-to-use program, can be found on the following GitHub repository:

https://github.com/benlaug/labgen

The corresponding paper can be found at:

http://hdl.handle.net/2268/203572

Award LaBGen

Here is a video showing some backgrounds estimated by LaBGen:

If you use LaBGen in your work, please cite papers [2] and [1] as follows:

@article{Laugraud2017LaBGen,
  title = {{LaBGen}: A method based on motion detection for generating the background of a scene},
  author = {B. Laugraud and S. Pi{\'e}rard and M. {Van Droogenbroeck}},
  journal = {Pattern Recognition Letters},
  publisher = {Elsevier},
  volume = {96},
  pages = {12-21},
  year = {2017},
  doi = {10.1016/j.patrec.2016.11.022}
}

@inproceedings{Laugraud2015Simple,
  title = {Simple median-based method for stationary background generation using background subtraction algorithms},
  author = {B. Laugraud and S. Pi{\'e}rard and M. Braham and M. {Van Droogenbroeck}},
  booktitle = {International Conference on Image Analysis and Processing (ICIAP), Workshop on Scene Background Modeling and Initialization (SBMI)},
  publisher = {Springer},
  series = {Lecture Notes in Computer Science},
  volume = {9281},
  pages = {477-484},
  year = {2015},
  month = {September},
  address = {Genova, Italy},
  doi = {10.1007/978-3-319-23222-5_58}
}

LaBGen-P

LaBGen-P is a simpler variant of LaBGen working at the pixel-level. It is described in [2] and has been ranked number two during the IEEE Scene Background Modeling Contest (SBMC) 2016. Its C++ source code, provided with a ready-to-use program, can be found on the following GitHub repository:

https://github.com/benlaug/labgen-p

The corresponding paper can be found at:

http://hdl.handle.net/2268/201146

Here is a video showing some backgrounds estimated by LaBGen-P:

If you use LaBGen-P in your work, please cite paper [3] as follows:

@inproceedings{Laugraud2016LaBGen-P,
  title = {{LaBGen-P}: A Pixel-Level Stationary Background Generation Method Based on {LaBGen}},
  author = {B. Laugraud and S. Pi{\'e}rard and M. {Van Droogenbroeck}},
  booktitle = {IEEE International Conference on Pattern Recognition (ICPR), IEEE Scene Background Modeling Contest (SBMC)},
  pages = {107-113},
  year = {2016},
  month = {December},
  address = {Canc{\'u}n, Mexico},
  doi = {10.1109/ICPR.2016.7899617}
}

LaBGen-OF

LaBGen-OF is a variant of LaBGen using optical flow algorithms (instead of background subtraction algorithms) for motion detection. It is described in [4]. Its C++ source code, provided with a ready-to-use program, can be found on the following GitHub repository:

https://github.com/benlaug/labgen-of

The corresponding paper can be found at:

http://hdl.handle.net/2268/213147

Here is a video showing some backgrounds estimated by LaBGen-OF:

If you use LaBGen-OF in your work, please cite paper [4] as follows:

@inproceedings{Laugraud2017IsAMemoryless,
  title = {Is a Memoryless Motion Detection Truly Relevant for Background Generation with {LaBGen}?},
  author = {B. Laugraud and M. {Van Droogenbroeck}},
  booktitle = {Advanced Concepts for Intelligent Vision Systems (ACIVS)},
  publisher = {Springer},
  series = {Lecture Notes in Computer Science},
  year = {2017},
  month = Sep,
  address = {Antwerp, Belgium}
}

References

[1] B. Laugraud, S. Piérard, M. Braham, M. Van Droogenbroeck. Simple median-based method for stationary background generation using background subtraction algorithms. International Conference on Image Analysis and Processing (ICIAP), Workshop on Scene Background Modeling and Initialization (SBMI), 9281:477-484, 2015.

[2] B. Laugraud, S. Piérard, and M. Van Droogenbroeck. LaBGen: A method based on motion detection for generating the background of a scene. Pattern Recognition Letters, 96:12-21, 2017.

[3] B. Laugraud, S. Piérard, M. Van Droogenbroeck. LaBGen-P: A Pixel-Level Stationary Background Generation Method Based on LaBGen. International Conference on Pattern Recognition (ICPR), IEEE Scene Background Modeling Contest (SBMC), 107–113, 2016.

[4] B. Laugraud, M. Van Droogenbroeck. Is a Memoryless Motion Detection Truly Relevant for Background Generation with LaBGen?. Advanced Concepts for Intelligent Vision Systems (ACIVS), 2017.

[5] L. Maddalena, A. Petrosino. Background Model Initialization for Static Cameras. In Background Modeling and Foreground Detection for Video Surveillance. Chapman and Hall/CRC, 2014.