Abstract
Publications home
SLAMANTIC – Leveraging semantics to improve VSLAM in dynamic environments
at
| Matthias Schorghuber, Daniel Steininger, Yohann Cabon, Martin Humenberger, Margrit Gelautz |
| Workshop on Deep Learning for Visual SLAM at ICCV19, Seoul, South Korea, 27 October-2 November, 2019 |
| Download |
@inproceedings{schorghuber2019slamantic,
title={SLAMANTIC-Leveraging Semantics to Improve VSLAM in Dynamic Environments},
author={Schorghuber, Matthias and Steininger, Daniel and Cabon, Yohann and Humenberger, Martin and Gelautz, Margrit},
booktitle={Proceedings of the IEEE International Conference on Computer Vision Workshops},
pages={0--0},
year={2019}
}In this paper, we tackle the challenge for VSLAM of handling non-static environments. We propose to include semantic information obtained by deep learning methods in the traditional geometric pipeline. Specifically, we compute a confidence measure for each map point as a function of its semantic class (car, person, building, etc.) and its detection consistency over time. The confidence is then applied to guide the usage of each point in the mapping and localization stage. Points with high confidence are used to verify points with low confidence in order to select the final set of points for pose computation and mapping. Furthermore, we can handle map points whose state may change between static and dynamic (a car can be parked or in motion). Evaluating our method on public datasets, we show that it can successfully solve challenging situations in dynamic environments which cause state-of-the-art baseline VSLAM algorithms to fail and that it maintains performance on static scenes. Code is available at http://github.com/mthz/slamantic.