Abstract
Martin Humenberger, Yohann Cabon
Workshop on Deep Learning for Visual SLAM at ICCV19, Seoul, South Korea, 27 October 2019-02 November, 2019
Abstract
In this paper, we tackle the challenge for VSLAM of handling non-static environments. We propose to include semantic information obtained by deep learning methods in the traditional geometric pipeline. Specifically, we compute a confidence measure for each map point as a function of its semantic class (car, person, building, etc.) and its detection consistency over time. The confidence is then applied to guide the usage of each point in the mapping and localization stage. Points with high confidence are used to verify points with low confidence in order to select the final set of points for pose computation and mapping. Furthermore, we can handle map points whose state may change between static and dynamic (a car can be parked or in motion). Evaluating our method on public datasets, we show that it can successfully solve challenging situations in dynamic environments which cause state-of-the-art baseline VSLAM algorithms to fail and that it maintains performance on static scenes. Code is available at http://github.com/mthz/slamantic.
NAVER LABS Europe 6-8 Chemin de Maupertuis 38240 Meylan France Contact