Combinatorics

Point cloud

Pattern recognition (psychology)

Loop (graph theory)

Mobile robot

Mathematics

Lidar

Gene

Ranging

Mathematical analysis

Artificial intelligence

Geography

Generalization

Chemistry

Transformation (genetics)

Object detection

Computer science

Simultaneous localization and mapping

Computer vision

Biochemistry

Remote sensing

Telecommunications

Robot

IEEE Transactions on Robotics

Loop closure detection is an essential component of simultaneous localization and mapping (SLAM) systems, which reduces the drift accumulated over time. Over the years, several deep learning approaches have been proposed to address this task; however, their performance has been subpar compared to handcrafted techniques, especially while dealing with reverse loops. In this article, we introduce the novel loop closure detection network (LCDNet) that effectively detects loop closures in light detection and ranging (LiDAR) point clouds by simultaneously identifying previously visited places and estimating the six degrees of freedom relative transformation between the current scan and the map. LCDNet is composed of a shared encoder, a place recognition head that extracts global descriptors, and a relative pose head that estimates the transformation between two point clouds. We introduce a novel relative pose head based on the unbalanced optimal transport theory that we implement in a differentiable manner to allow for end-to-end training. Extensive evaluations of LCDNet on multiple real-world autonomous driving datasets show that our approach outperforms state-of-the-art loop closure detection and point cloud registration techniques by a large margin, especially while dealing with reverse loops. Moreover, we integrate our proposed loop closure detection approach into a LiDAR SLAM library to provide a complete mapping system and demonstrate the generalization ability using different sensor setup in an unseen city.

LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAM