Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
In this paper, we propose a novel center-based decoupled point cloud registration framework for robust 6D object pose estimation in real-world scenarios. Our method decouples the translation from the entire transformation by predicting the object center and estimating the rotation in a center- aware manner. This center offset-based translation estimation is correspondence-free, freeing us from the difficulty of constructing correspondences in challenging scenarios, thus improving robustness. To obtain reliable center predictions, we use a multi-view (bird's eye view and front view) object shape description of the source-point features, with both views jointly voting for the object center. Additionally, we propose an effective shape embedding module to augment the source features, largely completing the missing shape information due to partial scanning, thus facilitating the center prediction. With the center-aligned source and model point clouds, the rotation predictor utilizes feature similarity to establish putative correspondences for SVD-based rotation estimation. In particular, we introduce a center-aware hybrid feature descriptor with a normal correction technique to extract discriminative, partaware features for high-quality correspondence construction. Our experiments show that our method outperforms the state-of-the-art methods by a large margin on realworld datasets such as TUD-L, LINEMOD, and OccludedLINEMOD. Code is available at https://github.com/JiangHB/CenterReg.
Simon Nessim Henein, Loïc Benoît Tissot-Daguette
Ekaterina Krymova, Nicola Parolini, Andrea Kraus, David Kraus, Daniel Lopez, Yijin Wang, Markus Scholz, Tao Sun