Hyperspectral 3D Point Cloud Segmentation using RandLA-Net

Isaak Mitschke, Thomas Wiemann, Felix Igelbrink, Joachim Hertzberg

In: Proceedings of 17th INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (IAS-17). International Conference on Intelligent Autonomous Systems (IAS-2022) June 13-16 Zagreb Croatia IAS 6/2022.


Point clouds are commonly used in robotics to represent 3D maps. To gain further understanding of their content, it is useful to annotate such maps semantically. To segment 3D point clouds with RGB values, different solutions exist. In machine learning, pre-trained classifiers are used for this purpose. Since it is not always possible to differen- tiate between entities relying solely on RGB information, hyperspectral histograms can augment the 3D data. The aim of this work is to eval- uate, if hyperspectral information can improve the segmentation results for ambiguous objects, e.g., streets, sidewalks, and cars using established deep learning methods. Given the reported performance on geometrical 3D data and the possibility to directly integrate point annotations, we extended the neural network RandLA-Net. In addition to the evaluation of RandLA-Net in this context, we also provide a reference dataset consisting of semantically annotated hyperspectral 3D point clouds.


Weitere Links

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence