Publikation
QueryCAD: Grounded Question Answering for CAD Models
Claudius Kienle; Benjamin Alt; Darko Katic; Rainer Jäkel; Jan Peters
In: IEEE International Conference on Robotics and Automation, ICRA 2025, Atlanta, GA, USA, May 19-23, 2025. IEEE International Conference on Robotics and Automation (ICRA), Pages 5798-5805, IEEE, 2025.
Zusammenfassung
CAD models are widely used in industry and
are essential for robotic automation processes. However, these
models are rarely considered in novel AI-based approaches,
such as the automatic synthesis of robot programs, as there
are no readily available methods that would allow CAD
models to be incorporated for the analysis, interpretation, or
extraction of information. To address these limitations, we
propose QueryCAD, the first system designed for CAD question
answering, enabling the extraction of precise information from
CAD models using natural language queries. QueryCAD in-
corporates SegCAD, an open-vocabulary instance segmentation
model we developed to identify and select specific parts of the
CAD model based on part descriptions. We further propose a
CAD question answering benchmark to evaluate QueryCAD
and establish a foundation for future research. Lastly, we
integrate QueryCAD within an automatic robot program syn-
thesis framework, validating its ability to enhance deep-learning
solutions for robotics by enabling them to process CAD models.
https://claudius-kienle.github.io/querycad