Publication

Questions and answers: Important steps to let AI chatbots answer questions in the museum

Stefan Schaffer, Aaron Ruß, Mino Lee Sasse, Louise Schubotz, Oliver Gustke

In: Proceedings of the 10th EAI International Conference: ArtsIT, Interactivity & Game Creation. EAI International Conference: ArtsIT, Interactivity & Game Creation (ArtsIT-2021) Artificial Intelligence in Art and Culture December 2-3 Karlsruhe Germany EAI Conference series Springer International Publishing 2021.

Abstract

In this paper, we describe our work within the research project “CHIM – Chatbot in the Museum”. CHIM is an AI-based chatbot prototype that enables conversational interaction using text and speech input: visitors can ask questions about certain artworks and receive answers in multimodal formats (text, audio, image, video). The application will be tested in the Städel Museum, Frankfurt/Main, Germany. To develop a proper Natural Language Understanding module, we adapted an existing categorization approach, gathered visitor questions, and structured them into twelve distinct content types. The preliminary results suggest that our approach to subdivide the previously overloaded content type meaning into further categories was successful, leading to a more balanced distribution of the data. We further describe the Natural Language Processing mechanisms employed here; these follow a multi-tiered approach using techniques like Rasa, BERT, and cosine-similarity to generate answers with different degrees of effort. Future steps are the implementation of dialog management, the refinement of the NLP strategies by integrating additional answers for selected exhibits, and the implementation of the final layout and interaction design. We are planning to test and evaluate the CHIM prototype on site in the Städel Museum in late 2021.

Projekte

ArtsIT_2021.pdf (pdf, 6 MB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz