A Multimodal Corpus of Expert Gaze and Behavior during Phonetic Segmentation Tasks

Arif Khan, Ingmar Steiner, Yusuke Sugano, Andreas Bulling, Ross Macdonald

In: 11th Language Resources and Evaluation Conference (LREC). International Conference on Language Resources and Evaluation (LREC-2018) 11th May 7-12 Miyazaki Japan Pages 4277-4281 European Language Resources Association (ELRA) Paris 5/2018.


Phonetic segmentation is the process of splitting speech into distinct phonetic units. Human experts routinely perform this task manually by analyzing auditory and visual cues using analysis software, which is an extremely time-consuming process. Methods exist for automatic segmentation, but these are not always accurate enough. In order to improve automatic segmentation, we need to model it as close to the manual segmentation as possible. This corpus is an effort to capture the human segmentation behavior by recording experts performing a segmentation task. We believe that this data will enable us to highlight the important aspects of manual segmentation, which can be used in automatic segmentation to improve its accuracy.

Weitere Links

LREC2018b.pdf (pdf, 1 MB ) LREC2018bPoster.pdf (pdf, 863 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz