Abstract
Cristani, M., Pesarin, A., Drioli, C., Tavano, A., Perina, A., & Murino, V. (2011). Generative modeling and classification of dialogs by a low-level turn-taking feature. Pattern Recognition, 44(8), 1785-1800.
Generative modeling and classification of dialogs by a low-level turn-taking feature
In the last few years, a growing attention has been paid to the problem of human-human communication, trying to devise artificial systems able to mediate a conversational setting between two or more people. In this paper, we propose an automatic system based on a generative structure able to classify dialog scenarios. The generative model is composed by integrating a Gaussian mixture model and a (observed) Markovian influence model, and it is fed with a novel low-level acoustic feature termed steady conversational period (SCP). SCPs are built on duration of continuous slots of silence or speech, taking also into account conversational turn-taking. The interactional dynamics built upon the transitions among SCPs provides a behavioral blueprint of conversational settings without relying on segmental or continuous phonetic features, and may be important for predicting the evolution of typical conversational situations in different dialog scenarios. The model has been tested on an extensive set of real, dyadic and multi-person conversational settings, including a recent dyadic dataset and the AMI meeting corpus. Comparative tests are made using conventional acoustic features and classification methods, showing that the proposed scheme provides superior classification performances for all conversational settings in our datasets. Moreover, we prove that our approach is able to characterize the nature of multi-person conversation (namely, the role of the participants) in a very accurate way, thus demonstrating great versatility. (C) 2011 Elsevier Ltd. All rights reserved.
Contact
Cognitive and Biological Psychology
University of Leipzig
Faculty of Life Sciences
Institute of Psychology
Neumarkt 9-19
D-04109 Leipzig
Secretariat
Dagmar Schrödl
Phone: +49 341 97-39570
Email: dagmar dot schroedl at uni-leipzig dot de
Fax: +49 341 97-39271