Issue No.01 - Jan.-March (2012 vol.3)
S. Ntalampiras , Electr. & Comput. Eng. Dept., Univ. of Patras, Patras, Greece
N. Fakotakis , Electr. & Comput. Eng. Dept., Univ. of Patras, Patras, Greece
During recent years, the field of emotional content analysis of speech signals has been gaining a lot of attention and several frameworks have been constructed by different researchers for recognition of human emotions in spoken utterances. This paper describes a series of exhaustive experiments which demonstrate the feasibility of recognizing human emotional states via integrating low level descriptors. Our aim is to investigate three different methodologies for integrating subsequent feature values. More specifically, we used the following methods: 1) short-term statistics, 2) spectral moments, and 3) autoregressive models. Additionally, we employed a newly introduced group of parameters which is based on the wavelet decomposition. These are compared with a baseline set comprised of descriptors which are usually used for the specific task. Subsequently, we experimented on fusing these sets on the feature and log-likelihood levels. The classification step is based on hidden Markov models, while several algorithms which can handle redundant information were used during fusion. We report results on the well-known and freely available database BERLIN using data of six emotional states. Our experiments show the importance of including information which is captured by the set based on multiresolution analysis and the efficacy of merging subsequent feature values.
wavelet transforms, emotion recognition, hidden Markov models, speech recognition, statistical analysis, hidden Markov models, temporal evolution modeling, acoustic parameters, speech emotion recognition, emotional content analysis, speech signals, human emotions, spoken utterances, low level descriptor integration, shortterm statistics, spectral moments, autoregressive models, wavelet decomposition, Hidden Markov models, Emotion recognition, Speech, Feature extraction, Computational modeling, Databases, Speech recognition, wavelet decomposition., Acoustic signal processing, speech emotion recognition, temporal feature integration, autoregressive models
S. Ntalampiras, N. Fakotakis, "Modeling the Temporal Evolution of Acoustic Parameters for Speech Emotion Recognition", IEEE Transactions on Affective Computing, vol.3, no. 1, pp. 116-125, Jan.-March 2012, doi:10.1109/T-AFFC.2011.31