EMOTIONAL SPEECH SYNTHESIS

I have been working on algorithms for emotional speech synthesis. The objective was to manipulate the prosody of computer generated speech signals so that a human listener can perceive different kinds of emotions or attitudes, such as happiness, sadness or anger. The algorithms that I developped were inspired by psychoacoustic studies but in no way tryed to reproduce precisely the way humans modulate their prosody to express emotions. Rather, I developed operators for prosodic deformation which are analogous to the deformation of faces in Walt Disney pictures used to express visually the emotions of characters. In brief, there was little science in this project, but a lot of fun!  

These algorithms are described in:

Oudeyer P-Y. (2002) The production and recognition of emotions in speech: features and algorithms, International Journal in Human-Computer Studies, vol. 59/1-2, pp. 157-183, special issue on Affective Computing. bibtex reference  abstract
 

You can hear yourself some examples of results in the following baby-like meaningless babbling sounds:

Neutral:

Happy:

Angry :

Also, I developped means to control continuously the degree of emotion as well as the age of the voice, as seen on the following screenshot of our software :
 

happy, but not so much   normally happy    very happy

sad, but not so much  normally sad   very sad

angry, but not so much     normally angry   very angry

I applyed these algorithm to meaningful speech, and in particular to japanese speech.
Here is a screenshot of the corresponding software, in which you can see lower level controls than on the previous software) :

RELATED PROJECTS

The Maïdo and Gurby Experiment

Emotional Speech Recognition

Natural human-robot interaction

Developmental Robotics and Artificial Curiosity

Acquisition and evolution of language