The SEMAINE research platform is a (mostly) open-source software package that aims to provide state-of-the-art software tools for nonverbally competent audio-visual behaviour analysis and synthesis for the research community. The aim of the SEMAINE project is to build a Sensitive Artificial Listener (SAL): a multimodal dialogue system with the social interaction skills needed for a sustained conversation with a human user. The SEMAINE project has proposed a system architecture for realising multimodal analysis and generation in a user-and-ECA dialogue situation. The SEMAINE system includes emotion recognition from the user’s face, voice, and head movements, detection of non-verbal behaviour such as laughs and nods, a dialogue management system modelling speaker as well as listener behaviour, voice synthesis, and face synthesis including facial expression synthesis.
- year: 2010
- month: Dec
- edition: 3.1
- url: http://semaine.opendfki.de/wiki/
- main_author: The SEMAINE Project
- license: Free, mostly open source
- platform: Windows, Linux, Mac OS X
Categories: face-analysis; gesture-analysis; language-analysis; voice-analysis; multimodal-analysis; face-synthesis; language-synthesis; voice-synthesis; multimodal-synthesis; linguistic-modelling; psychological-modelling
Copyright © 2012