AVEC 2017 menu

International Workshop on Roadmapping the Future of Multimodal Research

in conjunction with the ACM International Conference on Multimodal Interaction
Istanbul, November 16 2014
Submission deadline: July 31st, 2014


Roadmap for Data Collection

  • 9.20-9.40 Corpus Lifecycle in Multimodal Interaction - Maria Koutsombogera (ILSP / Athena R.C.); Harris Papageorgiou (ILSP / Athena R.C.)
  • 9.40-10.00 Topics for the Future: Genre Differentiation, Annotation, and Linguistic Content Integration in Interaction Analysis - Emer Gilmartin (Trinity College Dublin); Francesca Bonin (Trinity College Dublin); Emer Gilmartin (Trinity College Dublin); Carl Vogel (Trinity College Dublin); Nick Campbell (Trinity College Dublin)

10.00-10.30 Coffee Break

Improving Analytical Methods

  • 10.30-10.50 Role of inter-personal synchrony in extracting social signatures: some case studies - Mohamed Chetouani (ISIR-UPMC)
  • 10.50-11.10 Towards Healthcare Personal Agents – Giuseppe Riccardi (University of Trento)
  • 11.10-11.30 Intra- and Interpersonal Functions of Head Motion in Emotion Communication - Zakia Hammal (CMU); Jeffrey Cohn (University of Pittsburgh)

New Methods for Modeling

  • 11.30-11.50 Statistical Pattern Recognition Meets Formal Ontologies: Towards a Semantic Visual Understanding - Marco Cristani (University of Verona); Roberta Ferrario (CNR)
  • 11.50-12.10 Cognitive Multimodal Processing: from Signal to Behavior - Alexandros Potamianos (National Technical University of Athens)

12.10 – 13.30 Lunch Break

Interaction Roadmap

  • 13.30-13.50 Challenges for Social Embodiment - Elisabeth André (University of Augsburg)
  • 13.50-14.10 ROCKIT: Roadmap for Conversational Interaction Technologies - Steve Renals (University of Edinburgh); Jean Carletta (University of Edinburgh); Keith Edwards (University of Edinburgh); Herve Bourlard (Idiap Research Institute); Phil Garner (Idiap Research Institute); Andrei Popescu-Belis (Idiap Research Institute); Dietrich Klakow (Saarland University) ; Andrey Girenko (Saarland University); Volha Petukhova (Saarland University); Philippe Wacker (LT-Innovate); Andrew Joscelyne (LT-Innovate); Costis Kompis (Vodera); Simon Aliwell (Vodera) ; William Stevens (Europe Unlimited); Youssef Sabbah (Europe Unlimited)
  • 14.10-14.30 Natural Multimodal Interaction with a Social Robot: What are the Premises? - Albert Ali Salah (Bogazici University)

Applications and Business Opportunities

  • 14.30-14.50 Multimodal Interaction for Future Control Centers – Interaction Concept and Implementation - Rene Kaiser (johanneum Research); Ferdinand Fuhrmann (Johanneum Research)
  • 14.50-15.10 Towards Multimodal Pain Assessment for Research and Clinical Use – Zakia Hammal (CMU); Jeffrey Cohn (University of Pittsburgh)
  • 15.10 – 15.30 Automatic Behaviour Understanding in Medicine - Michel Valstar (University of Nottingham)

15.30-16.00 Coffee Break


  • 16.00-17.00 Open discussion

Call for Papers

The last decade has witnessed unprecedented efforts aimed at technologies for modeling, analysis and synthesis of human-human and human-machine multimodal interactions. The result is an extensive and increasingly growing state-of-the-art in domains like affective computing, social signal processing, human-computer interaction, computational paralinguistics, social media analytics, virtual agents, human communication dynamics, personality computing, social robotics, implicit human centered tagging, learning analytics, computer mediated communication and the list could continue. However, relatively little attention was paid to the potential impact these technologies can achieve outside the laboratory, whether this means to address societal issues, to reach the market with successful products or simply to perform experiments in naturalistic settings.

The goal of this workshop is twofold: on the one hand, to shed light on the opportunities available for bringing multimodal interaction technologies to the real world and, on the other hand, to outline a roadmap showing the most important steps still to be made in such a direction.

The list of topics includes (but it is not limited to) the following areas:

  • Identification of key challenges towards making multimodal interaction technologies robust to reality
  • Outline of application domains likely to benefit from multimodal interaction technologies
  • Case studies showing successful collaboration between research institutions and real-world bodies (companies, charities, governments, etc.)
  • Sensors, scenarios and methodologies for data collection in real-world settings
  • Privacy, ethical and legal issues (including intellectual property, patenting issues, etc.)
  • Business and commercial opportunities (including description of companies successfully exploiting multimodal interaction technologies)

The workshop welcomes position papers about the points above as well as about any other relevant issue. Contributions from junior researchers are particularly encouraged.

Instructions for Authors

The papers will be published in a separate section of the ICMI 2014 proceedings and will be included in the ACM Digital Library. The contributions are expected to be between 2 and 4 pages long and to follow the ICMI format available at the following links:

The contributions must be submitted at the following link:

The submission deadline for the manuscripts is July 31st, 2014

The notification of acceptance is August 25th, 2014

The submission deadline for the Camera Ready papers is September 5th, 2014

For any further information, please contact the Workshop organizers:

2 comments to International Workshop on Roadmapping the Future of Multimodal Research

Leave a Reply




You can use these HTML tags

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>