Call: 2nd International Workshop on Advancements in Social Signal Processing for Multimodal Interaction (ASSP4MI at ICMI2016)

Call for Papers:
The 2nd International Workshop on Advancements in Social Signal Processing for Multimodal Interaction (ASSP4MI@ICMI2016)
16 Nov 2016, Tokyo, Japan

held in conjunction with the 18th ACM International Conference on Multimodal Interaction (ICMI 2016)

Extended Deadline: 2 September 2016


In the last decade, an increasing need for affective and socially intelligent technology has been seen, partly caused by upcoming interactive technology that is enhancing our daily lives in our homes and at work. This has led to a significant increase of research in Social Signal Processing (SSP) in which the aims are to model, analyse, and synthesize social signals (including affective signals) and to develop socially intelligent machines. This body of work is inherently multimodal (e.g., eye gaze, touch, vocal, and facial expressions) and multidisciplinary (e.g., psychology, linguistics, computer science). Major research foci include the automatic understanding and generation of emotional and social behavior in specific situations. Applications are plentiful: the development of social robots, intelligent virtual agents, and smart environments are some of the application areas that will benefit from SSP research.

SSP research involves studying human-human interactions, as well as human-machine interactions. Large corpora consisting of spontaneous human-human interactions offer SSP researchers the opportunity to analyse and understand multimodal human behaviors, and to develop detectors and data mining algorithms. Mining large amounts of human-human interaction data can unravel relations between modalities that were initially hidden from the naked eye. Human-machine interactions on the other hand can be studied in order to understand how the socially intelligent technology developed affects how humans interact with machines.

Although many SSP-related applications already exist, the puzzle is far from solved. Major challenges include robustness of the applications and algorithms, the role of situational and user context in SSP, data collection and annotation, and unknown relations among multiple modalities. SSP is a continuously developing and lively multidisciplinary research domain, bringing along new challenges, methods, application areas and emerging fields of research.


We invite contributions, both research and position papers, addressing recent developments, challenges, and research results in SSP. Papers may relate to the following topics (please note that the list of topics is not exhaustive):

  • Data and annotation in SSP: novel corpora and annotation schemes, elicitation and data collection techniques, annotation issues, ethical issues in data collection
  • Methodology for SSP: improvements in recognition techniques, features, generation methods, evaluation methods, standardization
  • Modalities in SSP: how to fuse information from multiple behavior sources, how are they related to each other, novel modalities? Examples of information sources: eye gaze, voice, face, tactile information, physiological measures, accelerometer data
  • Multidisciplinarity in SSP: approaching SSP-related tasks from other disciplines such as psychology, linguistics, computer science etc. by using methods such as conversational analysis, phonetic analysis and others.
  • Application areas (including ‘special’ target user groups) in SSP and designing for SSP: social robots, intelligent virtual agents, smart environments, wearable technology, mobile phones, healthcare, physical and mental wellbeing, assistive technology, multimedia retrieval, designing for children and elderly, what is the killer application?


Paper submission: Extended deadline: 2 Sep 2016
Paper notification: 28 Sep 2016
Camera-ready: 5 Oct 2016
Workshop: 16 Nov 2016


Interested researchers are invited to submit a paper in the same ACM publication format as the main conference, see (Word) and (LaTeX). Papers may be from 4 to 8 pages long including references. Submissions (pdf) must be sent to The workshop proceedings will be included in the USB, and will be published on the ACM digital library after the conference


Khiet Truong, University of Twente, the Netherlands
Dirk Heylen, University of Twente, the Netherlands
Toyoaki Nishida, Kyoto University, Japan
Mohamed Chetouani, University Pierre and Marie-Curie, France


Dr. Khiet Truong
Assistant Professor
Human Media Interaction, University of Twente

k dot p dot truong at utwente dot nl

This entry was posted in Calls. Bookmark the permalink. Trackbacks are closed, but you can post a comment.

Post a Comment

Your email is never published nor shared. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>


  • Find Researchers

    Use the links below to find researchers listed alphabetically by the first letter of their last name.

    A | B | C | D | E | F| G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z