Have you ever felt your interaction with avatars, robots or chatbots as highly "unnatural", especially when entailing more than one modalities?
More often than usual, this is caused by these artificial machines lacking cognitive and social skills. By and large and while not noticing it explicitly during human-to-human interactions, this is largely the gap that needs to be covered for machines/computers/robots to be perceived as interacting in a more human-like manner.
In deriving accurate multimodal interaction models, MULTISIMO has produced a vast datasets collection comprising human-human interaction recordings, using a concise experimental protocol and state-of-the-art equipment. This dataset is made freely available under certain T&Cs for scientific research purposes.