What is it about?
This is an interpretable and ready-to-use pipeline for modelling engagement in human-robot interactions. In addition to predicting engagement, the pipeline provides deeper insights into a person's personality, attitude, and emotion. This innovative approach incorporates the Big Five personality traits, the Interpersonal Circumplex (IPC), and the Triandis Theory of Interpersonal Behavior (TIB).
Featured Image
Photo by Andy Kelly on Unsplash
Why is it important?
Prior work uses machine learning directly to predict engagement given multimodal data. This work uses theories from psychology -- the Big Five personality traits, the Interpersonal Circumplex, and Triandis' Theory of Interpersonal Behavior, to emulate how a human understands another's, emotion, personality, and engagement given multimodal cues. The results are thus more interpretable and explainable than those obtainable from standard "black box" ML models.
Perspectives
There is a lot of interest these days in "physics informed" machine learning. This work can be called "psychology informed" machine learning using computer vision and related data.
Shrisha Rao
International Institute of Information Technology - Bangalore
Read the Original
This page is a summary of: From multimodal features to behavioural inferences: A pipeline to model engagement in human-robot interactions, PLoS ONE, November 2023, PLOS,
DOI: 10.1371/journal.pone.0285749.
You can read the full text:
Resources
Using Psychology and Machine Learning to Improve Human-Robot Interaction
Press release describing the work.
IIITB researchers develop pipeline for a ‘human’ engagement with bots
Newspaper article about this work in The Hindu by Jahnavi T.R.
IIIT Bangalore researchers develop robotic model that can feel human emotions
News article in Deccan Herald by Rashmi Belur. NB. Slightly inaccurate heading; the model can be be used by a robot to perceive emotions, but it does not enable a robot to feel them.
Researchers use psychology theories to build more ‘Human-like bots’
News report in New Indian Express by Puran Choudhary, also linked from ACM TechNews.
पाइपलाइन तंत्र मानव इंटरैक्टिव रोबोट परिकल्पना को करेगा साकार
News article by Ahubha Jain in Lokmat News (Hindi).
Novel model helps form human interactive robot: To work on psychology and emotions
Article in Lokmat Times, Nagpur edition by Anubha Jain.
Contributors
The following have contributed to this page
