What is it about?
The MuSe-Stress sub-challenge in the MuSe 2022 Multimodal Sentiment Analysis Challenge aims to predict valence and physiological arousal from multimodal data in a stressed disposition. It provides the audio, video, text, and biological recordings (i.e., Electrocardiogram (ECG), Heart Rate (BPM), and Respiration).
Featured Image
Photo by Daniele Levis Pelusi on Unsplash
Why is it important?
In the MuSe 2022 Multimodal Sentiment Analysis Challenge, we propose Multimodal Temporal Attention (MMTA), which considers the temporal effects of all modalities on each unimodal branch, realizing the interaction between unimodal branches and adaptive inter-modal balance.
Perspectives
I hope this article can be enlightening to anyone interested in multimodal fusion.
Yu He
University of the Chinese Academy of Sciences
Read the Original
This page is a summary of: Multimodal Temporal Attention in Sentiment Analysis, October 2022, ACM (Association for Computing Machinery),
DOI: 10.1145/3551876.3554811.
You can read the full text:
Contributors
The following have contributed to this page
