affective-computing

💻 🤖 A summary on our attempts at using Deep Learning approaches for Emotional Text to Speech 🔈

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Official implementation of the paper "Estimation of continuous valence and arousal levels from faces in naturalistic conditions", Antoine Toisoul, Jean Kossaifi, Adrian Bulat, Georgios Tzimiropoulos and Maja Pantic, Nature Machine Intelligence, 2021

Learning to ground explanations of affect for visual art.

Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model

A curated list of awesome affective computing 🤖❤️ papers, software, open-source projects, and resources

This is my reading list for my PhD in AI, NLP, Deep Learning and more.

A machine learning application for emotion recognition from speech

From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.

😎 Awesome lists about Speech Emotion Recognition

Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits

Toolbox for Emotion Analysis using Physiological signals

🚀 Pre-process, annotate, evaluate, and train your Affect Computing (e.g., Multimodal Emotion Recognition, Sentiment Analysis) datasets ALL within MER-Factory!

This is the official implementation of the paper "Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning".

personal repository

ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition

Self-supervised ECG Representation Learning - ICASSP 2020 and IEEE T-AFFC

IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"

Multimodal Deep Learning Framework for Mental Disorder Recognition @ FG'20