pipette
ESEspañol

Audio emotion recognition for atypical hearing

Ulysse Roussel

Preprint with a published version

In the authors' words

My doctoral work aims to explore Audio Emotion Recognition (AER) in the context of atypical listening. This research focuses on auditory hypersensitivity in people with autism, a phenomenon that is often difficult to evaluate and unique to each individual. Our core idea is to leverage our understanding of affect from acoustic traits, relying on the possibility of generalizing affective responses from a small amount of annotated data. As a first step, we fine-tune a large foundation model, Contrastive Language-Audio Pretraining (CLAP) using low-rank adaptation (LoRA), trained on a valence and arousal dataset of neurotypical listeners.

Main resultThe abstract does not state a limitation.

Appeared: Monday, September 28. arXiv. Preprint with a published version.

Published version: ACII : Affective Computing and Intelligent INteraction 2026, Enrique Sucar; Nadia Berthouze; Gary McKeown, Sep 2026, Puebla (Mexico), Mexico