pipette
ESEspañol

NICE Toolbox: Nonverbal Interpersonal Communication Exploration Toolbox

Aleksandr Evgrashin, Carolin Schmitt, Timo L\"ubbing, Ashutosh Jha, Buket Naz Zeren, Sophie K. Bauer, Johannes Kopf-Beck, Anton K. G. Marx, Anamaria Semm, G\"okce Erg\"un, Senya Polikovsky

PreprintEasy to readCode available

In the authors' words

Understanding human communication is a long-standing goal in psychological research. People express themselves through many verbal and nonverbal channels: posture, gesture, gaze, facial expression, and speech. Measurement and annotation of these signals has traditionally required time-consuming manual work by trained human labellers. The Nonverbal Interpersonal Communication Exploration (NICE) Toolbox is a free, open-source Python framework that automatically measures these signals by combining existing state-of-the-art computer vision and speech-processing methods into a single software package. It includes support for multi-camera systems, interchangeable detection algorithms, 2D and 3D visualization of detector outputs, evaluation on the user's custom data, and export to third-party software. With the release of this tool, we aim to make data exploration of interpersonal communication signals scalable, reproducible, and accessible for psychological research.

Main resultThe abstract does not state a limitation.

Appeared: Friday, October 16. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 5 pages, 2 figures. Code: https://github.com/OSLabTools/nicetoolbox. Submitted to the Journal of Open Source Software (JOSS)