Artículo
Emotion recognition in talking-face videos using persistent entropy and neural networks
Autor/es | Paluzo Hidalgo, Eduardo
González Díaz, Rocío Aguirre Carrazana, Guilermo |
Departamento | Universidad de Sevilla. Departamento de Matemática Aplicada I (ETSII) |
Fecha de publicación | 2022 |
Fecha de depósito | 2022-06-30 |
Publicado en |
|
Resumen | The automatic recognition of a person’s emotional state has become a very active research
field that involves scientists specialized in different areas such as artificial intelligence, computer vi sion, or psychology, ... The automatic recognition of a person’s emotional state has become a very active research field that involves scientists specialized in different areas such as artificial intelligence, computer vi sion, or psychology, among others. Our main objective in this work is to develop a novel approach, using persistent entropy and neural networks as main tools, to recognise and classify emotions from talking-face videos. Specifically, we combine audio-signal and image-sequence information to com pute a topology signature (a 9-dimensional vector) for each video. We prove that small changes in the video produce small changes in the signature, ensuring the stability of the method. These topological signatures are used to feed a neural network to distinguish between the following emotions: calm, happy, sad, angry, fearful, disgust, and surprised. The results reached are promising and competitive, beating the performances achieved in other state-of-the-art works found in the literature. |
Agencias financiadoras | Agencia Estatal de Investigación. España Agencia Andaluza del Conocimiento |
Identificador del proyecto | PID2019-107339GB-100
P20-01145 |
Cita | Paluzo Hidalgo, E., González Díaz, R. y Aguirre Carrazana, G. (2022). Emotion recognition in talking-face videos using persistent entropy and neural networks. Electronic Research Archive, 30 (2), 644-660. |
Ficheros | Tamaño | Formato | Ver | Descripción |
---|---|---|---|---|
10.3934_era.2022034.pdf | 12.18Mb | [PDF] | Ver/ | |