D'haro Enriquez, Luis Fernando luisfernando.dharo@upm.es

Publications

Speech emotion recognition using multimodal LLMs and quality-controlled TTS-based data augmentation for Iberian languages

  • Bellver-Soler, Jaime
  • Guragain, Anmol
  • Ramos-Varela, Samuel
  • Cordoba, Ricardo
  • D'Haro, Luis Fernando

Computer Speech And Language - 1/7/2026

10.1016/j.csl.2025.101927 View at source

  • ISSN 10958363

Cutting Through Overload: Efficient Token Dropping for Speech Emotion Recognition in Multimodal Large Language Models

  • Bellver, Jaime
  • Rodríguez-Cantelar, Mario
  • Córdoba, Ricardo
  • D’Haro, Luis Fernando

30/5/2025

  • iMarina

Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialogue

  • Xu, Jiahui
  • Jiang, Feng
  • Gao, Anningzhe
  • D'Haro, Luis Fernando
  • Li, Haizhou

Ieee Transactions On Audio Speech And Language Processing (p. 4667-4681) - 1/1/2025

10.1109/taslpro.2025.3623884 View at source

  • ISSN 29984173

A dataset of synthetic art dialogues with ChatGPT

  • Gil-Martin, Manuel
  • Luna-Jimenez, Cristina
  • Esteban-Romero, Sergio
  • Estecha-Garitagoitia, Marcos
  • Fernandez-Martinez, Fernando
  • D'Haro, Luis Fernando

Scientific Data - 27/7/2024

10.1038/s41597-024-03661-x View at source

  • ISSN 20524463

Evaluating emotional and subjective responses in synthetic art-related dialogues: A multi-stage framework with large language models

  • Luna-Jimenez, Cristina
  • Gil-Martin, Manuel
  • D'Haro, Luis Fernando
  • Fernandez-Martinez, Fernando
  • San-Segundo, Ruben

Expert Systems With Applications - 5/7/2024

10.1016/j.eswa.2024.124524 View at source

  • ISSN 09574174

Multilingual Speech Emotion Recognition combining Audio and Text using Small Language Models

  • Bellver, Jaime
  • Rodríguez-Cantelar, Mario
  • Estecha Garitagoitia, Marcos
  • Córdoba, Ricardo
  • D'Haro, Luis Fernando

Iberspeech 2024 - 15/11/2024

  • iMarina

Awareness in robotics: An early perspective from the viewpoint of the EIC Pathfinder Challenge" Awareness Inside''

  • C Della Santina
  • CH Corbato
  • B Sisman
  • LA Leiva
  • I Arapakis

Arxiv Preprint Arxiv: - 1/1/2024

  • ISSN 23318422
  • iMarina

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models

  • Y Chen
  • C Zhang
  • D Luo
  • LF D'Haro
  • RT Tan
  • H Li

Arxiv Preprint Arxiv: - 1/1/2024

  • iMarina

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators

  • C Zhang
  • LF D'Haro
  • Y Chen
  • M Zhang
  • H Li

Proceedings Of The Aaai Conference On Artificial Intelligence - 1/1/2024

  • iMarina

Overview of the Ninth Dialog System Technology Challenge: DSTC9

  • Gunasekara, Chulaka
  • Kim, Seokhwan
  • D'Haro, Luis Fernando
  • Rastogi, Abhinav
  • Chen, Yun-Nung
  • Eric, Mihail
  • Hedayatnia, Behnam
  • Gopalakrishnan, Karthik
  • Liu, Yang
  • Huang, Chao-Wei
  • Hakkani-Tur, Dilek
  • Li, Jinchao
  • Zhu, Qi
  • Luo, Lingxiao
  • Liden, Lars
  • Huang, Kaili
  • Shayandeh, Shahin
  • Liang, Runze
  • Peng, Baolin
  • Zhang, Zheng
  • Shukla, Swadheen
  • Huang, Minlie
  • Gao, Jianfeng
  • Mehri, Shikib
  • Feng, Yulan
  • Gordon, Carla
  • Alavi, Seyed Hossein
  • Traum, David
  • Eskenazi, Maxine
  • Beirami, Ahmad
  • Cho, Eunjoon
  • Crook, Paul A
  • De, Ankita
  • Geramifard, Alborz
  • Kottur, Satwik
  • Moon, Seungwhan
  • Poddar, Shivani
  • Subba, Rajen
... View more Collapse

Ieee-Acm Transactions On Audio Speech And Language Processing (p. 4066-4076) - 1/1/2024

10.1109/taslp.2024.3426331 View at source

  • ISSN 15587916

Conversational Dialogue Systems for the Next Decade

  • Luis Fernando D'Haro
  • Zoraida Callejas
  • Satoshi Nakamura

Lecture Notes In Electrical Engineering - 1/1/2021

10.1007/978-981-15-8395-7 View at source

  • ISBN 978-981-15-8395-7
  • ISSN 18761100

Reranking of Responses Using Transfer Learning for a Retrieval-Based Chatbot

  • Aksu IT
  • Chen NF
  • D’Haro LF
  • Banchs RE

Lecture Notes In Electrical Engineering (p. 239-250) - 1/1/2021

10.1007/978-981-15-9323-9_20 View at source

  • ISBN 978-981-15-9323-9_20
  • ISSN 18761100

Overview of the Dialogue Breakdown Detection Challenge 4

  • Higashinaka R
  • D’Haro LF
  • Abu Shawar B
  • Banchs RE
  • Funakoshi K
  • Inaba M
  • Tsunomori Y
  • Takahashi T
  • Sedoc J
... View more Collapse

Lecture Notes In Electrical Engineering (p. 403-417) - 1/1/2021

10.1007/978-981-15-9323-9_38 View at source

  • ISSN 18761100

CLARA: A multifunctional virtual agent for conference support and touristic information

  • D'Haro L
  • Kim S
  • Yeo K
  • Jiang R
  • Niculescu A
  • Banchs R
  • Li H
... View more Collapse

Natural Language Dialog Systems And Intelligent Assistants (p. 233-239) - 29/10/2015

10.1007/978-3-319-19291-8_22 View at source

Proceedings of the 15th International Workshop on Spoken Dialogue Systems Technology

  • Maria Ines Torres, Yuki Matsuda, Zoraida Callejas, Arantza del Pozo, Luis Fernando D’Haro (Editors)

1/5/2025

  • iMarina

Awareness in Robotics: An Early Perspective from the Viewpoint of the challenge “Awareness Inside”

  • D'HARO ENRIQUEZ, LUIS FERNANDO

15th International Workshop on Spoken Dialogue Systems Technology - 1/5/2025

  • iMarina

A Personalized, Multimodal AI Assistant for Enhancing Museum Visitor Experience

  • D'HARO ENRIQUEZ, LUIS FERNANDO

Proceedings of the Workshop on Awareness in Learning Agents (ALA 2025), CEUR Workshop Proceedings - 25/10/2025

  • iMarina

Overview of Dialog System Evaluation Track: Dimensionality, Language, Culture and Safety at DSTC 12

  • Mendonca, John
  • Zhang, Lining
  • Mallidi, Rahul
  • Lavie, Alon
  • Trancoso, Isabel
  • Fernando D'Haro, Luis
  • Sedoc, Joao
... View more Collapse

(p. 27-35) - 1/1/2025

  • iMarina

Context or Retrieval? Evaluating RAG Methods for Art and Museum QA System

  • Ramos-Varela, Samuel
  • Bellver-Soler, Jaime
  • Estecha-Garitagoitia, Marcos
  • D'Haro, Luis Fernando

(p. 129-136) - 1/1/2025

  • iMarina

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators

  • Zhang, Chen
  • D'Haro, Luis Fernando
  • Chen, Yiming
  • Zhang, Malu
  • Li, Haizhou

Proc Conf Aaai Artif Intell (p. 19515-19524) - 25/3/2024

10.1609/aaai.v38i17.29923 View at source

  • ISSN 21595399

Awareness in robotics: an early perspective from the viewpoint of the EIC pathfinder challenge “awareness inside”

  • Cosimo Della Santina, Carlos Hernandez Corbato, Burak Sisman, Luis A. Leiva, Ioannis Arapakis, Michalis Vakalellis, Jean Vanderdonckt, Luis Fernando D’Haro, Guido Manzi, Cristina Becchio, Aïda Elamrani, Mohsen Alirezaei, Ginevra Castellano, Dimos V. Dimarogonas, Arabinda Ghosh, Sofie Haesaert, Sadegh Soudjani, Sybert Stroeve, Paul Verschure, Davide Bacciu, Ophelia Deroy, Bahador Bahrami, Claudio Gallicchio, Sabine Hauert, Ricardo Sanz, Pablo Lanillos, Giovanni Iacca, Stephan Sigg, Manel Gasulla, Luc Steels, and Carles Sierra

European Robotics Forum Erf 2024 - 13/3/2024

  • iMarina

STEPI: System for Triplet Extraction of Personal Information in Dialogue Systems

  • Maria Villa Monedero, Jaime Bellver, Mohamed Imed Eddine Ghebriout, Ricardo De Cordoba, Luis Fernando D'Haro

Iberspeech 2024 - 11/11/2024

  • iMarina

Cvqa: Culturally-diverse multilingual visual question answering benchmark

  • David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, Teresa Lynn, Injy Hamed, Aditya Nanda Kishore, Aishik Mandal, Alina Dragonetti, Artem Abzaliev, Atnafu Lambebo Tonja, Bontu Fufa Balcha, Chenxi Whitehouse, Christian Salamea, Dan John Velasco, David Ifeoluwa Adelani, David Le Meur, Emilio Villa-Cueva, Fajri Koto, Fauzan Farooqui, Frederico Belcavello, Ganzorig Batnasan, Gisela Vallejo, Grainne Caulfield, Guido Ivetta, Haiyue Song, Henok Biadglign Ademtew, Hernán Maina, Holy Lovenia, Israel Abebe Azime, Jan Christian Blaise Cruz, Jay Gala, Jiahui Geng, Jesus-German Ortiz-Barajas, Jinheon Baek, Jocelyn Dunstan, Laura Alonso Alemany, Kumaranage Ravindu Yasas Nagasinghe, Luciana Benotti, Luis Fernando D'Haro, Marcelo Viridiano, Marcos Estecha-Garitagoitia, Maria Camila Buitrago Cabrera, Mario Rodríguez-Cantelar, Mélanie Jouitteau, Mihail Mihaylov, Mohamed Fazli Mohamed Imam, Muhammad Farid Adilazuarda, Munkhjargal Gochoo, Munkh-Erdene Otgonbold, Naome Etori, Olivier Niyomugisha, Paula Mónica Silva, Pranjal Chitale, Raj Dabre, Rendi Chevi, Ruochen Zhang, Ryandito Diandaru, Samuel Cahyawijaya, Santiago Góngora, Soyeong Jeong, Sukannya Purkayastha, Tatsuki Kuribayashi, Teresa Clifford, Thanmay Jayakumar, Tiago Timponi Torrent, Toqeer Ehsan, Vladimir Araujo, Yova Kementchedjhieva, Zara Burzo, Zheng Wei Lim, Zheng Xin Yong, Oana Ignat, Joan Nwatu, Rada Mihalcea, Thamar Solorio, Alham Fikri Aji

38th Conference On Neural Information Processing Systems (Neurips 2024) - 4/11/2024

  • iMarina

THAU-UPM at EmoSPeech-IberLEF2024: Efficient Adaptation of Mono-modal and Multi-modal Large Language Models for Automatic Speech Emotion Recognition

  • Esteban-Romero S
  • Bellver-Soler J
  • Martín-Fernández I
  • Gil-Martín M
  • Fernando D’Haro L
  • Fernández-Martínez F

Ceur Workshop Proceedings - 1/1/2024

  • ISSN 16130073
  • iMarina

This researcher has no working papers.

This researcher has no technical reports.

Diseño de aplicaciones para escenarios reales basadas en enfoques neuronales, inteligentes y sostenibles

  • , (Participante)
  • CORDOBA HERRALDE, RICARDO DE (Investigador principal (IP))
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))
  • San Segundo Hernández, Rubén (Participante)
  • Ferreiros López, Javier (Participante)
  • PARDO MUÑOZ, JOSE MANUEL (Miembro del equipo de trabajo)
  • ESTEBAN ROMERO, SERGIO (Miembro del equipo de trabajo)
... View more Collapse

Period: 01-09-2025 - 31-08-2028

Type of funding: National

Amount of funding: 122000,00 Euros.

  • iMarina

EIC Booster ASSIST

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador/a)

Period: 01-02-2025 - 31-07-2025

  • iMarina

GTHAU. Interacción Humano-IA: Investigación e Innovación en la Generación de Discurso, Interpretación y Traducción en Tiempo Real

  • Penas Ibañez, Azucena (Investigador principal (IP))

Period: 01-01-2025 - 31-12-2027

Type of funding: Regional

Amount of funding: 0,00 Euros.

  • iMarina

Descubriendo el significado y la intención más allá de la palabra hablada: hacia un entorno inteligente para abordar los documentos multimedia

  • CHINCHILLA FITER, CARLOS (Miembro del equipo de trabajo)
  • ESTEBAN ROMERO, SERGIO (Miembro del equipo de trabajo)
  • GIL MARTIN, MANUEL (Miembro del equipo de trabajo)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))
  • CORDOBA HERRALDE, RICARDO DE (Investigador principal (IP))
  • PARDO MUÑOZ, JOSE MANUEL (Participante)
  • San Segundo Hernández, Rubén (Participante)
  • Ferreiros López, Javier (Participante)
... View more Collapse

Period: 01-09-2022 - 31-08-2025

Type of funding: National

  • iMarina

Improving social competences of virtual agents through artificial consciousness based on the Attention Schema Theory

  • PARDO MUÑOZ, JOSE MANUEL (Participante)
  • CORDOBA HERRALDE, RICARDO DE (Participante)
  • Hernández Gómez, Luis Alfonso (Participante)
  • Ferreiros López, Javier (Participante)
  • Montero Martínez, Juan Manuel (Participante)
  • San Segundo Hernández, Rubén (Participante)
  • KONTAXAKIS ANTONIADIS, GEORGIOS (Participante)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))
  • ESTECHA GARITAGOITIA, MARCOS (Participante)
  • SALGADO CRIADO, JESUS (Participante)
  • OLESZUK CARRELO, Mª TERESA (Participante)
  • BELLVER SOLER, JAIME (Investigador principal (IP))
  • LUNA JIMENEZ, CRISTINA (Participante)
  • RODRIGUEZ CANTELAR, MARIO (Participante)
  • FERNANDEZ ALLER, MARIA CELIA (Participante)
  • Fernández Martínez, Fernando (Participante)
  • GIL MARTIN, MANUEL (Participante)
... View more Collapse

Period: 01-12-2022 - 30-11-2025

Type of funding: International

Amount of funding: 1300600,00 Euros.

  • iMarina

ALEXA PRIZE ACADEMIC RESEARCH SPONSORSHIP (SGC5)

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))

Period: From 01-01-2022

  • iMarina

AYUDAS PARA LA REALIZACIÓN DE PROYECTOS DE I+D PARA JÓVENES INVESTIGADORES (GENIUS: GENERACIÓN Y EVALUACIÓN INTELIGENTE DE TEXTOS EN CONTEXTOS MULTIMODALES Y CONVERSACIONALES)

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))

Period: From 01-01-2022

  • iMarina

PROYECTOS SEMILLA DE INVESTIGACION INTERNACIONAL EN HONG KONG UNIVERSIT

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Investigador principal (IP))

Period: From 01-01-2022

  • iMarina

Consultoría sobre la optimización del desarrollo de distintos productos de la empresa

  • Luis Fernando D'Haro Enríquez (Miembro del equipo de investigación)
  • CORDOBA HERRALDE, RICARDO DE (Investigador principal (IP))

Period: 09-06-2021 - 15-10-2021

Type of funding: Internal

Amount of funding: 48000,00 Euros.

  • iMarina

STRATEGIC AND OPERATIONAL CONSULTANCY (THIRD EDITION)

  • Fernández Martínez, Fernando (Colaborador/a)
  • Montero Martínez, Juan Manuel (Colaborador/a)
  • San Segundo Hernández, Rubén (Colaborador/a)
  • CORDOBA HERRALDE, RICARDO DE (Colaborador/a)
  • Ferreiros López, Javier (Colaborador/a)
  • PARDO MUÑOZ, JOSE MANUEL (Investigador principal (IP))
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Colaborador/a)
... View more Collapse

Period: 01-06-2021 - 22-09-2022

  • iMarina

Personal Assistant with Emotional and Multilingual Capabilities for Social Robots

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Director)
  • MATIA ESPADA, FERNANDO (Director) Doctorando: RODRIGUEZ CANTELAR, MARIO

1/1/2025

  • iMarina

Diseño y Evaluación de Técnicas de Reconocimiento de Idioma mediante la Fusión de Información Fonotáctica y Acústica

  • HARO ENRIQUEZ, Luis Fernando d’ (Director)
  • CORDOBA HERRALDE, RICARDO DE (Director) Doctorando: SALAMEA PALACIOS, Christian Raúl

1/1/2018

  • iMarina

THAUMOD: Training Hub for Advanced and Unified MultiODal training and evaluation

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Autor o Coautor)
  • de Cordoba Herralde, Ricardo (Autor o Coautor)
  • RAMOS VARELA, SAMUEL (Autor o Coautor)
  • Estecha Garitagoitia, Marcos Santiago (Autor o Coautor)
  • BELLVER SOLER, JAIME (Autor o Coautor)
  • RODRIGUEZ CANTELAR, MARIO (Autor o Coautor)

11/6/2025

  • iMarina

ORCHESTRA: mOdular aRCHitecture for multimodal and multilingual convErSaTional and Robust AI systems

  • RAMOS VARELA, SAMUEL (Autor o Coautor)
  • Estecha Garitagoitia, Marcos Santiago (Autor o Coautor)
  • BELLVER SOLER, JAIME (Autor o Coautor)
  • RODRIGUEZ CANTELAR, MARIO (Autor o Coautor)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Autor o Coautor)
  • de Cordoba Herralde, Ricardo (Autor o Coautor)

20/2/2025

  • iMarina

Art-GenEvalGPT - A dataset of synthetic art dialogues with ChatGPT

  • GIL MARTIN, MANUEL (Obtentor)
  • LUNA JIMENEZ, CRISTINA (Obtentor)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Obtentor)
  • Fernández Martínez, Fernando (Obtentor)
  • ESTEBAN ROMERO, SERGIO (Obtentor)
  • ESTECHA GARITAGOITIA, MARCOS (Obtentor)
  • BELLVER SOLER, JAIME (Obtentor)
... View more Collapse

12/7/2024

  • iMarina

GenEvalGPT - A Multi-stage Framework with Large Language Models

  • LUNA JIMENEZ, CRISTINA (Obtentor)
  • GIL MARTIN, MANUEL (Obtentor)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Obtentor)
  • Fernández Martínez, Fernando (Obtentor)
  • San Segundo Hernández, Rubén (Obtentor)

12/6/2024

  • iMarina

TourSG: A Research Dialogue Corpus in the Touristic Domain

  • banchs, rafael (Inventores/autores/obtentores)
  • Kim, Seokhwan (Inventores/autores/obtentores)
  • D'HARO ENRIQUEZ, LUIS FERNANDO (Inventores/autores/obtentores)
  • Jiang, Ridong (Inventores/autores/obtentores)
  • Yeoh, Kheng Hui (Inventores/autores/obtentores)
  • Niculescu, Andreea I (Inventores/autores/obtentores)

1/1/2017

  • iMarina

Multimodal interface for searching multimedia content

  • D'HARO ENRIQUEZ, LUIS FERNANDO (Inventores/autores/obtentores)

2/10/2007

  • iMarina
Last data update: 5/15/26 1:42 PM