Editing Multimodal Speech Recognition (section)

=== Increased Contextual Understanding ===
By analyzing both the spoken word and the speaker's facial expressions or gestures, multimodal systems can better understand the context and emotion behind the speech, leading to more accurate results. A study created a database that includes various emotions expressed by people in speech-based interactions<ref>Kessous, L., Castellano, G., & Caridakis, G. (2010). Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. ''Journal on Multimodal User Interfaces'', ''3''(1–2), 33–48. <nowiki>https://doi.org/10.1007/s12193-009-0025-5</nowiki></ref>. By combining facial expressions, body gestures, and speech analysis, they successfully integrated three modalities to enhance emotion recognition. The results show that multimodal approaches have a significant advantage in emotion recognition, especially when combining facial expressions, body gestures, and speech information.