Academic
Publications
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays

A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays,Nils Krahnstoever,Sanshzar Kettebekov,Mohammed Yeasin,Rajeev Sharm

A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays   (Citations: 40)
BibTex | RIS | RefWorks Download
This paper presents a framework for designing a natu- ral multimodal modal human computer interaction (HCI) system. The core of the proposed framework is a princi- pled method for combining information derived from audio and visual cues. To achieve a natural interaction, both audio and visual modalities are fused along with feedback through a large screen display. A careful design along with due considerations of possible aspects of a systems interaction cycle and integration has resulted in a successful system. The performance of the proposed framework has been validated through development of several prototype systems as well as commercial applica- tions for the retail and entertainment industry. To assess the impact of these multimodal systems (MMS), informal studies have been conducted. It was found that the system performed according to its specifications in 95% of the cases and that users showed ad-hoc proficiency, indicat- ing natural acceptance of such systems.
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
Sort by: