Non-intrusive multimodal attention detection

Pao Yue-kong Library Electronic Theses Database

Non-intrusive multimodal attention detection

 

Author: Sun, Jiawei
Title: Non-intrusive multimodal attention detection
Degree: M.Sc.
Year: 2014
Subject: Interactive multimedia
Multimedia systems
Hong Kong Polytechnic University -- Dissertations
Department: Dept. of Computing
Pages: iii, 47 leaves : illustrations (some color) ; 30 cm
Language: English
InnoPac Record: http://library.polyu.edu.hk/record=b2757672
URI: http://theses.lib.polyu.edu.hk/handle/200/7536
Abstract: With the increasing deployment of computes in a wide variety of applications, the ability to detect the user's attention, or engagement, as a key piece of contextual information is becoming more important in building effective interactive systems. The idea is that a system being aware of whether the user is attending to it would be able to adapt itself better to the user activities to enhance productivity. Much previous work in attention detection are either obtrusive or impose demanding constraints on the context and the participants. In addition, most approaches rely on uni-modal signals, often with limited availability and stability. This research attempts to address these two major limitations through a non-intrusive multimodal solution that allows participants to work naturally and without interference. The solution makes use of common off-the-shelf items that could reasonably be expected of any computing environment and does not rely on expensive and tailor-made equipment. With a three-class attention state setting, it achieves average accuracy rates of 59.63% to 77.81%; the best result being 77.81% for a searching task, which shows 11.9% improvement over the baseline. Analysis and discussion on contribution by individual feature to different models are presented in this dissertation.

Files in this item

Files Size Format
b27576723.pdf 1.141Mb PDF
Copyright Undertaking
As a bona fide Library user, I declare that:
  1. I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
  2. I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
  3. I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.

     

Quick Search

Browse

More Information