Towards a Multimodal Framework for Human Behavior Recognition

This paper proposes a framework of an interface that is capable of detecting and classifying human intentions and personality types. The framework relies on a conventional set of multimodal components, namely an eye-tracking system, a mouse and a keyboard, where a large number of real time data anal...

Full description

Saved in:
Bibliographic Details
Main Authors: Soueina, Sidi O., Kiss, Jocelyne, Chaudeyrac, Pascal, Bouvier, Patrice, Salem, Ahmed H., Elmaghraby, Adel S.
Format: Conference Proceeding
Language:English
Subjects:
Avatars
Computer science
Educational institutions
Eye-tracking
Eyes
Human-centered computing > Human computer interaction (HCI)
Human-centered computing > Human computer interaction (HCI) > Interaction devices
Human-centered computing > Human computer interaction (HCI) > Interaction devices > Touch screens
Humans
Intention analysis
Keyboards
Mice
Multimodality
Ontologies
serious games
Testing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper proposes a framework of an interface that is capable of detecting and classifying human intentions and personality types. The framework relies on a conventional set of multimodal components, namely an eye-tracking system, a mouse and a keyboard, where a large number of real time data analysis will take place, in order to detect behavioral patterns. The system gradually learns from the players and builds a collection of patterns of actions. The personalities of the players are detected through ontological comparisons of known personality types with the newly discovered patterns of actions. We further layout the ground of our initial assumption -- appearing in other publications, that the sub-conscious controls the eyes movements during the game, on those elements or words that are related to the fears and desire, i.e., the personality of the player.
DOI:10.1109/WI-IATW.2006.133