Academic
Publications
Facial Feature Tracking and Occlusion Recovery in American Sign Language

Facial Feature Tracking and Occlusion Recovery in American Sign Language,Thomas J. Castelli,Margrit Betke,Carol Neidle

Facial Feature Tracking and Occlusion Recovery in American Sign Language   (Citations: 4)
BibTex | RIS | RefWorks Download
Facial features play an important role in expressing grammatical information in signed languages, including American Sign Language (ASL). Gestures such as raising or furrowing the eyebrows are key indicators of constructions such as yes-no questions. Periodic head movements (nods and shakes) are also an essential part of the expression of syntactic information, such as negation (associated with a side-to-side headshake). Therefore, identification of these facial gestures is essential to sign language recognition. One problem with detection of such grammatical indicators is occlusion recovery. If the signer's hand blocks his/her eyebrows during production of a sign, it becomes di/cult to track the eyebrows. We have developed a system to detect such grammatical markers in ASL that recovers promptly from occlusion. Our system detects and tracks evolving templates of facial features, which are based on an anthropometric face model, and interprets the geometric relationships of these templates to identify grammatical markers. It was tested on a variety of ASL sentences signed by various Deaf,native signers and detected facial gestures used to express grammatical information, such as raised and furrowed eyebrows as well as headshakes.
Conference: Pattern Recognition in Information Systems , pp. 81-90, 2006
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
    • ...There exist many works on facial feature tracking, e.g., [3-12]...
    • ...Existing systems often require some manual initialization, and few systems are able to recover from the loss of track, for example, due to occlusion [2,8,9,13,15]...

    Esra Ataer Cansizogluet al. An Information Fusion Approach for Multiview Feature Tracking

    • ...Our work relates to efforts by the Computer Vision community to develop facial feature tracking systems [5]...
    • ...Many existing systems require some manual initialization, and few are able to recover from loss of track, for example due to occlusion [5-8]...

    Caitlin Connoret al. Movement and Recovery Analysis of a Mouse-Replacement Interface for Us...

    • ...There are only a few works on tracking facial features for recognizing facial expressions in SL such as [16, 3]. However, the 3D model used in [16] is computationally expensive and sensitive to noise, and the anthropometric 2D model used in [3] might not be suitable when 3D head rotations occur...
    • ...There are only a few works on tracking facial features for recognizing facial expressions in SL such as [16, 3]. However, the 3D model used in [16] is computationally expensive and sensitive to noise, and the anthropometric 2D model used in [3] might not be suitable when 3D head rotations occur...
    • ...The work reported in [3] only tried to recognize two brow states and head shake...

    Tan Dat Nguyenet al. Tracking facial features under occlusions and recognizing facial expre...

    • ...There are only a few works on tracking facial features for recognizing facial expressions in SL such as [5, 6]. However, the 3D model used in [5] is computationally expensive and sensitive to noise, and the anthropometric 2D model used in [6] might not be suitable with 3D head rotations...
    • ...There are only a few works on tracking facial features for recognizing facial expressions in SL such as [5, 6]. However, the 3D model used in [5] is computationally expensive and sensitive to noise, and the anthropometric 2D model used in [6] might not be suitable with 3D head rotations...

    Tan Dat Nguyenet al. Towards recognition of facial expressions in sign language: Tracking f...

Sort by: