BACK

Tongue-able Interfaces: Prototyping and Evaluating
Camera Based Tongue Gesture Input System

Tongue-computer interaction techniques create a new pathway between human mind and computer, with particular utility for people with upper limb impairment. The high dexterity and resilience of the tongue make it a good candidate for interacting with computers. This paper introduces a new interaction technique, camera-based tongue computer interface (CBTCI), which employs tongue without any direct physical contact required. Through a two-phase study, the CBTCI was evaluated and its interaction problems were identified and discussed. In the first phase, the performance of the CBTCI prototype was evaluated through two user tests. The participants' behaviors were observed throughout the first phase and analyzed to scaffold the study of the design problems in gesture based tongue computer interaction. The Phase II study investigated the usability problems of CBTCI which were reflected through the user behavior and participants' feedback; specifically the exploration of referential techniques to make users aware of their tongue position and adjust their gesture. Pros and cons of the referential strategies are discussed to foster future assistive tongue-computer interface design.

Publications:

Shuo Niu, Li Liu, and D. Scott McCrickard. "Tongue-able interfaces: evaluating techniques for a camera based tongue gesture input system." In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility, pp. 277-278. ACM, 2014.

Li Liu, Shuo Niu, Jingjing Ren, and Jingyuan Zhang. "Tongible: a non-contact tongue-based interaction technique." In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility, pp. 233-234. ACM, 2012.