Mouthbrush: Drawing and Painting by Hand and Mouth
Author(s): Chi-ho Chan, Michael J. Lyons, Nobuji Tetsutani.
Proceedings: 5th international conference on Multimodal interfaces, Poster Session, pp. 277--280,
2004.
[BibTeX] 
Abstract:
We present a novel multimodal interface which permits users to
draw or paint using coordinated gestures of hand and mouth. A
headworn camera captures an image of the mouth and the mouth
cavity region is extracted by Fisher discriminant analysis of the
pixel colour information. A normalized area parameter is read
by a drawing or painting program to allow read-time gestural
control of pen/brush parameters by mouth gesture while
sketching with a digital pen/tablet. A new performance task, the
Radius Control Task, is proposed as a means of systematic
evaluation of performance of the interface. Data from
preliminary experiments show that with some practice users can
achieve single pixel radius control with ease. A trial of the
system by a professional artist shows that it is ready for use as a
novel tool for creative artistic expression.