Desktop software applications are built with traditional user interfaces in mind. Unlike modern Smartphones and tablets where Tactile and other haptic user-interface modalities are primary, desktop user-interfaces put excessive focus on keystrokes/mouse clicks. It can be established from data that the leading cause of repetitive strain injuries and ensuing lost workdays at workplaces is carpal tunnel syndrome arising from keyboard/mouse usage. The leading focus of this study is to demonstrate a high level user interface layer that can coordinate between a multiplicity of modalities and can be used to drastically reduce the number of mouse-clicks/keystrokes. The modalities will be implemented bottom up and the algorithms involved will be detailed. The user interface layer can be connected to any application through a simple API , thus it can be used to extend the accessibility of any existing software.
Voice-actuated-events, Phonemes, Speech-synthesis, Classifier, Bright-spot Detection, Nose tip tracking, Eye-Blink-detection.
1."Image based Face Detection and Recognition: based Face Detection and Recognition: based Face Detection and Recognition: State of the Art” Faizan Ahmad, Aaima Najam and Zeeshan Ahmed ,department of Computer Science & Engineering, Beijing University of Aeronautics & Astronautics
2. Malachy J. Foley, University of North Carolina at Chapel Hill, NC " Avoiding Mouse Elbow"
3. Oraya Sawettanusorn, Yasutaka Senda, Shinjiro Kawato, Nobuji Tetsutani, and Hironori Yamauchi "REAL-TIME FACE DETECTION USING SIX-SEGMENTED RECTANGULAR FILTER (SSR FILTER)REAL-TIME FACE DETECTION USING SIX-SEGMENTED RECTANGULAR FILTER (SSR FILTER")
4. Chiang, C. C., Tai, W. K., Yang, M. T., Huang, Y. T. & Huang, C. J., (2003). A novel method for detecting lips, eyes and faces in real-time. Real-Time Imaging 9, 277-287.
5. Gurbuz, S., Kinoshita, K., & Kawato, S., (2004a).Real-time human nose bridge tracking in presence of geometry and illumination changes. Second International Workshop on Man-Machine Symbiotic Systems, Kyoto, Japan.
6. S. Kawato and J. Ohya. Two-step approach for real-time eye tracking with a new filtering technique. Proc. Int. Conf. on System , Man & Cybernetics, pages 1366–1371, 2000.
7. P.Viola and M.Jones, “Rapid object Detection using a Boosted Cascade of Simple Features,” Proc. Of IEEE Conf.CVRP,1 , pp.511-518,2001.
8. Lamere, P.; Kwok, P.; Walker, W.; Gouva, E.; Singh, R.; Raj, B.; Wolf, P , MITSUBISHI ELECTRIC RESEARCH LABORATORIES"Design of the CMU Sphinx-4 Decoder"
