FEPS: A sensory substitution system for the blind to perceive facial expressions
Abstract
This work demonstrates a visual-to-auditory Sensory SubstitutionSystemSSDcalled Facial Expression Perception through Sound FEPS). It is designed to enable the visually impairedpeopletoparticipatein a more effective social communication by perceiving their interlocutor's facial expressions. The earlier SSDs provided feedback on inferred emotions, where as, this system responds to thefacial movements. This is a better method than emotion inference due to complexitiesin expression-to-emotion mapping, theproblem ofcapturing multitude ofpossible emotionsderivedfrom a limited facial movements and the difficulty to correctly predict emotions due to lack in ground truth data. In this work, the user's ability to understand the facial expressions has been ensured by a usability study.
Publication Title
ASSETS'12 - Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility
Recommended Citation
Tanveer, M., Iftekhar Anam, A., Yeasin, M., Mahbubur Rahman, A., & Ghosh, S. (2012). FEPS: A sensory substitution system for the blind to perceive facial expressions. ASSETS'12 - Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, 207-208. https://doi.org/10.1145/2384916.2384956
