HearsWhatISee: Software for Visually Impaired
Document Type
Abstract
Publication Date
Spring 5-1-2019
Abstract
Being visually impaired and touching objects to recognize them is not easy. Imagine not having your sense of vision or knowing the areas surrounding you. There is only so much you would be able to identify to understand your atmosphere before moving on to a new location. HearsWhatISee, a Microsoft HoloLens augmented reality application, will speed up the process of recognition for the visually impaired. HearsWhatISee will deploy the front cameras and the spatial scanning of the HoloLens to recognize objects and faces. The HearsWhatISee application is designed for users who are visually impaired. Users will wear the HoloLens and be notified of an object in front of them by a light sound. Once the users hear the sound of recognition, they will have the opportunity to ask questions, for example, “What is this object?” or “Who is near me?”. The HoloLens will recognize the object or the face and reply with the correct name of the item or person. When users move into a new area, HearsWhatISee will automatically spatially scan the area and notify users of new objects. This allows people with visual impairment to quickly recognize their surrounding area without the help of an assistant.
Recommended Citation
Freihofer, Isabel `19, "HearsWhatISee: Software for Visually Impaired" (2019). Student Research. 137, Scholarly and Creative Work from DePauw University.
https://scholarship.depauw.edu/studentresearchother/137
Comments
Completed as part of the Computer Science Senior Capstone Project.