HearsWhatISee: Software for Visually Impaired

Document Type

Abstract

Publication Date

Spring 5-1-2019

Abstract

Being visually impaired and touching objects to recognize them is not easy. Imagine not having your sense of vision or knowing the areas surrounding you. There is only so much you would be able to identify to understand your atmosphere before moving on to a new location. HearsWhatISee, a Microsoft HoloLens augmented reality application, will speed up the process of recognition for the visually impaired. HearsWhatISee will deploy the front cameras and the spatial scanning of the HoloLens to recognize objects and faces. The HearsWhatISee application is designed for users who are visually impaired. Users will wear the HoloLens and be notified of an object in front of them by a light sound. Once the users hear the sound of recognition, they will have the opportunity to ask questions, for example, “What is this object?” or “Who is near me?”. The HoloLens will recognize the object or the face and reply with the correct name of the item or person. When users move into a new area, HearsWhatISee will automatically spatially scan the area and notify users of new objects. This allows people with visual impairment to quickly recognize their surrounding area without the help of an assistant.

Comments

Completed as part of the Computer Science Senior Capstone Project.

This document is currently not available here.

Share

COinS