Augmented reality is defined as a real-world environment whose elements are built upon computer-generated sensory input such as sound, video, graphics or GPS data. In the educational field, students with special needs would benefit from this technology the most. Often students with disability of some kind experience difficulties in the classroom. Augmented reality is the latest technology that could accommodate or modify their learning experience to their specific needs. Their barriers could be broken down and they could receive a functional equivalent education quality as their classmates.

Applications of use for the Deaf

Here are some concept design of the Looking Glass

Deaf individuals also do not always like to have an sign language interpreter escorting them all day long. There is augmented reality glasses/screen panel in development right now. These "Looking Glass" or panels will use variety of speech recognition technologies and create a speech balloon to instantly visualize what people are saying. They will be able to visually see voices in real-time. The speech bubbles will indicate what direction or where the voice and sound is coming from. This especially will be beneficial in a group setting where several different people may be interacting.

"Looking Glass" speech bubble example
Speech bubble example 2

Video of Speech Bubble technology using PocketSphinx with OpenCV

Video of Speech Bubble technology installed at a train station in Vienna

Application of use for the blind

The Voice for Android is a mobile app solution that blind students will be able to download. Using the camera on the mobile phone, the technology will be able to audibly translate their visual environment that they cannot see. Alternatively, they can also put on glasses that will do the same thing. This solution will provide the user with details on color, location, voice locator and face detector.

.Back to home