Those who are deaf or hard of hearing are unable to enjoy listening to music, immerse themselves in concerts, and gain the full experience on watching their favorite TV show or movie.

One solution that was present in the past was utilizing subtitles along with what the viewer was watching. But, a few word description of the soundtrack provided in the subtitles don't capture the emotional depth of music.

Many deaf/HH people have stated that they can experience music through feeling vibration through balloons. However, this only captures the broad beats present in the sound playing, rather than precisely grasping the tone, rhythm, dynamics, or melody. Vibrations are only effective when the person with hearing impairment is near a loud speaker, demonstrating that this solution hardly works in any other situation.

In 2015, an experiment was conducted, where both deaf and non-deaf participants were shown visual stimuli that simulated rhythmic patterns. Cross-modal plasticity was demonstrated whenthe deaf participants had their auditory cortex (normally utilized to process sound) activated in response to the visual rhythms. However, there were hardly any activity in the auditory cortices of the hearing participants.

This finding motivated us to create a real-time music visualizer to allow the deaf/HH audience to experience music to a greater degree.