The vOICe for Android

The vOICe for Android

100,000 - 500,000 downloads

Add this app to your lists
See with your ears! The vOICe for Android maps live camera views to soundscapes, offering augmented reality for the totally blind through sensory substitution and computer vision. Also includes a talking color identifier, talking compass, talking face detector and a talking GPS locator, while CamFind visual search and Google Goggles can be launched from The vOICe for Android by tapping the left or right screen edge.

Is it an augmented reality game or a serious tool? It can be both, depending on what you want it to be! The ultimate goal is to provide a form of synthetic vision to the blind, but sighted users can simply have fun playing the game of sight-without-eyesight. Visually impaired users with severe tunnel vision can try if the auditory feedback helps them notice changes in the visual periphery. The vOICe for Android is compatible with Google Glass, using the tiny camera in these glasses to generate a live sonic augmented reality overlay, hands-free! You will want to use an external battery connected via USB cable to keep the small Google Glass battery from draining too quickly, and access to The vOICe's special options is currently still limited on Glass. You can help us by blogging and tweeting about your experiences, use cases, and how *you* learn to see with sound.

How does it work? The vOICe uses pitch for height and loudness for brightness in one-second left to right scans of any view: a rising bright line sounds as a rising tone, a bright spot as a beep, a bright filled rectangle as a noise burst, a vertical grid as a rhythm. Best used with stereo headphones for the most immersive experience and most detailed auditory resolution.

Just experiment with simple visual patterns first, because real-life imagery is complex. Randomly drop a bright item such as a DUPLO brick on a dark table top, and learn to reach for it through sound alone (closing your eyes if you have eyesight). Next try and explore your own safe home environment, learning to associate the complex sound patterns with what you already know is there.

For serious users: learning to see with sound is like learning a foreign language or learning to play a musical instrument, really challenging your perseverance and brain plasticity. It may well be the ultimate brain training system, bridging the senses through artificial synesthesia.

Why is it free? Because our foremost goal is to make a real change by lowering barriers to use as much as we can. You will find that competing technologies cost upwards of $15,000 and yet have lower specs. The perceptual resolution offered by The vOICe is unmatched even by $100,000 "bionic eye" retinal implants (PLoS ONE 7(3): e33136).

Please report bugs to feedback@seeingwithsound.com, and visit the web page seeingwithsound.com/android.htm for detailed description and disclaimers. We are on Twitter at @seeingwithsound.

Thank you!

Tags: the voice games, call recorder beep off, the voice game in, the voice español, ciegos colores, the voice, augmented reality blind, the voice game, game the voice, codigo para foice movil.

Recently changed in this version

v1.76: Low light boost option added (HDR, default on). Fix for crashes in About dialog.

v1.75: Minor bug fixes. No known fix for The vOICe reportedly no longer running on Google Glass. :-(

v1.74: Adaptations to support ZGPAX S5 smartwatch phone (240 x 240 pixel screen, 2MP camera).

v1.73: Further adaptations for Google Glass, enforcing fullscreen mode for proper view.

v1.72: Preliminary adaptations for Google Glass (untested!). Launch with "OK Glass, start imaging, The vOICe for Android".


Comments and ratings for The vOICe for Android
  • (54 stars)

    by Joan Kamaru on 05/07/2013

    Some time ago we made a Black and White Art Show. It was held on the virtual world of Second Life where visitors could buy artworks created for Peters software. Virtualart can be saved to computer and printed out for experimenting with.

  • (54 stars)

    by Taal G on 10/06/2013

    amazing app

  • (54 stars)

    by Emlyn Tilley on 15/05/2013

    Thought id try this and see how it works, after a small amount using it you can distinguish door ways ect and can see how it would be useful for blind people after a bit of training.

  • (54 stars)

    by Verica Milosevic on 08/05/2013

    Freaky....Scary do NOT install (I'm still shaking)

  • (54 stars)

    by Sassine Ghantous on 08/05/2013

    Love it. Use it for night vision goggles too XD

  • (54 stars)

    by zfj xyx on 07/05/2013

    great!

  • (54 stars)

    by Vince S on 04/04/2013

    Picks up faces pretty well. An interesting way to represent images in audio though it is hard to distinguish horizontal objects.