User:Bkpsusmitaa/sandbox4

From Wikipedia, the free encyclopedia

Back-up copy of my hard work

vOICe[edit]
"vOICe" redirects here. For VOICE, see VOICE (disambiguation). For voice, see voice (disambiguation).
"The vOICe" redirects here. For THE VOICE, see THE VOICE (disambiguation).

The vOICe Auditory Display Technology is one of several approaches towards sensory substitution (vision substitution) for the blind that aims to provide synthetic vision to the user, analogous to seeing their surroundings using sound waves, by means of a non-invasive visual prosthesis.

vOICe is a technology that allows blind individuals to perceive, analogous to seeing, their surroundings using sound waves.

The vOICe Auditory Display maps live camera images into sounds. The brains of the blind users then learn to decode these generally extremely complex sounds as meaningful vision over time. Ideally, this would not only enable the experienced blind user understand the visual content, but also perceive it as truly visual, making it "feel" like vision.

It creates a pattern out of an image formed in the field of a head- or belt- mounted camera and uses “soundscape,” patterns of scores of different tones at different volumes and pitches emitted simultaneously.

The vOICe Auditory Display has a picture resolution of up to a few thousand pixels (e.g., 60 by 60 pixels) Additionally, it doesn't require any surgery (with the related dangers). Actually, its interface to the mind by means of sound is simply through headphones. The vOICe approach utilizes equipments that one can purchase in most PC shops: PC camera, subnotebook PC, smartphones and stereo earphones (COTS - Commercial Off the Shelf), which holds the cost down when contrasted with more devoted therapeutic equipments. The vOICe specifically expands upon Nature's own nanotechnology − the human hearing and the human brain. This is accomplished with none of the well-being- or safety-worries about conceivable risks associated with human-made nanoparticles and nanotechnology.

The vOICe converts live camera views from a video camera into soundscapes, patterns of scores of different tones at different volumes and pitches emitted simultaneously[1]. This system uses general video to audio mapping by associating height to pitch and brightness with loudness in a left-to-right scan of any video frame.[2] Views are typically refreshed about once per second with a typical image resolution of up to 60 x 60 pixels as can be proven by spectrographic analysis.[1]

The device is based on the brain's adaptability, owing to its neuroplasticity, to learn to perceive imagery out of a pattern, and reinforce that learning through repeated experiences, using the principles of artificial synesthesia.

Over time with practice, the processing is gradually sent down to the subconscious levels and becomes automatic.

The technology has been positively and widely reviewed on the media, including newspapers and news websites, [3] [4] other websites[5] [6] [7] [8] [9] [10] and Science Magazines [11] [12] [13].

Presently, there is also an Android App available for the technology[14].

Neuroscience and psychology research[15][16][17][18][19] indicate recruitment of relevant brain areas in seeing with sound, as well as functional improvement through training[20][21][22].

The ultimate goal is to provide synthetic vision with truly visual sensations by exploiting the neural plasticity of the human brain. The system does not require any surgery. Its interface to the mind is simply headphones[23][24]. Over time with practice, the processing within the brain is gradually sent down to the subconscious levels and becomes automatic.[25]

Neuroscience research [26][27][28][29] has shown that the visual cortex of even adult blind people can become responsive to sound, and "seeing with sound" might reinforce this in a visual sense with live video from a head-mounted camera encoded in sound. The extent to which cortical plasticity indeed allows for functionally relevant rewiring or remapping of the human brain is still largely unknown and is being investigated in an open collaboration with research partners around the world.

One suggestion for increasing the relative efficiency of the resulting visual stimuli is to adjust the visual field by using an accelerometer to provide a steady image even if the head is moved, which is implemented in its Android edition[30]. Connecting an infrared sensor to adjust the camera position to match eye movements is an option for the Windows edition (though affordable mobile eye-trackers are not yet on the market).

The technology of the vOICe was invented in the 1990's by Peter Meijer[1]. It has been positively and widely reviewed in media[31][32][33][34][35][36][37][38][39] and also in various high-quality peer-reviewed scientific journals, far extensive than those partially referenced in the current section, and maintained by the inventor's website itself.

References[edit]

  1. ^ a b c Meijer PBL (1992). "An Experimental System for Auditory Image Representations". IEEE Transactions Biomedical Engineering. 39 (2): 112–121. doi:10.1109/10.121642. PMID 1612614.
  2. ^ Cite error: The named reference bach was invoked but never defined (see the help page).
  3. ^ Daily Mail: Seeing with SOUND
  4. ^ The Guardian: vOICe- the soundscape headsets that allow blind people to ‘see’ the world
  5. ^ The vOICe - Seeing with Sound
  6. ^ Article at the American Academy of Ophthalmology website, Humayun: Restoring ‘Vision’ With Sensory Substitution Devices
  7. ^ ScienceDirect, reporting NeuroImage Elsevier Peer-Reviewed Journal article, Top-down influence on the visual cortex of the blind during sensory substitution
  8. ^ Neural Regeneration Research, a peer-reviewed journal article, Use of sensory substitution devices as a model system for investigating cross-modal neuroplasticity in humans
  9. ^ Nature, a peer-reviewed science journal article, 'Visual’ parsing can be taught quickly without visual experience during critical periods
  10. ^ A Nature Scientific Report, Auditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
  11. ^ Science: Computer Program Allows the Blind to 'See' With Sound
  12. ^ Popular Science: Device Trains Blind People To 'See' By Listening
  13. ^ LiveMint: Shooting blind
    Relevant portion evidencing how far the technology has travelled and empowered the differently-abled, "... Delhi-based photographer Pranav Lal, who is also blind, uses vOICe, a camera-based visual sound technology ,,, experience of live camera views ... image-to-sound rendering ..."
  14. ^ vOICe App for Android
  15. ^ Neural Regeneration Research, a peer-reviewed journal article, Use of sensory substitution devices as a model system for investigating cross-modal neuroplasticity in humans
  16. ^ Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli? Original Research ARTICLE, Frontiers in Psychology, 13 October 2015
  17. ^ A Nature Scientific Report, Auditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
  18. ^ "Computer Program Allows the Blind to 'See' With Sound". Science | AAAS. 2014-03-06. Retrieved 2017-04-15.
  19. ^ "Device Trains Blind People To 'See' By Listening". Popular Science. Retrieved 2017-04-15.
  20. ^ A. Amedi; W. Stern; J. A. Camprodon; F. Bermpohl; L. Merabet; S. Rotman; C. Hemond; P. Meijer; A. Pascual-Leone (June 2007). "Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex". Nature Neuroscience. 10 (6): 687–689. doi:10.1038/nn1912. PMID 17515898.
  21. ^ M. Auvray; S. Hanneton; J. K. O'Regan (2007). "Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with 'The vOICe'" (PDF). Perception. 36 (3): 416–430. doi:10.1068/p5631. PMID 17455756.
  22. ^ M. J. Proulx; P. Stoerig; E. Ludowig; I. Knoll (March 2008). "Seeing 'Where' through the Ears: Effects of Learning-by-Doing and Long-Term Sensory Deprivation on Localization Based on Image-to-Sound Substitution". PLoS ONE. 3 (3): e1840. doi:10.1371/journal.pone.0001840. PMC 2267489. PMID 18364998.{{cite journal}}: CS1 maint: unflagged free DOI (link)
  23. ^ A Nature Scientific Report, Auditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
  24. ^ "Computer Program Allows the Blind to 'See' With Sound". Science | AAAS. 2014-03-06. Retrieved 2017-04-15.
  25. ^ "Device Trains Blind People To 'See' By Listening". Popular Science. Retrieved 2017-04-15.
  26. ^ Article at the American Academy of Ophthalmology website, Humayun: Restoring ‘Vision’ With Sensory Substitution Devices
  27. ^ ScienceDirect, reporting NeuroImage Elsevier Peer-Reviewed Journal article, Top-down influence on the visual cortex of the blind during sensory substitution
  28. ^ How the brain's neuroplasticity lets us substitute one sense for another—and invent new ones Rewiring the Brain to Create New Senses
  29. ^ Research on synesthesia has led to devices that blur the lines between the senses, and may offer new hope for the blind Sensory Substitution
  30. ^ "The vOICe for Android - Android Apps on Google Play". play.google.com. Retrieved 2017-04-15.
  31. ^ "Glasses which turn video into noise are allowing blind people to 'see'". Mail Online. Retrieved 2017-04-15.
  32. ^ Doward, Jamie (2014-12-06). "vOICe: the soundscape headsets that allow blind people to 'see' the world". The Guardian. ISSN 0261-3077. Retrieved 2017-04-15.
  33. ^ Chaturvedi, Pooja (22 Jan 2013). "Shooting blind". livemint.com. Retrieved 16 April 2017.
    Relevant portion evidencing how far the technology has travelled and empowered the differently-abled, "... Delhi-based photographer Pranav Lal, who is also blind, uses vOICe, a camera-based visual sound technology ,,, experience of live camera views ... image-to-sound rendering ..." .
  34. ^ Gurung, Regina (15 Nov 2016). "He hears shapes, clicks it!". The New Indian Express. Express News Service. Retrieved 16 April 2017.
  35. ^ "The vOICe - Seeing with Sound". The vOICe - Seeing with Sound. Retrieved 2017-04-15.
  36. ^ https://www.wired.com/2017/03/book-excerpt-body-builders
  37. ^ http://www.sciencemag.org/news/2014/03/computer-program-allows-blind-see-sound
  38. ^ https://www.theguardian.com/society/2014/dec/07/voice-soundscape-headsets-allow-blind-see
  39. ^ http://www.popsci.com/science/article/2013-07/synesthesia-blind

Note[edit]

For the articles and reports published on peer-reviewed Scientific Journals, each of the individually-referenced article needs to be downloaded and searched with the string, "vOICe", with enabled "Match Case".

See Also[edit]

Human Brain
Synesthesia
Neuroplasticity

External Links[edit]

https://www.seeingwithsound.com
The vOICe for Android
The vOICe Lets The Blind See With SOUND!
Animated visual at the product's webpage

Retrieved from "https://en.wikipedia.org/w/index.php?title=User:Bkpsusmitaa/sandbox4&oldid=813953665"