The world we experience is not the real world. It’s a mental construction, filtered through our physical senses. Which raises the question: How would our world change if we had new and different senses? Could they expand our universe?
1 | Hearing Pictures
For decades, some deaf people have worn cochlear implants, which use electrode arrays to stimulate the auditory nerve inside the ear. Researchers are working on other technologies that could restore sight or touch to those who lack it. For the blind, cameras could trigger electrodes on the retina, on the optic nerve, or in the brain. For the paralyzed or people with prosthetic limbs, pressure pads on real or robotic hands could send touch feedback to the brain or to nerves in the arm.
Autistic people might even gain a stronger social sense. Last year, MIT researchers revealed the EQ-Radio, a device that bounces signals off people to detect their heart rate and breathing patterns. A yet-to-be-invented device might infer a target’s mood from those data and convey it to an autistic user—or anyone who wants to improve their emotional intuition.
We can also substitute one sense for another. The brain is surprisingly adept at taking advantage of any pertinent information it receives, and can be trained to, for instance, “hear” images or “feel” sound. For the blind, a device called the BrainPort V100 connects a camera on a pair of glasses to a grid of electrodes on a person’s tongue. At first the effect just feels like tiny bubbles, but eventually users can learn to read stronger points of stimulation as bright pixels and weaker points as dark ones, and can form a mental picture.
Somewhat similarly, a Dutch device called the vOICe (“Oh I see!”) uses a camera to create a soundscape that the vision-impaired wearer hears through headphones. To the uninitiated it sounds like bursts of static, but with training, people can discern images. Every second or so, the sound pans from left to right, using frequency to indicate an object’s height (the taller the object, the higher the pitch) and volume to indicate its brightness.
For the deaf, David Eagleman, a neuroscientist at Stanford University, has developed a vest that turns sound into a pattern of vibrations on the torso. With practice, people can learn to use it to interpret speech and other sounds.
The Atlantic /Matthew Hutson