Do you want to know more about the Biomed participants? Find out them here

Seeing with your Ears

#HealthcareIT, #Telemedicine

An artificial vision device for people who are #blind or visually impaired, OrCam MyEye 2.0 #improvesvisionbyusingears.

“Our whole mission is to communicate visual information through audio,” Rafi Fischer, director of media communications at #Israelicompany OrCam, explained. “What OrCam MyEye can do is instantly and discreetly read any printed text from any surface—a newspaper article, a restaurant menu, or a computer screen text.”

The user points at the text he wishes to read, OrCam will instantly read the selected text.

The #wearabledevice is the size of a finger. It can be fixed to almost any pair of glasses. “All you have to do is put it on and wear your glasses, and you are ready to use the device,” Fischer said. It consists of a small head unit with a miniature camera in front, and a speaker by the ear, so that only the user can hear the audio. The camera is equipped with LED lights.

Fischer showed three ways to trigger OrCam MyEye 2.0. First, he made a pointing gesture that showed the machine the text to be read. Converting the text into audio, the device started reading until Fischer interrupted it with another gesture. In the second scenario, the operator just tapped the side of the appliance to activate it. Whenever no text is detected, the device emits a little chime, and it also indicates if the text is upside down. In the last scenario, OrCam MyEye automatically detected the edges of a document held in front of it.

#RecognizingFriends

The product demonstration included a #facialrecognition test. OrCam MyEye automatically detected that “a man” had been introduced in the room. It took 15 to 20 seconds for Fischer to enter this new face into the device: “now when he (the colleague) approaches me I hear his name”, Fischer explained. OrCam MyEye learns and remembers people, and recognizes the stored faces.

Because OrCam MyEye communicates with audio, it adapts to a wide range of needs. “Our users typically have different sorts of eye conditions, such as macular degeneration, retinitis pigmentosa, cataracts, also people with severe dyslexia,” Fischer noted. Many of them shared stories with OrCam about how the device had empowered them and increased their independence.

“We are trying to add as many functionalities as possible to the device,” Fischer said. “One of the future things to look for is speech recognition.” This would allow users to ask OrCam questions directly without resorting to any motion.

Shopping is also made easier for OrCam MyEye users. It identifies bar codes and logos that are manually pre-registered. OrCam MyEye also reads local currencies and detects colors. “We built our algorithms to develop this text-to-speech reading to work offline,” Fischer said. “It all happens locally: no privacy issues, no reception issues.” In addition, the text that is read is not recorded.

OrCam MyEye is currently available in twelve languages in over twenty countries, and more are in the pipeline. Each version reads at least two different languages. A small drawback is the limited autonomy of its battery: “Using it constantly, it only lasts about an hour.” The device comes with a USB charger.

Seven to 100-Year-Old Users

“We have many thousands of users at this time,” the OrCam representative said. “The youngest is seven years old and the oldest 100 years old.” All users underwent a two-hour training session to learn to use the product.

OrCam will be giving a talk at the Medical Devices track of MIXiii BIOMED 2018, May 16 2018, Hall C

***

How Israel’s Desert Bloomed Into A Hi-Tech Hub

 09 May 2018 | ANALYSIS by Catherine Longworth

FIND OUT WHO IS PARTICIPATING AT BIOMED 2018 IN THE CONFERENCE PROGRAM !

READ MORE ABOUT THEIR INNOVATIONS AND ACHIEVEMENTS IN THE BLOG !