MAY 25, 2019 1:02 AM PDT

New language learning app uses smartphone camera and computer vision to teach vocabulary

WRITTEN BY: Nouran Amin

As part of a project from Microsoft’s in-house incubator Microsoft Garage, recent interns have created a new language learning app that utilizes the smartphone camera to enhance English literacy in adults by helping them learn the words for the things around them.

The app, a project from Microsoft’s in-house incubator Microsoft Garage, will initially be made available for testing and feedback for select organizations. Those who work with low literacy communities a

The app, Read My World, allows the user to take a picture to learn from a library of more than 1,500 words. A photo can be of real-world objects or a text found in a document and uses a combination of Microsoft Cognitive Services and Computer Vision APIs for identification purposes.

Although the app is not meat supplement formal classroom training, it offers a unique to learn some words for those who didn’t have the opportunity to participate in a language learning class.

“Originally, we were planning more of a lesson plan-style approach, but through our research and discovery, we realized a Swiss army knife might be more useful,” said Nicole Joyal, a software developer intern who worked on the project. “We wound up building a tool that can help you throughout your day-to-day rather than something that teaches,” she said.

Read My World will show the user the word’s spelling and phonetic pronunciation of the identified vocabulary. Photos can be saved to a personal dictionary in the app for later reference. Finally, the app has vocabulary games to encourage the practice of learned words.

Source: TechCrunch

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
APR 12, 2020
Space & Astronomy
APR 12, 2020
Three New Crew Members Arrive at the International Space Station
The International Space Station received three new crew members this past week following extensive pre-quarantine measur ...
APR 06, 2020
Technology
APR 06, 2020
Smart Toilet: The Next Disease-Detecting Technology
The next disease-detecting technology could come to a bathroom near you—the Smart Toilet! A toilet designed to det ...
APR 23, 2020
Chemistry & Physics
APR 23, 2020
Wearable e-skin powered by sweat
What if your skin could monitor your heart rate, body temperature, and blood sugar levels? Well, not your skin, exactly ...
MAY 03, 2020
Space & Astronomy
MAY 03, 2020
How the Hubble Space Telescope Transformed Astronomy
The Hubble Space Telescope has officially spent three decades in outer space, making it one of the most renowned space o ...
MAY 10, 2020
Technology
MAY 10, 2020
Robots With Toes?
Biologists have been observing the many toes of geckos and how they adapt mobility to diverse surfaces. "The resear ...
MAY 25, 2020
Space & Astronomy
MAY 25, 2020
Virgin Orbit Wants to Launch Space Rockets From 747 Jets
Entities from all around the world, be it companies or government space agencies, are continuously innovating in an atte ...
Loading Comments...