MAY 25, 2019 01:02 AM PDT

New language learning app uses smartphone camera and computer vision to teach vocabulary

WRITTEN BY: Nouran Amin

As part of a project from Microsoft’s in-house incubator Microsoft Garage, recent interns have created a new language learning app that utilizes the smartphone camera to enhance English literacy in adults by helping them learn the words for the things around them.

The app, a project from Microsoft’s in-house incubator Microsoft Garage, will initially be made available for testing and feedback for select organizations. Those who work with low literacy communities a

The app, Read My World, allows the user to take a picture to learn from a library of more than 1,500 words. A photo can be of real-world objects or a text found in a document and uses a combination of Microsoft Cognitive Services and Computer Vision APIs for identification purposes.

Although the app is not meat supplement formal classroom training, it offers a unique to learn some words for those who didn’t have the opportunity to participate in a language learning class.

“Originally, we were planning more of a lesson plan-style approach, but through our research and discovery, we realized a Swiss army knife might be more useful,” said Nicole Joyal, a software developer intern who worked on the project. “We wound up building a tool that can help you throughout your day-to-day rather than something that teaches,” she said.

Read My World will show the user the word’s spelling and phonetic pronunciation of the identified vocabulary. Photos can be saved to a personal dictionary in the app for later reference. Finally, the app has vocabulary games to encourage the practice of learned words.

Source: TechCrunch

About the Author
  • Nouran enjoys writing on various topics including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
JUN 18, 2019
Space & Astronomy
JUN 18, 2019
TESS Distinguishes its First Earth-Sized Exoplanet Since Launch
It’s been almost exactly one year since a SpaceX Falcon 9 rocket ferried NASA’s Transiting Exoplanet Survey Satellite (TESS) into space to pick...
JUN 18, 2019
Technology
JUN 18, 2019
Gigabot X: An Environmentally Conscious 3D Printer
Fused particle fabrication (FPF) can change the manufacturing of outdoor sporting goods like Kayak paddles, snowshoes, and skateboards. Recyclable feedstoc...
JUN 18, 2019
Drug Discovery
JUN 18, 2019
Nanomachine Improves Drug Delivery for Cancer Therapeutics
Recent studies on mice has allowed researchers to find a way to deliver specific drugs to certain parts of the body that are exceptionally difficult to acc...
JUN 18, 2019
Space & Astronomy
JUN 18, 2019
Trident: A Proposed Planetary Science Mission That Would Explore Triton
Triton is Neptune’s largest moon, and images of Triton captured during the Voyager 2 flyby in 1989 captivated the attention of planetary scientists s...
JUN 18, 2019
Technology
JUN 18, 2019
Technology better than tape measure for identifying lymphedema risk
A multisite international study proved that technology is now better than tape to measure the risk of a female developing lymphedema after breast cancer su...
JUN 18, 2019
Space & Astronomy
JUN 18, 2019
Here's Why the James Webb Space Telescope is Taking So Long
NASA’s James Webb Space Telescope is one of the American space agency’s most expensive projects to date, and it promises to teach us more about...
Loading Comments...