MAY 25, 2019 01:02 AM PDT

New language learning app uses smartphone camera and computer vision to teach vocabulary

WRITTEN BY: Nouran Amin

As part of a project from Microsoft’s in-house incubator Microsoft Garage, recent interns have created a new language learning app that utilizes the smartphone camera to enhance English literacy in adults by helping them learn the words for the things around them.

The app, a project from Microsoft’s in-house incubator Microsoft Garage, will initially be made available for testing and feedback for select organizations. Those who work with low literacy communities a

The app, Read My World, allows the user to take a picture to learn from a library of more than 1,500 words. A photo can be of real-world objects or a text found in a document and uses a combination of Microsoft Cognitive Services and Computer Vision APIs for identification purposes.

Although the app is not meat supplement formal classroom training, it offers a unique to learn some words for those who didn’t have the opportunity to participate in a language learning class.

“Originally, we were planning more of a lesson plan-style approach, but through our research and discovery, we realized a Swiss army knife might be more useful,” said Nicole Joyal, a software developer intern who worked on the project. “We wound up building a tool that can help you throughout your day-to-day rather than something that teaches,” she said.

Read My World will show the user the word’s spelling and phonetic pronunciation of the identified vocabulary. Photos can be saved to a personal dictionary in the app for later reference. Finally, the app has vocabulary games to encourage the practice of learned words.

Source: TechCrunch

About the Author
  • Nouran enjoys writing on various topics including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
JAN 17, 2020
Technology
JAN 17, 2020
Is Technology in the Classroom Effective?
“Tablets and laptops have their educational virtues,” says Annahita Ball, an assistant professor in the University at Buffalo School of Social ...
JAN 17, 2020
Technology
JAN 17, 2020
Mesh: New Computer Memory Compacting System
Internet browsers and smartphone apps use a lot of memory which often affect the efficiency of other critical applications particularly programs written in...
JAN 17, 2020
Earth & The Environment
JAN 17, 2020
Sunflowers Inspire Solar Harvesting Technology
One of the most remarkable capabilities of living things is phototropism—in which living organisms track and move with light sources. The most famili...
JAN 17, 2020
Cancer
JAN 17, 2020
Using machine learning to discover new cancer treatments
Flashback fifty years ago and many of the modern world’s inventions and discoveries would have been undreamed of – including using machines to ...
JAN 17, 2020
Technology
JAN 17, 2020
Engineering Silk into Medical Devices
Scientists at Tufts University created an effective fabrication method for molding silk into medical devices. Silk is a biopolymer long known for its super...
JAN 17, 2020
Space & Astronomy
JAN 17, 2020
Boeing Launches Botched Starliner Demo Mission for NASA
Boeing finally moved forward with the initial un-crewed test launch of its Starliner Commercial Crew spacecraft for NASA at the end of this past week follo...
Loading Comments...