MAY 25, 2019 1:02 AM PDT

New language learning app uses smartphone camera and computer vision to teach vocabulary

WRITTEN BY: Nouran Amin

As part of a project from Microsoft’s in-house incubator Microsoft Garage, recent interns have created a new language learning app that utilizes the smartphone camera to enhance English literacy in adults by helping them learn the words for the things around them.

The app, a project from Microsoft’s in-house incubator Microsoft Garage, will initially be made available for testing and feedback for select organizations. Those who work with low literacy communities a

The app, Read My World, allows the user to take a picture to learn from a library of more than 1,500 words. A photo can be of real-world objects or a text found in a document and uses a combination of Microsoft Cognitive Services and Computer Vision APIs for identification purposes.

Although the app is not meat supplement formal classroom training, it offers a unique to learn some words for those who didn’t have the opportunity to participate in a language learning class.

“Originally, we were planning more of a lesson plan-style approach, but through our research and discovery, we realized a Swiss army knife might be more useful,” said Nicole Joyal, a software developer intern who worked on the project. “We wound up building a tool that can help you throughout your day-to-day rather than something that teaches,” she said.

Read My World will show the user the word’s spelling and phonetic pronunciation of the identified vocabulary. Photos can be saved to a personal dictionary in the app for later reference. Finally, the app has vocabulary games to encourage the practice of learned words.

Source: TechCrunch

About the Author
BS/MS
Nouran is a scientist, educator, and life-long learner with a passion for making science more communicable. When not busy in the lab isolating blood macrophages, she enjoys writing on various STEM topics.
You May Also Like
OCT 11, 2022
Genetics & Genomics
Revealing the Genome Carried by the Common Ancestor to all Mammals
OCT 11, 2022
Revealing the Genome Carried by the Common Ancestor to all Mammals
Every mammal that is found on our planet is descended from one common ancestor, thought to have lived around 180 million ...
OCT 17, 2022
Cell & Molecular Biology
Some Highly Repetitive Protein Sequences are Shared by Many Species
OCT 17, 2022
Some Highly Repetitive Protein Sequences are Shared by Many Species
Gene sequences are made up of nucleotide bases, which are 'read' by the cell's machinery in triplets; three ...
OCT 07, 2022
Space & Astronomy
Early Stellar Evolution Imprints in Stellar Oscillations
OCT 07, 2022
Early Stellar Evolution Imprints in Stellar Oscillations
A new study published in Nature Communications is shedding new light on the theory of stellar evolution. Astronomers at ...
OCT 13, 2022
Technology
Robotic Pill Effective for Oral Delivery of Medications Like Insulin
OCT 13, 2022
Robotic Pill Effective for Oral Delivery of Medications Like Insulin
Treating and managing diabetes can be a lot of work, and it’s a condition that affects about 10% of Americans to d ...
NOV 18, 2022
Earth & The Environment
Grad Student Highlights: Marc Berghouse (University of Nevada, Reno)
NOV 18, 2022
Grad Student Highlights: Marc Berghouse (University of Nevada, Reno)
This interview series is focused on the graduate student experience across all STEM fields that allows them to get their ...
NOV 14, 2022
Immunology
A Probiotic 'Backpack' Could Treat Inflammatory Bowel Disease
NOV 14, 2022
A Probiotic 'Backpack' Could Treat Inflammatory Bowel Disease
There are many types of microorganisms in the human gastrointestinal tract, and many of them perform important functions ...
Loading Comments...