MAY 25, 2019 1:02 AM PDT

New language learning app uses smartphone camera and computer vision to teach vocabulary

WRITTEN BY: Nouran Amin

As part of a project from Microsoft’s in-house incubator Microsoft Garage, recent interns have created a new language learning app that utilizes the smartphone camera to enhance English literacy in adults by helping them learn the words for the things around them.

The app, a project from Microsoft’s in-house incubator Microsoft Garage, will initially be made available for testing and feedback for select organizations. Those who work with low literacy communities a

The app, Read My World, allows the user to take a picture to learn from a library of more than 1,500 words. A photo can be of real-world objects or a text found in a document and uses a combination of Microsoft Cognitive Services and Computer Vision APIs for identification purposes.

Although the app is not meat supplement formal classroom training, it offers a unique to learn some words for those who didn’t have the opportunity to participate in a language learning class.

“Originally, we were planning more of a lesson plan-style approach, but through our research and discovery, we realized a Swiss army knife might be more useful,” said Nicole Joyal, a software developer intern who worked on the project. “We wound up building a tool that can help you throughout your day-to-day rather than something that teaches,” she said.

Read My World will show the user the word’s spelling and phonetic pronunciation of the identified vocabulary. Photos can be saved to a personal dictionary in the app for later reference. Finally, the app has vocabulary games to encourage the practice of learned words.

Source: TechCrunch

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
JUL 15, 2020
Technology
Creating Robotic Senses
JUL 15, 2020
Creating Robotic Senses
Placing your dinner plates in the sink or grabbing a bottle of water maybe the simplest thing you do this week but for r ...
SEP 14, 2020
Technology
Novel Method To Manufacture Blood Cells
SEP 14, 2020
Novel Method To Manufacture Blood Cells
New Way for Manufacturing Red Blood Cells Scientists at Singapore-MIT Alliance for Research and Technology (SMART) have ...
NOV 05, 2020
Clinical & Molecular DX
Painless Microneedle Patch Diagnoses Malaria in Minutes
NOV 05, 2020
Painless Microneedle Patch Diagnoses Malaria in Minutes
It looks like a Band-Aid — a small, adhesive patch that is applied directly to the skin. This simple, low-cost dia ...
NOV 18, 2020
Technology
Using Machine Learning to Build Chemical Libraries
NOV 18, 2020
Using Machine Learning to Build Chemical Libraries
Using machine learning in drug discovery is no longer a novel procedure and has been well documented in recent literatur ...
NOV 24, 2020
Neuroscience
Computer Mouse Movements Predict Risk-Taking Behavior
NOV 24, 2020
Computer Mouse Movements Predict Risk-Taking Behavior
Researchers from Ohio State University have found a way to measure people’s appetite for risk-taking behavior from ...
NOV 26, 2020
Technology
Bio-printing Lab Grown Kidneys
NOV 26, 2020
Bio-printing Lab Grown Kidneys
Scientists are now working to bioprinting kidneys in the lab for treatments of kidney failure. The research was led by a ...
Loading Comments...