MAR 22, 2018 12:45 PM PDT

AI Reads Handwriting Better Than Us

WRITTEN BY: Julia Travers

Businesses and organizations that rely on written input in order to function may now be in luck, thanks to an Oakland, California-based tech startup called Captricity. In March 2018, it launched an AI-powered software system that can read handwriting faster and more accurately than people -- it’s called Captricity READ, seen as an advanced onenote alternative.

Much like a human fingerprint, each person’s handwriting has idiosyncratic angles and curves that make it unique. Deciphering handwritten forms and translating them into savable and searchable digital media can be a time-consuming record-keeping process for many companies.

AI and handwriting image collage, credit: public domain

"Surpassing humans with machine reading is a watershed moment for digital automation," Kuang Chen, founder and CEO of Captricity, said. Handwriting recognition (HWR) is an essential task in realms where the use of pen and paper persist. Captricity lists the insurance industry, in which it serves eight out of the top ten U.S. companies, as an example. Government, non-profit, healthcare and financial services groups also rely on its data-entry tech.

According to Captricity, these groups can now quickly and affordably process handwritten forms with an 80 percent reduction in manual effort. Captricity READ's 91 percent accuracy rate beats out human abilities and reportedly exceeds all established rates set by text transcription software.

How Did Captricity's AI Learn to Read so Well?

How did Captricity READ outperform our species in reading our own writing? It relies on a machine learning structure called a deep neural network to achieve this level of precision. It has access to a total of 35 lifetimes of reading experience in the form of tens of millions of data points gleaned from one billion text transcription tasks. Captricity explains that the company is in possession of the biggest handwriting training dataset in the world.

Captricity used 3,000 real business writing form fields to measure its new achievements in HWR accuracy. It challenges other groups to meet or break its records and has made the dataset relevant to its claims publicly available.

"Enterprises have struggled with automation technology due to extremely low accuracy in reading handwriting and poor-quality images. Unlike any previous technology, Captricity READ is the missing link that drives intelligent automation enterprise-wide,” Chen said.

Other Developments in Hi-Tech Reading and Writing

Innovative options also exist for capturing handwritten text on a smaller scale, including smart pens that record a writers’ hand movements, such as the Livescribe. Smartpads like the Wacom tablet can record written text and save it in a searchable form. Similarly, the apps Evernote and Onenote can transform an image of a piece of writing into searchable text.

In another related milestone, Microsoft and Chinese retail-giant Alibaba announced in January 2018 that each of their AI was able to beat out humans in a reading comprehension test, though this one dealt with typed text. The test was the Stanford Question Answering Dataset (SQuAD), which is described on the SQuAD site as “a machine reading comprehension dataset comprising of questions pertaining to a set of Wikipedia articles.”

However, some researchers felt the test, in which each answer was a segment of text taken directly from the relevant passage, didn’t truly measure the depths and subtleties of human comprehension. Overall, “people are still much better than machines” at fully and accurately understanding language, a Microsoft researcher who was involved in the competition told Wired.

About the Author
  • Julia Travers is a writer, artist and teacher. She frequently covers science, tech, conservation and the arts. She enjoys solutions journalism. Find more of her work at jtravers.journoportfolio.com.
You May Also Like
MAR 26, 2021
Cell & Molecular Biology
New 'Bio-ink' Gets 3D-Printed Organs Closer to Reality
MAR 26, 2021
New 'Bio-ink' Gets 3D-Printed Organs Closer to Reality
For the many people waiting for transplants, 3D-printed organs can't come soon enough. Researchers have been making stri ...
MAY 06, 2021
Drug Discovery & Development
Tweaked Version of Ketamine Could Solve the Opioid Crisis
MAY 06, 2021
Tweaked Version of Ketamine Could Solve the Opioid Crisis
Medications that manage post-operative pain are some of the main entry points to opioid addiction and overdose in the US ...
JUN 04, 2021
Plants & Animals
What Elephant Trunks Teach Science about Suction
JUN 04, 2021
What Elephant Trunks Teach Science about Suction
How an elephant picks up a tortilla chip could inspire next-generation suction technology.
JUN 12, 2021
Technology
HubSpot and Modern Health Partner to Support Mental Wellbeing in the Workplace
JUN 12, 2021
HubSpot and Modern Health Partner to Support Mental Wellbeing in the Workplace
The hardships of 2020 exposed many flaws in our social and economic systems, including the ways we address mental health ...
JUN 22, 2021
Clinical & Molecular DX
See the Nasties on Your Skin with Your Smartphone
JUN 22, 2021
See the Nasties on Your Skin with Your Smartphone
The skin is home to around 1.5 trillion bacteria, which together with fungi and viruses, make up the skin microbiota. Th ...
JUL 09, 2021
Cell & Molecular Biology
Wearable Tech for...Plants?
JUL 09, 2021
Wearable Tech for...Plants?
Researchers have developed a "wearable" patch to detect the gaseous substances plants emit when diseased or stressed,
Loading Comments...