FEB 13, 2019 3:19 PM PST

Teaching Self-Driving Cars To Predict Human Movement

WRITTEN BY: Nouran Amin

Researchers at the University of Michigan have collected data by vehicles through cameras, LiDAR and GPS—which allowed them to capture video snippets of humans in motion and then recreate it in 3D computer simulations. Specifically, they are teaching self-driving cars to recognize and predict pedestrian movements accurately than other current technologies.

"Prior work in this area has typically only looked at still images. It wasn't really concerned with how people move in three dimensions," said Ram Vasudevan, U-M assistant professor of mechanical engineering. "But if these vehicles are going to operate and interact in the real world, we need to make sure our predictions of where a pedestrian is going doesn't coincide with where the vehicle is going next."

Gearing vehicles with necessary predictive power requires technology that digs into the very minute details of human interactions and movement including the pace of a human's gait (periodicity), the mirror symmetry of limbs, and foot placement.

"Now, we're training the system to recognize motion and making predictions of not just one single thing -- whether it's a stop sign or not -- but where that pedestrian's body will be at the next step and the next and the next," said Matthew Johnson-Roberson, associate professor in U-M's Department of Naval Architecture and Marine Engineering.

Current machine learning uses autonomous technology dealing with two dimensions—still photos. But, the new “biomechanically inspired recurrent neural network" utilizing video clips that catalogs human movements to predict poses and future locations for one of several pedestrians from up to 50 yards on the scale of a city intersection.

"If a pedestrian is playing with their phone, you know they're distracted," Vasudevan said. "Their pose and where they're looking is telling you a lot about their level of attentiveness. It's also telling you a lot about what they're capable of doing next."

Source: Science Daily

About the Author
  • Nouran is a scientist, educator, and life-long learner with a passion for making science more communicable. When not busy in the lab isolating blood macrophages, she enjoys writing on various STEM topics.
You May Also Like
JUL 11, 2021
Earth & The Environment
A Lake in Antarctica Suddenly Drains
JUL 11, 2021
A Lake in Antarctica Suddenly Drains
During the winter of 2019, a large and deep lake on the Amery Ice Shelf in East Antarctica was lost in about a week. Abo ...
JUL 23, 2021
Neuroscience
Does the Rise of Neurotech Spell the End of Humanity as We Know it?
JUL 23, 2021
Does the Rise of Neurotech Spell the End of Humanity as We Know it?
Researchers from Imperial College London have written an overview of currently available commercial brain-computer inter ...
AUG 04, 2021
Technology
New Implant for Regulating Glucose Levels in People with Type 1 Diabetes
AUG 04, 2021
New Implant for Regulating Glucose Levels in People with Type 1 Diabetes
Management of diabetes can include a range of interventions, from specific diets and exercise to the regular use of insu ...
AUG 31, 2021
Cell & Molecular Biology
Researchers 3D Print Japanese-Style Beef Steaks
AUG 31, 2021
Researchers 3D Print Japanese-Style Beef Steaks
Agriculture, especially the production of meat, puts tremendous pressure on the environment and is thought to be a major ...
SEP 16, 2021
Technology
Scientists Create Tiny Replicas Of The Pancreas To Study New Drugs
SEP 16, 2021
Scientists Create Tiny Replicas Of The Pancreas To Study New Drugs
Pancreatic cancer it’s often hard to diagnose in its early stages, resulting in patients having more advanced canc ...
SEP 27, 2021
Earth & The Environment
Nudging Closer to a Sustainable Future
SEP 27, 2021
Nudging Closer to a Sustainable Future
Attitudes toward sustainable solutions have rapidly changed in the last few decades as environmental issues like climate ...
Loading Comments...