FEB 13, 2019 3:19 PM PST

Teaching Self-Driving Cars To Predict Human Movement

WRITTEN BY: Nouran Amin

Researchers at the University of Michigan have collected data by vehicles through cameras, LiDAR and GPS—which allowed them to capture video snippets of humans in motion and then recreate it in 3D computer simulations. Specifically, they are teaching self-driving cars to recognize and predict pedestrian movements accurately than other current technologies.

"Prior work in this area has typically only looked at still images. It wasn't really concerned with how people move in three dimensions," said Ram Vasudevan, U-M assistant professor of mechanical engineering. "But if these vehicles are going to operate and interact in the real world, we need to make sure our predictions of where a pedestrian is going doesn't coincide with where the vehicle is going next."

Gearing vehicles with necessary predictive power requires technology that digs into the very minute details of human interactions and movement including the pace of a human's gait (periodicity), the mirror symmetry of limbs, and foot placement.

"Now, we're training the system to recognize motion and making predictions of not just one single thing -- whether it's a stop sign or not -- but where that pedestrian's body will be at the next step and the next and the next," said Matthew Johnson-Roberson, associate professor in U-M's Department of Naval Architecture and Marine Engineering.

Current machine learning uses autonomous technology dealing with two dimensions—still photos. But, the new “biomechanically inspired recurrent neural network" utilizing video clips that catalogs human movements to predict poses and future locations for one of several pedestrians from up to 50 yards on the scale of a city intersection.

"If a pedestrian is playing with their phone, you know they're distracted," Vasudevan said. "Their pose and where they're looking is telling you a lot about their level of attentiveness. It's also telling you a lot about what they're capable of doing next."

Source: Science Daily

About the Author
BS/MS
Nouran is a scientist, educator, and life-long learner with a passion for making science more communicable. When not busy in the lab isolating blood macrophages, she enjoys writing on various STEM topics.
You May Also Like
OCT 23, 2022
Space & Astronomy
Black Hole "Wobble" Wobbles Researchers
OCT 23, 2022
Black Hole "Wobble" Wobbles Researchers
In a recent study published in Nature, an international team of researchers led by Cardiff University in the United King ...
NOV 04, 2022
Earth & The Environment
Grad Student Highlights: Ian McDowell (University of Nevada, Reno)
NOV 04, 2022
Grad Student Highlights: Ian McDowell (University of Nevada, Reno)
This interview series is focused on the graduate student experience across all STEM fields that allows them to get their ...
NOV 02, 2022
Space & Astronomy
ESA's Solar Orbiter Captures Extraordinary Views of the Quiet Corona
NOV 02, 2022
ESA's Solar Orbiter Captures Extraordinary Views of the Quiet Corona
On October 12, 2022, the European Space Agency’s (ESA) Solar Orbiter mission had its second close encounter with t ...
NOV 03, 2022
Space & Astronomy
JWST Takes Stunning Image of Pillars of Creation
NOV 03, 2022
JWST Takes Stunning Image of Pillars of Creation
The James Webb Space Telescope has taken not just one but two breathtaking images of the Pillars of Creation. Located in ...
NOV 10, 2022
Technology
Potholes Might Say Bye-Bye Thanks to New Machine-Learning Technique
NOV 10, 2022
Potholes Might Say Bye-Bye Thanks to New Machine-Learning Technique
In a recent study published in Engineering Structures, a team of researchers from the University of Technology Sydney ha ...
DEC 02, 2022
Chemistry & Physics
CO2 Levels Show No Sign of Slowing Down
DEC 02, 2022
CO2 Levels Show No Sign of Slowing Down
Global carbon emissions show no sign of slowing down despite a need to stay below 1.5°C of total warming, an article ...
Loading Comments...