FEB 13, 2019 3:19 PM PST

Teaching Self-Driving Cars To Predict Human Movement

WRITTEN BY: Nouran Amin

Researchers at the University of Michigan have collected data by vehicles through cameras, LiDAR and GPS—which allowed them to capture video snippets of humans in motion and then recreate it in 3D computer simulations. Specifically, they are teaching self-driving cars to recognize and predict pedestrian movements accurately than other current technologies.

"Prior work in this area has typically only looked at still images. It wasn't really concerned with how people move in three dimensions," said Ram Vasudevan, U-M assistant professor of mechanical engineering. "But if these vehicles are going to operate and interact in the real world, we need to make sure our predictions of where a pedestrian is going doesn't coincide with where the vehicle is going next."

Gearing vehicles with necessary predictive power requires technology that digs into the very minute details of human interactions and movement including the pace of a human's gait (periodicity), the mirror symmetry of limbs, and foot placement.

"Now, we're training the system to recognize motion and making predictions of not just one single thing -- whether it's a stop sign or not -- but where that pedestrian's body will be at the next step and the next and the next," said Matthew Johnson-Roberson, associate professor in U-M's Department of Naval Architecture and Marine Engineering.

Current machine learning uses autonomous technology dealing with two dimensions—still photos. But, the new “biomechanically inspired recurrent neural network" utilizing video clips that catalogs human movements to predict poses and future locations for one of several pedestrians from up to 50 yards on the scale of a city intersection.

"If a pedestrian is playing with their phone, you know they're distracted," Vasudevan said. "Their pose and where they're looking is telling you a lot about their level of attentiveness. It's also telling you a lot about what they're capable of doing next."

Source: Science Daily

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
JUN 30, 2020
Neuroscience
Stroking Cuddly Seal Robot Boosts Happiness, Reduces Pain
JUN 30, 2020
Stroking Cuddly Seal Robot Boosts Happiness, Reduces Pain
Stroking a cuddly seal robot boosts happiness and reduces pain in young adults, according to a new study by researchers ...
JUL 20, 2020
Technology
Robotic Human-Like Hands
JUL 20, 2020
Robotic Human-Like Hands
Robots are seen as metallic tough man-made objects that do not align with a ‘soft-touch’. However, there is ...
JUL 31, 2020
Chemistry & Physics
Advancing Nuclear Fusion by Taming the "Chirping" Plasma
JUL 31, 2020
Advancing Nuclear Fusion by Taming the "Chirping" Plasma
2020 turns out to a year of breakthrough for nuclear fusion. The world's largest fusion project ITER (International ...
SEP 15, 2020
Neuroscience
Smartphone Data Can Predict Depression and Anxiety
SEP 15, 2020
Smartphone Data Can Predict Depression and Anxiety
Researchers from Dartmouth College have found that passively-collected data from smartphones is able to predict a person ...
OCT 19, 2020
Clinical & Molecular DX
Making Capillary Electrophoresis Accessible for Any Lab
OCT 19, 2020
Making Capillary Electrophoresis Accessible for Any Lab
Analyzing nucleic acids through gel electrophoresis has been a staple of genetic research for decades. But using traditi ...
OCT 10, 2020
Drug Discovery & Development
Fishnet of Nanoparticles Traps Drug Molecules
OCT 10, 2020
Fishnet of Nanoparticles Traps Drug Molecules
‘Fishnet’ Nanoparticles Traps Drug Molecules A team at Northwestern University have casted a net of nanopart ...
Loading Comments...