Intelligent analysis of drivers' attention in autonomous vehicles

© Fraunhofer IDMT/Leona Hofmann

How attentive are drivers during monotonous car journeys? Researchers in the “MentalState” project are examining the change in level of attention during a monotonous activity, known as vigilance, by analysing brain activity and other biosignals. The objective is to make these results usable for the development of autonomous vehicles and advanced driver assistance systems (ADAS). In the study, vigilance is monitored by means of two scenarios in a driving simulator; one manual driving scenario and one autonomous driving scenario. Experiments are conducted to see whether the change in sustained attention, i.e., vigilance, differs between autonomous and manual driving and how this is related to drivers’ ability to react to dangerous situations while driving.

A central aspect of the study is the monitoring of brain activity through recording of electroencephalograms (EEG). To record the EEG, the researchers are working with an adapted design of the self-adhesive trEEGrid, customized for this use-case. The trEEGrid was developed as a prototype within the “SleepWell” project. The electrodes can be arranged flexibly, depending on the purpose. In addition, it is designed for self-use and delivers good signal quality with high wearing comfort. For the following analysis of the data, intelligent machine learning algorithms of the Oldenburg Branch are used.

In addition to EEG, the researchers also analyze other biosignals. An eye tracker records activity and movement of the eyes to detect signs of fatigue, such as pupil size or blink rate. In addition, heart rate variability is monitored as another parameter. From heart rate variability it is possible to deduce how heart rate adjusts to physical or mental demands. By means of questionnaires, participants indicate their subjective assessment of mental demands.  Behavioral data, such as response speed and error rates, deliver further information about driving performance and level of attention.

Intelligent attention measurement during autonomous driving using mobile EEG systems

Insights into research and development around mobile EEG measurement systems at Fraunhofer IDMT in Oldenburg

Privacy warning

With the click on the play button an external video from www.youtube.com is loaded and started. Your data is possible transferred and stored to third party. Do not start the video if you disagree. Find more about the youtube privacy statement under the following link: https://policies.google.com/privacy

Further Information

 

Press Release / 25.9.2023

The whole body on the radar

Fraunhofer IDMT develops methods monitoring via radar.

 

New solutions for the mobility of tomorrow

With our “Hearing for the car”, our "YourSound", checking drivers' attention or monitoring in production, we offer a wide-ranging portfolio for the automotive sector.

 

IAA Mobility 2023

The IAA Mobility will take place from September 04 to 08, 2023. At booth D11 in hall B1, Fraunhofer IDMT from Oldenburg presents technologies for the hearing car, mobile EEG systems and personalized sound experiences.

 

Data Protection for Biosignals

Between data worthy of protection and pertinent research: How might practicable data protection concepts and anonymisation techniques for biosignals look?

 

Mobile multisensor system for sleep monitoring at home

We are working on a multi-sensor system close to the ear that records sleep behavior comfortably at home.

 

Contactless health monitoring

The group »Mobile Neurotechnologies« is working on monitoring vital parameters: contactless, hygienic, and easy to set up.

 

Mobile EEG-Systems for better epilepsy treatment

Exactly recorded biosignals at the time of the seizure in everyday processes help in the classification of epilepsy disorders.

 

»The Hearing Car«

Especially in the development of autonomous vehicles, acoustic sensors are a key component. In combination with optical sensors, the car’s sense of hearing ensures greater safety and reliability in road traffic – for example through intelligent siren recognition and localization.

 

Connected Health

The work area Connected Health dedicates its research and development activities to sensor-based health systems that can be deployed flexibly and without clinical infrastructure.

The Oldenburg Branch for Hearing, Speech and Audio Technology HSA is funded in the program »Vorab« by the Lower Saxony Ministry of Science and Culture (MWK) and the Volkswagen Foundation for its further development.

Mobile Neurotechnologies

The group »Mobile Neurotechnologies« is working on discreet EEG systems for the analysis of brain activity - e.g. for safe workplace design or for use in health applications.