Skip to main navigation Skip to search Skip to main content

Neuromorphic Driver Monitoring Systems: A Computationally Efficient Proof-of-Concept for Driver Distraction Detection

  • University of Galway
  • Xperi Corporation

Research output: Contribution to a Journal (Peer & Non Peer) › Article › peer-review

17 Citations (Scopus)
4 Downloads (Pure)

Abstract

Driver Monitoring Systems (DMS) represent a promising approach for enhancing driver safety within vehicular technologies. This research explores the integration of neuromorphic event camera technology into DMS, offering faster and more localized detection of changes due to motion or lighting in an imaged scene. When applied to the observation of a human subject event camera provides a new level of sensing capabilities over conventional imaging systems. The study focuses on the application of DMS by incorporating the event cameras, augmented by submanifold sparse neural network models (SSNN) to reduce computational complexity. To validate the effectiveness of proposed machine learning pipeline built on event data we have opted the Driver Distraction as a critical use case. The SSNN model is trained on synthetic event data generated from the publicly available Drive&Act and Driver Monitoring Dataset (DMD) using a video-To-event conversion algorithm (V2E). The proposed approach yields comparable performance with state-of-The-Art approaches, achieving an accuracy of 86.25% on the Drive&Act dataset and 80% on comprehensive DMD dataset while significantly reducing computational complexity. In addition, to demonstrate the generalization of our results the network is also evaluated using locally acquired event dataset gathered from a commercially available neuromorphic event sensor.

Original languageEnglish
Pages (from-to)836-848
Number of pages13
JournalIEEE Open Journal of Vehicular Technology
Volume4
DOIs
Publication statusPublished - 2023

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • computational complexity
  • Distraction recognition
  • driver monitoring system
  • driver monitoring system driver monitoring system (DMS)
  • event based vision
  • neuromorphic sensing
  • submanifold convolutions

Fingerprint

Dive into the research topics of 'Neuromorphic Driver Monitoring Systems: A Computationally Efficient Proof-of-Concept for Driver Distraction Detection'. Together they form a unique fingerprint.

Cite this