Table of Contents
Fetching ...

A Review of Driver Gaze Estimation and Application in Gaze Behavior Understanding

Pavan Kumar Sharma, Pranamesh Chakraborty

TL;DR

A comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios, including the limitations in the existing literature, challenges, and the future scope.

Abstract

Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. The main objective of this study is to perform a comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios. We first discuss the fundamentals related to driver gaze, involving head-mounted and remote setup based gaze estimation and the terminologies used for each of these data collection methods. Next, we list out the existing benchmark driver gaze datasets, highlighting the collection methodology and the equipment used for such data collection. This is followed by a discussion of the algorithms used for driver gaze estimation, which primarily involves traditional machine learning and deep learning based techniques. The estimated driver gaze is then used for understanding gaze behavior while maneuvering through intersections, on-ramps, off-ramps, lane changing, and determining the effect of roadside advertising structures. Finally, we have discussed the limitations in the existing literature, challenges, and the future scope in driver gaze estimation and gaze-based applications.

A Review of Driver Gaze Estimation and Application in Gaze Behavior Understanding

TL;DR

A comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios, including the limitations in the existing literature, challenges, and the future scope.

Abstract

Driver gaze plays an important role in different gaze-based applications such as driver attentiveness detection, visual distraction detection, gaze behavior understanding, and building driver assistance system. The main objective of this study is to perform a comprehensive summary of driver gaze fundamentals, methods to estimate driver gaze, and it's applications in real world driving scenarios. We first discuss the fundamentals related to driver gaze, involving head-mounted and remote setup based gaze estimation and the terminologies used for each of these data collection methods. Next, we list out the existing benchmark driver gaze datasets, highlighting the collection methodology and the equipment used for such data collection. This is followed by a discussion of the algorithms used for driver gaze estimation, which primarily involves traditional machine learning and deep learning based techniques. The estimated driver gaze is then used for understanding gaze behavior while maneuvering through intersections, on-ramps, off-ramps, lane changing, and determining the effect of roadside advertising structures. Finally, we have discussed the limitations in the existing literature, challenges, and the future scope in driver gaze estimation and gaze-based applications.
Paper Structure (32 sections, 2 equations, 6 figures, 4 tables)

This paper contains 32 sections, 2 equations, 6 figures, 4 tables.

Figures (6)

  • Figure 1: Structure of the paper.
  • Figure 2: (a) Eye tracking glass (Pupil Invisible) (b) Near Eye camera (green circle) and LED light (red circle) (c) Scene camera (d) Different parts of an Eye (e) Left and Right Eye Infrared images captured by using Near Eye Cameras (f) Driver frontal view recorded by Scene Camera (blue circles represent fixations).
  • Figure 3: (a) Driver gaze estimation using wearable eye tracker: Driver wearing eye tracking glasses (b) Photograph of instrumented vehicle for remote setup of gaze estimation A:Capture gaze information, B:Infra-red lamp, C:Scene camera lemonnier2020drivers.
  • Figure 4: Gaze zone classification. (a) Coarser gaze zones (b) Finer gaze zones.
  • Figure 5: Open source benchmark driver's face datasets image samples. (a) RS-DMV (b) DriveFace (c) LISA GAZE v2 (d)DG-UNICAMP (e) DG-UNICAMP (f) DGW.
  • ...and 1 more figures