ahuer2435 / DMS

Driver Monitoring System

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DMS

Driver Monitoring System

Updates Histopy

  • v0.0 : Initial version [Released Date : 2021-07-01]
  • v0.1 : CAN signal update [Released Date : 2021-08-20]
  • v0.2 : HMI & odometer update [Release Date : 2021-09-13]
  • v0.2.1 : Audio synchronization test branch [Release Date : 2021-09-30]
  • v1.0.0 : Real-time traffic info & GNSS (RTK) [Release Date : 2022-10-07]
  • v1.1.0 : Front-view external video (Internal camera is a temporary suspension) [Release Date : 2022-12-27]
  • v1.2.0 : Replace the internal cameras with the RealSense Cameras [Release Date : 2023-03-31]
  • v1.3.0 : Add left & right indicator signals to CAN signal [Release Date : 2023-04-10]

Build environments

  • sudo apt install ffmpeg

Data application lists

  • External Video
    • RGB images of front view towards the vehicle heading (.png)
  • Internal Video
    • RGB images of front view towards the driver (.png)
    • IR images of front view towards the driver (.png)
    • Depth images of front view towards the driver
    • RGB images of side view towards the driver (.png)
    • IR images of side view towards the driver (.png)
    • Depth images of side view towards the driver
  • CAN data
    • A_Depth : Accel Pedal State (%)
    • B_Depth : Brake Pedal state (%)
    • B_PRES : Brake Presure (TBD)
    • B_FLAG : Brake Operation Flag
    • S_Angle : Steering Wheel Angle (o)
    • HL_High : Headlamp High-Beam Operation
    • HL_Low : Headlamp High-Beam Operation
    • DriveMode : Drive Mode
    • HevMode : Hybrid Mode
    • E_Status : Enine Status
    • E_Col_Temp : Engine Coolant Temperature (oC)
    • E_Speed : Engine RPM (rpm)
    • F_Consump : Fuel Consumption (TBD)
    • Eco_Level : TBD
    • F_Economy : Fuel Economy (km/L)
    • BA_SoC : Battery SoC
    • LAT_ACCEL : Lateral Acceleration (TBD)
    • LONG_ACCEL : Longitudinal Acceleration (TBD)
    • YAW_RATE : YAW_RATE (TBD)
    • WHL_SPD_FR : Vehicle speed on each wheels (Front Right) (kph)
    • WHL_SPD_FL : Vehicle speed on each wheels (Front Left) (kph)
    • WHL_SPD_RR : Vehicle speed on each wheels (Rear Right) (kph)
    • WHL_SPD_RL : Vehicle speed on each wheels (Rear Left) (kph)
    • V_Spped : Vehicle speed (kph)
    • G_Status : Gear Status
    • Inhibit_P : Parking Gear Status
    • Inhibit_R : Reverse Gear Status
    • Inhibit_N : Neutral Gear Status
    • Inhibit_D : Drive Gear Status
    • Out_Temp : Ambient Temperature (oC)
    • IndLeft : Indicator signal for left
    • IndRight : Indicator signal for right
  • Real-time traffic information
    • LinkID : TBD
    • LinkName : TBD
    • Description : TBD
    • Congestion : TBD
    • TrafficUpdateTime : TBD
    • LinkDirection : TBD
    • LinkRoadType : TBD
    • StartNodeName : TBD
    • EndNodeName : TBD
    • LinkLength : TBD
    • LinkPassTime : TBD
    • LinkSpeed : TBD
  • GNSS(Global Navigation Satellite System) w/RTK(Real Time Kinematic)
    • Latitude : TBD
    • Longitude : TBD
    • GPSMode : TBD
    • SatelliteNum : TBD
    • Altitude : TBD
    • Yaw : TBD
    • Pitch : TBD
    • Roll : TBD
    • TrueNorth : TBD
    • NorthDeclination : TBD

▼▼▼▼▼▼▼▼ Deactivate data ▼▼▼▼▼▼▼▼ (please refer to config file)

  • Driver affective state
    • Affective state of the driver self-reported through the HMI systems.
  • Physiological data
    • Temp : Skin temperature (oC)
    • EDA : Electrodermal Activity (µS)
    • BVP : photoplethysmograph
    • HR : Average heart rate from BVP signal (bpm)
    • ACC : 3-axis accelerometer on wrist band (1/64g)
  • Audio
    • Audio acquired from cavin of vehicle(right side of the driver's seat headrest) (.wav)

About

Driver Monitoring System


Languages

Language:Python 99.7%Language:Shell 0.3%