codertcm / awesome-radar-perception

A curated list of radar datasets, detection, tracking and fusion

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Awesome Radar Perception

A curated list of radar datasets, detection, tracking and fusion.
Keep updating.
Author: Yi Zhou
Contact: zhouyi1023@tju.edu.cn
Update some public-available codes, see useful_codes.md

Radar Datasets

In my review paper (still under review), there is a table with more detials.

Conventional Radar Datasets for Autonomous Driving

Dataset Radar Type Data Type Annotation Link
nuScenes Continental ARS408 x5 Sparse PC 3D bbox, TrackID Website
DENSE 77Ghz Long-Range Radar Sparse PC 3D bbox Website
PixSet TI AWR1843 Sparse PC 3D bbox, TrackID Website
Radar Scenes 77GHz Middle-Range Radar x4 Dense PC 2D point-wise, TrackID Website
Zendar SAR SAR ADC, RD, PC Pointwise Mask of Moving Vehicle Github


Brief Review: nuScenes, DENSE and Pixset are for sensor fusion, but not particularly address the role of radar. Radar scenes provides point-wise annotations for radar point cloud, but has no other modalities. Zendar seems no longer available for downloading.

Pre-CFAR Datasets for Detection

Dataset Radar Type Data Type Annotation Link
CRUW TI AWR1843 Ultra Short Range RA Pointlevel Object Website
CARRADA TI AWR1843 Short Range RA,RD,RAD Pointwise, 2D bbox, Mask Website
RADDet TI AWR1843 RAD 3D bbox for RAD tensor Github
RaDICaL TI IWR1443 ADC 2D bbox Website
GhentVRU TI AWR1243 Short Range RAD Segmentation Mask for VRUs Paper


Brief Review: CARRADA is too simple, CRUW uses RA maps, RADDet provides annotations for RAD tensor, RADICaL provides raw ADC data and signal processing toolboxes, GhentVRU can be accssed by contacting with authors.

4D Radar Datasets for Detection

Dataset Radar Type Data Type Annotation Link
Astyx Hires2019 Astyx 6455 HiRes Middel Range PC 3D bbox Dateset
View-of-Delft ZF FRGen21 Short Range PC 3D bbox Website
RADIal Valeo Middel Range DDM ADC,RAD,PC Point-level Vehicle; Open Space Mask Github
TJ4DRadSet Oculii Eagle Long Range PC 3D bbox, TrackID Paper


Brief Review: Astyx is small, VoD focuses on VRU classification, RADIal's annotation is coarse but provides raw data, TJ4D features for its long range detection. Both VoD and TJ4D are not yet public available.

Specific Tasks

Dataset Radar Type Task Link
HawkEye SAR Static vehicle classification Website
PREVENTION Conti ARS308 + SRR208 x2 Trajectory Prediction Website
SCORP 76GHz Open space segmentation Website
Ghost 77GHz long range *2 Ghost object detection Github
DopNet 24Ghz Gesture Classification Website
Radar signatures of human activities Soli Indoor human activities Dataset
Solinteraction Data Soli Tangible interactions Github
GROUNDED Ground Penetrating Radar Localization Website
FloW Dataset TI AWR1843 Floating waste detection Website

Odometry and Localization

Dataset Radar Type Task Link
Oxford Radar Robocar Navtech Spinning Radar Odometry Website
RADIATE Navtech Spinning Radar Odometry, Detection, Tracking Website
MulRan Navtech Spinning Radar Place Recognition Website
Boreas Navtech Spinning Radar Long-term Odometry, Localization, Detection Website
EU Long-term Dataset Conti ARS 308 Long-term SLAM Website
ColoRadar TI AWR2243 Cascade + AWR1843 Odometry Website
USVInland TI AWR1843 SLAM in inland waterways, Water segmentation Website
Endeavour Radar Dataset Conti ARS 430 x5 Odometry Website

Radar Toolbox and ROS Node

TI Signal Processing SDK:

RaDICaL's Toolbox: SDK;
PyRapid: SDK;
OpenRadar : SDK;
Pymmw: SDK;
Open radar initiative: SDK;
RADIal's Emptyband-DDM Script: Code

Official SDK:

NXP Premium Radar SDK: Link;
TI mmWAVE Studio: Link
TI Toolbox: Link
Matlab Radar Toolbox: Link

ROS:

Ainstein Radar ROS Node: ROS Node;
Continental ARS 408 ROS Node: ROS Node;
TI mmWave ROS Driver: Guide;
RaDICaL's TI ROS Node: ROS Node;
UoA's TI ROS Package: ROS Node

Seminars and Workshops

Radar

  • Automotive Radar – An Overview on State-of-the-Art Technology [Video]
  • Automotive Radar – A Signal Processing Perspective on Current Technology and Future Systems [Video][Slides]
  • Radar Old but Gold- current research challenges and activities in radar micro-Doppler signatures [Video]
  • Soli: Millimeter-wave radar for touchless interaction [Video]
  • 2021 CVPR Workshop on Autonomous Driving (Tesla's Famous Talk) [Video]
  • 2021 ICRA Radar Perception for All-Weather Autonomy [Website]
  • 2021 ICASSP Recent Advances in mmWave Radar Sensing for Autonomous Vehicles [Website]
  • IEEE AESS Virtual Distinguished Lecturer Webinar Series [Website]
  • Journal of Radar Webinar Series (in Chinese) [Video]

Uncertainty Quantification

  • History of Bayesian Neural Networks [Video]
  • Uncertainty and Out-of-Distribution Robustness in Deep Learning [Video]

Recommended Books and Tutorials

Radar Textbook

  • Fundamentals of Radar Signal Processing by Mark A. Richard
  • Radar Systems Analysis and Design using Matlab by Bassem R. Mahafza

Signal Processing

Waveform

Quadrature Signal

MIMO

Conformal Prediction

Review Papers

Antenna:

Radar Signal Processing:

Deep Learning Applications for Radar:

General Object Detection:

Sensor Fusion:

Uncertainty Estimation:

Radar Characteristics

RCS

Reflection Signature

Multi-Path

Micro-Doppler

Polarimetric

Simulation

Generative

Calibration

Radar & Multi Radars

Radar-Camera

Radar-Lidar

Radar-Lidar-Camera

Ego Motion

Static Objects and Surrounding Environments

Classification

Segmentation

Mapping and Localization

Detection of Dynamic Objects

Clustering

Classification of Clusters

Sparse 2D Point Cloud

4D Point Cloud

SAR & ISAR Imaging

Pre-CFAR Data

Range Azimuth Map

Range Doppler Map

ROD2021 Challenge Paper

Range Azimuth Doppler

Raw Signal

Micro-Doppler Spectrogram

Radar Camera Fusion

Feature-level Fusion

Region Proposal Based

Weakly Supervised

Decision-level Fusion

Radar Lidar Fusion

Radar Lidar Camera Fusion

Depth Estimation

Radar Tracking

About

A curated list of radar datasets, detection, tracking and fusion