Daniel-xsy / BEV-Attack

[TMLR'24] On the Adversarial Robustness of Camera-based 3D Object Detection

BEV Attack

This is the codebase of our paper On the Adversarial Robustness of Camera-based 3D Object Detection.

About

In recent years, camera-based 3D object detection has gained widespread attention for its ability to achieve high performance with low computational cost. However, the robustness of these methods to adversarial attacks has not been thoroughly examined. In this study, we conduct the first comprehensive investigation of the robustness of leading camera-based 3D object detection methods under various adversarial conditions. Our experiments reveal five interesting findings: (a) the use of accurate depth estimation effectively improves robustness; (b) depth-estimation-free approaches do not show superior robustness; (c) bird's-eye-view-based representations exhibit greater robustness against localization attacks; (d) incorporating multi-frame benign inputs can effectively mitigate adversarial attacks; and (e) addressing long-tail problems can enhance robustness. We hope our work can provide guidance for the design of future camera-based object detection modules with improved adversarial robustness.

Updates

• [2022.09.23] - Project starts
• [2022.09.29] - Build baseline attack

Outline

• BEV Attack
  • About
  • Updates
  • Outline
  • Installation
  • Data Preparation
  • Getting Started
  • TODO List

Installation

Please refer to installation.md for more details.

Data Preparation

Please refer to prepare_dataset.md for more details.

Getting Started

Coming soon. Codebase will be organized when the author has time 💦.

Brief information

For BEVFormer, PETR, and DETR3D, please refer to the config folder, and the script, just un-comment the attack at the end of each config you need to run.

For BEVDet and BEVDepth, please refer to the config folder and the script.

Offical BEVDet codebase has been changed and there might be some mismatch between this codebase and the current official one.

TODO List

• Intial release.
• Build attack baseline.
• Add patch attack, reorganize code structure for more flexible usage.

Citation

If you find this work helpful, please kindly consider citing the following:

@article{xie2023adversarial,
  title={On the Adversarial Robustness of Camera-based 3D Object Detection},
  author={Xie, Shaoyuan and Li, Zichao and Wang, Zeyu and Xie, Cihang},
  journal={Transactions on Machine Learning Research (TMLR)},
  year={2024}
}