QingSimon / open_vins

An open source platform for visual-inertial navigation research.

Open VINS

Welcome to the Open VINS project! The Open VINS project houses some core computer vision code along with a state-of-the art filter-based visual-inertial estimator. The core filter is an Extended Kalman filter which fuses inertial information with sparse visual feature tracks. These visual feature tracks are fused leveraging the Multi-State Constraint Kalman Filter (MSCKF) sliding window formulation which allows for 3D features to update the state estimate without directly estimating the feature states in the filter. Inspired by graph-based optimization systems, the included filter has modularity allowing for convenient covariance management with a proper type-based state system. Please take a look at the feature list below for full details on what the system supports.

• Github project page - https://github.com/rpng/open_vins
• Documentation - https://docs.openvins.com/
• Getting started guide - https://docs.openvins.com/getting-started.html
• Publication reference - TBD

News / Events

• October 1, 2019 - We will be presenting at the Visual-Inertial Navigation: Challenges and Applications workshop at IROS 2019. The submitted workshop paper can be found at this link.
• August 21, 2019 - Open sourced ov_maplab for interfacing OpenVINS with the maplab library.
• August 15, 2019 - Initial release of OpenVINS repository and documentation website!

Project Features

• Sliding window visual-inertial MSCKF
• Modular covariance type system
• Comprehensive documentation and derivations
• Extendable visual-inertial simulator
  • On manifold SE(3) b-spline
  • Arbitrary number of cameras
  • Arbitrary sensor rate
  • Automatic feature generation
• Five different feature representations
  1. Global XYZ
  2. Global inverse depth
  3. Anchored XYZ
  4. Anchored inverse depth
  5. Anchored MSCKF inverse depth
• Calibration of sensor intrinsics and extrinsics
  • Camera to IMU transform
  • Camera to IMU time offset
  • Camera intrinsics
• Environmental SLAM feature
  • OpenCV ARUCO tag SLAM features
  • Sparse feature SLAM features
• Visual tracking support
  • Monocular camera
  • Stereo camera
  • Binocular camera
  • KLT or descriptor based
• Static IMU initialization (sfm will be open sourced later)
• Out of the box evaluation on EurocMav and TUM-VI datasets
• Extensive evaluation suite (ATE, RPE, NEES, RMSE, etc..)

Credit / Licensing

This code was written by the Robot Perception and Navigation Group (RPNG) at the University of Delaware. If you have any issues with the code please open an issue on our github page with relevant implementation details and references. For researchers that have leveraged or compared to this work, please cite the following:

@Conference{Geneva2019IROSws,
  Title      = {OpenVINS: A Research Platform for Visual-Inertial Estimation},
  Author     = {Patrick Geneva and Kevin Eckenhoff and Woosik Lee and Yulin Yang and Guoquan Huang},
  Booktitle  = {{IROS} 2019 Workshop on Visual-Inertial Navigation: Challenges and Applications},
  Year       = {2019},
  Address    = {Macau, China},
  Month      = nov,
  Url        = {\url{https://github.com/rpng/open_vins}}
}

The codebase is licensed under the GNU General Public License v3 (GPL-3).