nuScenes devkit

Welcome to the devkit of the nuScenes dataset.

Overview

Changelog
Dataset download
Devkit setup
Getting started
Frequently asked questions
Setting up a new virtual environment

Changelog

Nov. 21, 2018: RADAR filtering and multi sweep aggregation.
Oct. 4, 2018: Code to parse RADAR data released.
Sep. 12, 2018: Devkit for teaser dataset released.

Dataset download

To download nuScenes you need to go to the Download page, create an account and confirm the nuScenes Terms of Use. After logging in you will see multiple archives for images, pointclouds and meta data. For the devkit to work you will need to download all archives. Please unpack the archives to the /data/nuscenes folder *without* overwriting folders that occur in multiple archives. Eventually you should have the following folder structure:

/data/nuscenes
    maps	-	Large image files (~500 Gigapixel) that depict the drivable surface and sidewalks in the scene.
    samples	-	Sensor data for keyframes.
    sweeps	-	Sensor data for intermediate frames.
    v0.1	-	JSON tables that include all the meta data and annotations.

If you want to use another folder, specify the dataroot parameter of the NuScenes class below.

Devkit setup

Download the devkit to your home directory using:

cd && git clone https://github.com/nutonomy/nuscenes-devkit.git

The devkit is tested for Python 3.7. To install Python 3.7 and set up a new virtual environment, you can look at these instructions. To install the required packages, run the following command in your favourite virtual environment:

pip install -r requirements.txt

Also add the python-sdk directory to your PYTHONPATH environmental variable, e.g. by adding the following to your ~/.virtualenvs/nuscenes/bin/postactivate (virtual environment) or ~/.bashrc (global):

export PYTHONPATH="${PYTHONPATH}:$HOME/nuscenes-devkit/python-sdk"

Getting started

To get started with the nuScenes devkit, please run the tutorial as an IPython notebook:

jupyter notebook $HOME/nuscenes-devkit/python-sdk/tutorial.ipynb

In case you want to avoid downloading and setting up the data, you can also take a look at the same notebook on Github. To learn more about the dataset, go to nuScenes.org or take a look at the database schema and annotator instructions.

Frequently asked questions

How come some objects visible in the camera images are not annotated? In the annotator instructions we specify that an object should only be annotated if it is covered by at least one LIDAR point. This is done to have precise location annotations, speedup the annotation process and remove faraway objects.
I have found an incorrect annotation. Can you correct it? Please make sure that the annotation is indeed incorrect according to the annotator instructions. Then send an email to nuScenes@nutonomy.com.
How can I use the RADAR data? We recently added features to parse and visualize RADAR point-clouds. More visualization tools will follow.
Why are there less sample pointclouds than samples? See this issue. Scenes 169 and 170 overlap and going forward we will remove scene 169.

Setting up a new virtual environment

It is recommended to install the devkit in a new virtual environment. Here are the steps you can follow to create one:

Python 3.7 installation

If you don't have Python 3.7 on your system, you can use the following steps to install it.

Ubuntu:

sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt-get update
sudo apt-get install python3.7

Mac OS: Download from https://www.python.org/downloads/mac-osx/ and install.

Install virtualenvwrapper

pip install virtualenvwrapper

Add these two lines to ~/.bashrc (~/.bash_profile on MAC OS) to set the location where the virtual environments should live and the location of the script installed with this package:

export WORKON_HOME=$HOME/.virtualenvs
source [VIRTUAL_ENV_LOCATION]

Replace [VIRTUAL_ENV_LOCATION] with either /usr/local/bin/virtualenvwrapper.sh or ~/.local/bin/virtualenvwrapper.sh depending on where it is installed on your system.

After editing it, reload the shell startup file by running e.g. source ~/.bashrc.

Create the virtual environment

mkvirtualenv nuscenes --python [PYTHON_BINARIES]

PYTHON_BINARIES are typically at either /usr/local/bin/python3.7 or /usr/bin/python3.7.

Activating the virtual environment

If you are inside the virtual environment, your shell prompt should look like: (nuscenes) user@computer:~$ If that is not the case, you can enable the virtual environment using:

workon nuscenes

To deactivate the virtual environment, use:

deactivate

sirkrisp / nuscenes-devkit