Prerequisites:
- Unix system (Linux or MacOS)
- Python version 3.7.x
- Terminal (e.g. iTerm2 for MacOS)
- Integrated development environment (IDE) (e.g. PyCharm or Sublime Text)
For the following description, we assume that you are using Linux or MacOS and that you are familiar with working from a terminal. The exercises are implemented in Python 3.7. Note that you might be unable to install some libraries required for the assignments if your python version < 3.7. So please make sure that you install python 3.7 before proceeding.
If you are using Windows, the procedure might slightly vary and you will have to Google for the details. We'll mention some of them in this document.
To avoid issues with different versions of Python and Python packages we recommend to always set up a project specific virtual environment. The most common tools for a clean management of Python environments are pyenv, virtualenv and Anaconda.
In this README we provide you with a short tutorial on how to use and setup a virtuelenv environment. To this end, install or upgrade virtualenv. There are several ways depending on your OS. At the end of the day, we want
which virtualenv
to point to the installed location.
On Ubuntu, you can use:
apt-get install python-virtualenv
Also, installing with pip should work (the virtualenv executable should be added to your search path automatically):
pip3 install virtualenv
Once virtualenv is successfully installed, go to the root directory of the i2dl repository (where this README.md is located) and execute:
virtualenv -p python3 --no-site-packages .venv
Basically, this installs a sandboxed Python in the directory .venv. The
additional argument ensures that sandboxed packages are used even if they had
already been installed globally before.
Whenever you want to use this virtualenv in a shell you have to first activate it by calling:
source .venv/bin/activate
To test whether your virtualenv activation has worked, call:
which python
This should now point to .venv/bin/python.
From now on we assume that that you have activated your virtual environment.
Installing required packages: We have made it easy for you to get started, just call from the i2dl root directory:
pip3 install -r requirements.txt
The exercises are guided via Jupyter Notebooks (files ending with *.ipynb). In order to open a notebook dedicate a separate shell to run a Jupyter Notebook server in the i2dl root directory by executing:
jupyter notebook
A browser window which depicts the file structure of directory should open (we tested this with Chrome). From here you can select an exercise directory and one of its exercise notebooks!
Note:For windows, use miniconda or conda. Create an environment using the command:
conda create --name i2dl python=3.7
Next activate the environment using the command:
conda activate i2dl
Continue with installation of requirements and starting jupyter notebook as mentioned above, i.e.
pip install -r requirements.txt
jupyter notebook
In the exercises we will use PyTorch and PyTorch Lightning deep learning frameworks which provides a research oriented interface with a dynamic computation graph and many predefined, learning-specific helper functions. PyTorch Lightning is installed as part of the requirements.txt file and no special actions are needed for it.
Unfortunately, for PyTorch the installation depends on the individual system configuration (OS, Python version and CUDA version) and therefore is not possible with the usual requirements.txt file.
Use this wheel inside your virtualenv to install PyTorch:
pip install torch==1.3.0 torchvision==0.4.1
# CUDA 10.0
pip install torch==1.3.0 torchvision==0.4.1 -f https://download.pytorch.org/whl/torch_stable.html
# CUDA 9.2
pip install torch==1.3.0+cu92 torchvision==0.4.1+cu92 -f https://download.pytorch.org/whl/torch_stable.html
# CPU only
pip install torch==1.3.0+cpu torchvision==0.4.1+cpu -f https://download.pytorch.org/whl/torch_stable.html
The exercises would be uploaded to Moodle. You need to login with your moodle account and download the exercises from there. At each time we start with a new exercise you have to populate the respective exercise directory.
i2dl_exercises
├── datasets # The datasets required for all exercises will be placed here
├── exercise_1
├── exercise_2
├── exercise_3
├── exercise_4
├── exercise_5
├── exercise_6
├── exercise_7
├── exercise_8
├── exercise_9
├── exercise_10
├── exercise_11
├── exercise_12
├── LICENSE
└── README.md
Datasets will be uploaded on moodle based on the exercises. Please download the zip file and extract it in the downloads folder. A sample directory structure for cifar10 dataset is shown below:-
i2dl_exercises
├── datasets # The datasets required for all exercises will be downloaded here
├── cifar10 # Dataset directory
├── cifar10.p # dataset files