This repo contains a minimal working example for a submission to the TrojAI leaderboard. This minimal ‘solution’ loads the model file, inferences the example text sequences, and then writes a random number to the output file. You can use this as your base to build your own solution.
Every solution submitted for evaluation must be containerized via Singularity (see this Singularity tutorial).
The submitted Singularity container will be run by the TrojAI Evaluation Server using the specified Container API, inside of a virtual machine which has no network capability.
The container submitted for evaluation must perform trojan detection for a single trained AI model file and output a single probability of the model being poisoned. The test and evaluation infrastructure will iterate over the N models for which your container must predict trojan presence.
Your container will have access to these Submission Compute Resources.
- New Container Configuration
- System Requirements
- Example Data
- Submission Instructions
- How to Build this Minimal Example
With the release of TrojAI Round 10, a new container configuration is being added that enables TrojAI T&E to evaluate submitted detectors across various new dimensions. The main changes require submitted containers to do two new things:
- Specify a "metaparameters" file that documents a container's manually tunable parameters and their range of possible values.
- Generate "learned parameters" via a new reconfiguration API.
Submitted containers will now need to work in two different modes:
- Inference Mode: Containers will take as input both a "metaparameter" file and a model and output the probability of poisoning.
- Reconfiguration Mode: Containers will take a new dataset as input and output a file dump of the new learned parameters tuned to that input dataset.
- Linux (tested on Ubuntu 20.04 LTS)
- CUDA capable NVIDIA GPU (tested on A4500)
Note: This example assumes you are running on a version of Linux (like Ubuntu 20.04 LTS) with a CUDA enabled NVIDIA GPU. Singularity only runs natively on Linux, and most Deep Learning libraries are designed for Linux first. While this Conda setup will install the CUDA drivers required to run PyTorch, the CUDA enabled GPU needs to be present on the system.
Example data can be downloaded from the NIST Leader-Board website.
A small toy set of clean & poisioned data is also provided in this repository under the model/example-data/ folder. This toy set of data is only for testing your environment works correctly.
- Package your trojan detection solution into a Singularity Container.
- Name your container file based on which server you want to submit to.
- Request an Account on the NIST Test and Evaluation Server.
- Follow the Google Drive Submission Instructions.
- View job status and results on the Leader-Board website.
- Review your submission logs shared back with your team Google Drive account.
https://www.anaconda.com/distribution/
-
conda create --name trojai-example python=3.8 -y(help) -
conda activate trojai-example -
Install required packages into this conda environment
conda install pytorch=1.11 torchvision=0.12 cudatoolkit=11.3 -c pytorchpip install pycocotools transformers opencv-python jsonschema jsonargparse jsonpickle scipy
-
Clone the repository
git clone https://github.com/usnistgov/trojai-example cd trojai-example- The example model is too big for the repository, so you will need to download it following the instructions in the /model directory.
-
Test the python based
example_trojan_detectoroutside of any containerization to confirm pytorch is setup correctly and can utilize the GPU.python example_trojan_detector.py \ --model_filepath=./model/trojai-example-model-round10/model.pt \ --features_filepath=./features.csv \ --result_filepath=./output.txt \ --scratch_dirpath=./scratch/ \ --examples_dirpath=./model/trojai-example-model-round10/clean-example-data/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --round_training_dataset_dirpath=/path/to/training/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --learned_parameters_dirpath=./learned_parameters/
Example Output:
Trojan Probability: 0.07013004086445151
-
Test self-configure functionality.
python example_trojan_detector.py \ --scratch_dirpath=./scratch/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --configure_mode \ --learned_parameters_dirpath=./new_learned_parameters/ \ --configure_models_dirpath=./model/
The tuned parameters can then be used in a regular run.
python example_trojan_detector.py \ --model_filepath=./model/trojai-example-model-round10/model.pt \ --features_filepath=./features.csv \ --result_filepath=./output.txt \ --scratch_dirpath=./scratch/ \ --examples_dirpath=./model/trojai-example-model-round10/clean-example-data/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --round_training_dataset_dirpath=/path/to/training/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --learned_parameters_dirpath=./new_learned_parameters/
Package example_trojan_detector.py into a Singularity container.
-
Install Singularity
-
Build singularity based on
example_trojan_detector.deffile:-
delete any old copy of output file if it exists:
rm example_trojan_detector.simg -
package container:
sudo singularity build example_trojan_detector.simg example_trojan_detector.def
which generates a
example_trojan_detector.simgfile. -
-
Test run container:
singularity run \ --bind /full/path/to/trojai-example \ --nv \ ./example_trojan_detector.simg \ --model_filepath=./model/trojai-example-model-round10/model.pt \ --features_filepath=./features.csv \ --result_filepath=./output.txt \ --scratch_dirpath=./scratch/ \ --examples_dirpath=./model/trojai-example-model-round10/clean-example-data/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --round_training_dataset_dirpath=/path/to/training/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --learned_parameters_dirpath=./learned_parameters/
Example Output:
Trojan Probability: 0.7091788412534845
-
Test self-tune functionality.
singularity run \ --bind /full/path/to/trojai-example \ --nv \ ./example_trojan_detector.simg \ --scratch_dirpath=./scratch/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --configure_mode \ --learned_parameters_dirpath=./new_learned_parameters/ \ --configure_models_dirpath=./model/
The tuned parameters can then be used in a regular run.
singularity run \ --bind /full/path/to/trojai-example \ --nv \ ./example_trojan_detector.simg \ --model_filepath=./model/trojai-example-model-round10/model.pt \ --features_filepath=./features.csv \ --result_filepath=./output.txt \ --scratch_dirpath=./scratch/ \ --examples_dirpath=./model/trojai-example-model-round10/clean-example-data/ \ --source_dataset_dirpath=/path/to/source/dataset/ \ --round_training_dataset_dirpath=/path/to/training/dataset/ \ --metaparameters_filepath=./metaparameters.json \ --schema_filepath=./metaparameters_schema.json \ --learned_parameters_dirpath=./new_learned_parameters/