Machine Learning Attack Series - Overview
The code for the Husky AI server and model files are here.
Machine Learning Basics and Building Husky AI
- Getting the hang of machine learning
- The machine learning pipeline and attacks
- Husky AI: Building a machine learning system
- MLOps - Operationalizing the machine learning model
Threat Modeling and Strategies
- Threat modeling a machine learning system
- Grayhat Red Team Village Video: Building and breaking a machine learning system
- Assume Bias and Responsible AI
Practical Attacks and Defenses
- Brute forcing images to find incorrect predictions
- Smart brute forcing
- Perturbations to misclassify existing images
- Adversarial Robustness Toolbox Basics
- Image Scaling Attacks
- Stealing a model file: Attacker gains read access to the model
- Backdooring models: Attacker modifies persisted model file
- Repudiation Threat and Auditing: Catching modifications and unauthorized access
- Attacker modifies Jupyter Notebook file to insert a backdoor
- CVE 2020-16977: VS Code Python Extension Remote Code Execution
- Using Generative Adversarial Networks (GANs) to create fake husky images
- Using Azure Counterfit to create adversarial examples
- Backdooring Pickle Files
Miscellaneous
- Participating in the Microsoft Machine Learning Security Evasion Competition - Bypassing malware models by signing binaries
- Husky AI Github Repo
Threat Model
Reminder: Penetration testing requires authorization from proper stakeholders. Information is provided for research and educational purposes to advance understanding of attacks and improve countermeasures.