There are 2 repositories under trustworthy-ai topic.
Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams
🐢 Open-Source Evaluation & Testing for LLMs and ML models
The open-sourced Python toolbox for backdoor attacks and defenses.
[ICML 2024] TrustLLM: Trustworthiness in Large Language Models
[NeurIPS-2023] Annual Conference on Neural Information Processing Systems
Code of the paper: A Recipe for Watermarking Diffusion Models
Neural Network Verification Software Tool
A comprehensive toolbox for model inversion attacks and defenses, which is easy to get started.
Official code repo for the O'Reilly Book - Machine Learning for High-Risk Applications
A toolkit for tools and techniques related to the privacy and compliance of AI models.
A project to add scalable state-of-the-art out-of-distribution detection (open set recognition) support by changing two lines of code! Perform efficient inferences (i.e., do not increase inference time) and detection without classification accuracy drop, hyperparameter tuning, or collecting additional data.
The official implementation for ICLR23 paper "GNNSafe: Energy-based Out-of-Distribution Detection for Graph Neural Networks"
[ACM MM22] Towards Robust Video Object Segmentation with Adaptive Object Calibration, ACM Multimedia 2022
Principal Image Sections Mapping. Convolutional Neural Network Visualisation and Explanation Framework
A project to improve out-of-distribution detection (open set recognition) and uncertainty estimation by changing a few lines of code in your project! Perform efficient inferences (i.e., do not increase inference time) without repetitive model training, hyperparameter tuning, or collecting additional data.
Official code of "StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis" (CVPR 2022)
A curated list of awesome academic research, books, code of ethics, data sets, institutes, newsletters, principles, podcasts, reports, tools, regulations and standards related to Responsible AI and Human-Centered AI.
Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
code & data of PoisonedRAG paper
Code of the paper: Finetuning Text-to-Image Diffusion Models for Fairness
[ICCV-2023] Gradient inversion attack, Federated learning, Generative adversarial network.
[TPAMI, 2023] Fear-Neuro-Inspired Reinforcement Learning for Safe Autonomous Driving
a tool for comparing the predictions of any text classifiers
Official code of "Discover and Mitigate Unknown Biases with Debiasing Alternate Networks" (ECCV 2022)
Official code of "Discover the Unknown Biased Attribute of an Image Classifier" (ICCV 2021)
Trustworthy AI method based on Dempster-Shafer theory - application to fetal brain 3D T2w MRI segmentation
MERLIN is a global, model-agnostic, contrastive explainer for any tabular or text classifier. It provides contrastive explanations of how the behaviour of two machine learning models differs.
A project to train your model from scratch or fine-tune a pretrained model using the losses provided in this library to improve out-of-distribution detection and uncertainty estimation performances. Calibrate your model to produce enhanced uncertainty estimations. Detect out-of-distribution data using the defined score type and threshold.
Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data (NeurIPS 2022)