ml-safety

There are 1 repository under ml-safety topic.

giskard
Giskard-AI / giskard
🐢 Open-Source Evaluation & Testing for LLMs and ML models
ai-red-team ai-safety ai-security ai-testing ethical-artificial-intelligence fairness-ai llm llm-eval llm-evaluation llm-security llmops ml-safety ml-testing ml-validation mlops model-monitoring rag-evaluation red-team-tools responsible-ai trustworthy-ai
Language:Python 3291
hendrycks / robustness
Corruption and Perturbation Robustness (ICLR 2019)
computer-vision convolutional-neural-networks deep-learning domain-generalization imagenet machine-learning ml-safety pytorch robustness
Language:Python 971
hendrycks / natural-adv-examples
A Harder ImageNet Test Set (CVPR 2021)
adversarial-attacks robustness adversarial-example ml-safety imagenet domain-generalization
Language:Python 576
hendrycks / outlier-exposure
Deep Anomaly Detection with Outlier Exposure (ICLR 2019)
anomaly anomaly-detection calibration deep-learning ml-safety out-of-distribution-detection pytorch
Language:Python 531
JohnSnowLabs / langtest
Deliver safe & effective language models
benchmarks ethics-in-ai large-language-models ml-safety ml-testing mlops model-assessment nlp responsible-ai llm-test
Language:Python 459
agencyenterprise / PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
ai-safety language-models ml-safety agi ai-alignment agi-alignment adversarial-attacks gpt-3 large-language-models machine-learning chain-of-thought prompt-engineering
Language:Python 276
hendrycks / ss-ood
Self-Supervised Learning for OOD Detection (NeurIPS 2019)
robustness out-of-distribution-detection uncertainty self-supervised-learning self-supervised ml-safety
Language:Python 263
hendrycks / imagenet-r
ImageNet-R(endition) and DeepAugment (ICCV 2021)
robustness domain-adaptation domain-generalization out-of-distribution ml-safety
Language:Python 244
hendrycks / ethics
Aligning AI With Shared Human Values (ICLR 2021)
ai-safety machine-ethics ethical-ai gpt-3 ml-safety
Language:Python 214
ModelNet40-C
jiachens / ModelNet40-C
Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296
deep-learning point-cloud-processing robustness computer-vision benchmark data-augmentation regularization corruption-robustness ml-safety pytorch
Language:Python 204
hendrycks / anomaly-seg
The Combined Anomalous Object Segmentation (CAOS) Benchmark
segmentation carla-simulator anomaly-detection out-of-distribution-detection ml-safety
Language:Python 153
Giskard-AI / awesome-ai-safety
📚 A curated list of papers & technical articles on AI Quality & Safety
ai ai-alignment ai-safety artificial-intelligence llm llmops machine-learning ml mlops natural-language-processing ai-quality ethical-ai ml-testing model-testing model-validation computer-vision awesome awesome-list ml-safety robustness
140
hendrycks / pre-training
Pre-Training Buys Better Robustness and Uncertainty Estimates (ICML 2019)
pretrained robustness uncertainty out-of-distribution-detection calibration adversarial-examples data-corruption ml-safety
Language:Python 98
YyzHarry / ME-Net
[ICML 2019] ME-Net: Towards Effective Adversarial Robustness with Matrix Estimation
adversarial-attacks adversarial-example robustness matrix-estimation defense ml-safety matrix-completion icml icml-2019
Language:Python 52
hendrycks / jiminy-cricket
Jiminy Cricket Environment (NeurIPS 2021)
ml-safety machine-ethics
Language:ZAP 23
yaodongyu / ProjNorm
Predicting Out-of-Distribution Error with the Projection Norm
distribution-shift ml-safety
Language:Python 16
MUFIACode
harsmac / MUFIACode
Code for the attack multiplicative filter attack MUFIA, from the paper "Frequency-based vulnerability analysis of deep learning models against image corruptions".
adversarial-attacks adversarial-examples adversarial-machine-learning cifar10 cifar100 computer-vision dct-coefficients domain-generalization filters frequency-analysis imagenet machine-learning ml-safety pytorch robustness
Language:Python 3
ArianeDlns / adv-AI-project
This repository contains the project for the Advanced AI course @CentraleSupélec
ml-safety
Language:Jupyter Notebook 2