Beast code in Giters

Giuseppe Massaro's starred repositories

grok-1

Grok open release

Language:PythonApache-2.049141 560 200

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

Language:PythonMIT11862 88 309

reader

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Language:TypeScriptApache-2.05580 32 71

xzbot

notes, honeypot, and exploit demo for the xz backdoor (CVE-2024-3094)

Language:Go3468 390

cozo

A transactional, relational-graph-vector database that uses Datalog for query. The hippocampus for AI!

Language:RustMPL-2.03234 42 138

tracecat

The open source Tines / Splunk SOAR alternative.

Language:PythonAGPL-3.02203 21 70

PurpleLlama

Set of tools to assess and improve LLM security.

Language:PythonNOASSERTION2132 32 20

jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

Language:Jupyter NotebookMIT1590 21 7

akto

Proactive, Open source API security → API discovery, Testing in CI/CD, Test Library with 150+ Tests, Add custom tests, Sensitive data exposure

Language:JavaMIT881 14 146

awesome-llm-security

A curation of awesome tools, documents and projects about LLM Security.

755 31 4

TheBigPromptLibrary

A collection of prompts, system prompts and LLM instructions

Language:HTMLMIT658 190

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

Language:PythonNOASSERTION642 13 39

CipherChat

A framework to evaluate the generalization capability of safety alignment for LLMs

Language:PythonMIT540 80

EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

Language:PythonGPL-3.0313 5 21

ps-fuzz

Make your GenAI Apps Safe & Secure :rocket: Test & harden your system prompt

Language:PythonMIT300 10 14

PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022

Language:PythonMIT276 10 2

llm-security

Dropbox LLM Security research code and results

Language:PythonApache-2.0190 60

rigging

Lightweight LLM Interaction Framework

Language:PythonMIT150 7 6

llm-adaptive-attacks

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]

Language:ShellMIT137 3 4

jailbreakbench

An Open Robustness Benchmark for Jailbreaking Language Models [arXiv 2024]

Language:PythonMIT110 4 3

dspy-redteam

Red-Teaming Language Models with DSPy

Language:Python87 3 1

parley

Tree of Attacks (TAP) Jailbreaking Implementation

Language:PythonMIT80 40

ReNeLLM

The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily".

Language:PythonMIT52 11 3