AI Safety & Alignment

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line

elder-plinius/CL4R1T4S

LEAKED SYSTEM PROMPTS FOR CHATGPT, CLAUDE, GEMINI, GROK, PERPLEXITY, CURSOR, LOVABLE, REPLIT, AND MORE! - AI SYSTEMS TRANSPARENCY FOR ALL! 👐

maximhq/bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, v

YuJunZhiXue/dsh-purge

DeepSeek Harness 破甲：让所有模型都能破甲，不同模型可换不同提示词；默认提示词面向国模「小码酱」。Jailbreak for every model — swap prompts per model. 求 Star 收藏 ⭐ 如要二开，请查看署名要求部分

future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

guardrails-ai/guardrails

Adding guardrails to large language models.

LouisShark/chatgpt_system_prompt

A collection of GPT system prompts and various prompt injection/leaking knowledge.

elder-plinius/T3MP3ST

autonomous red teaming platform; multi-agent offensive-security meta-harness

CyberStrikeus/CyberStrike

Open-source AI-powered offensive security harness for automated penetration testing.

Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

msoedov/agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

oritera/Cairn

Cairn is a general-purpose AI state-space search engine, validated first on autonomous penetration testing. Sometimes misspelled as Carin.

wanxingai/LightAgent

LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows.

RiccardoBiosas/awesome-MLSecOps

A curated list of MLSecOps tools and resources for securing machine learning and AI systems - adversarial ML defense, LLM security, AI red teaming, model scanning, supply-chain protection, and MLOps p

verazuo/jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

mezmo/aura

AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on pro

uclaml/SPIN

The official implementation of Self-Play Fine-Tuning (SPIN)

EasyJailbreak/EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

Jovancoding/Network-AI

Traffic light for AI Agents and TypeScript/Node multi-agent orchestrator with shared state, guardrails, and adapters for 32 AI frameworks

uiuing/browser-agent

An open-source AI agent for the browser. Bring any model. It plans in the side panel, acts on real pages through tools, and verifies every claimed result against the live DOM — with guardrails and reu

occludra/gateway

Self-hosted AI security proxy. Redact PII, block prompt injection, route to any LLM provider. OpenAI-compatible.

aiplaybookin/novice-ChatGPT

ChatGPT API Usage using LangChain, LlamaIndex, Guardrails, AutoGPT and more

tmasjc/deka-oss

Aligning Human Intuition with Semantic Space

LLAMATOR-Core/ai-agents-security

Инициатива, посвященная безопасности агентов на базе искусственного интеллекта

Enigma-Vault/NoPII

Ready-to-run examples showing NoPII PII protection with OpenAI, Anthropic, LangChain, LlamaIndex, and more

onehumanbeing/esp32-iphone-agent

Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.

Minglink/dsh-infinite-gen-4

DeepSeek v4.1 flash 网络安全红队工具（无限四代） 求 Star 收藏 ⭐欢迎大家提交项目的改进

yueliu1999/Awesome-Jailbreak-on-LLMs

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

taielab/awesome-hacking-lists

A curated collection of top-tier penetration testing tools and productivity utilities across multiple domains. Join us to explore, contribute, and enhance your hacking toolkit!

Gentleman-Programming/gentle-shell

Your coding agent for controlled development in the workspace you lead. A Pi-native shell with Organic Driven Development, focused subagents, risk-based native review, live changes and agent views, an

zjunlp/KnowledgeEditingPapers

Must-read Papers on Knowledge Editing for Large Language Models.

cvs-health/uqlm

[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"

tophant-ai/ClawVault

OpenClaw Security Vault — Atomic "claw" control: every AI reach, within your sight.

toby-bridges/api-relay-audit

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.

0x5477/deepseek-v4-pro-unrestricted

DeepSeek v4 Pro 破甲提示词及测试包 — jailbreak prompts and test suite for DeepSeek

Gentleman-Programming/gentle-pi

Turn Pi into el Gentleman: a senior-architect development harness with SDD/OpenSpec, subagents, strict TDD evidence, review guardrails, and skill discovery.

Quincunx33/Ai-jailbreak

A collection of jailbreak prompts and exploit techniques for local and frontier AI models, with modern methods for Qwen3.5, Gemma 4, Llama 4, Kimi K3, GPT-OSS, GPT-5.x, Gemini 3.x and Grok 4.x. For re

PsycheCashier/ClaudeAi-Jailbreak-Prompt

Claude 5.0 jailbreak prompt engineering and vulnerability analysis. Open-source Red Teaming framework for Claude 5 Opus/Sonnet safety alignment testing & bypass research.

CraneWorship86/Claude-Jailbreak-Prompt

Claude AI Advanced Prompt Engineering & Context Customization Framework. Unleash extended creative writing, deep analytical mode, and flexible safety alignment adjustments for Anthropic models.

9hannahnine-jpg/arc-gate

Arc Gate — LLM proxy with prompt injection detection. Bendex Geometry.

codewithaarohi/Multi_agent_system_part_3

Production-Ready Multi-Agent AI System with LangGraph | Supervisor Agent + Guardrails + Human-in-the-Loop