Repository navigation

llm-security

Website
Wikipedia

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook

23857

411

8 天前

Giskard-AI / giskard

🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python

4477

317

1 天前

NVIDIA / garak

the LLM vulnerability scanner

人工智能 llm-evaluation llm-security security-scanners vulnerability-assessment

Python

4303

421

9 小时前

verazuo / jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT jailbreak 大语言模型 prompt large-language-model llm-security jailbreaking

Jupyter Notebook

3075

280

4 个月前

protectai / llm-guard

The Security Toolkit for LLM Interactions

large-language-models 大语言模型 ChatGPT 安全 adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

Python

1605

199

5 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python

1296

204

4 天前

mariocandela / beelzebub

A secure low code honeypot framework, leveraging LLM for System Virtualization.

Cybersecurity research 安全 honeypot 框架低代码 Go research-project Kubernetes cloudnative cloudsecurity openai 大语言模型 llm-security llama3 ollama deception

1021

2 天前

EasyJailbreak / EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

large-language-model llm-security jailbreak

Python

624

23 天前

cyberark / FuzzyAI

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

jailbreak jailbreaking 大语言模型 llms 人工智能安全 Fuzzing/Fuzz testing llm-evaluation llm-security

Jupyter Notebook

517

17 天前

chawins / llm-sp

Papers and resources related to the security and privacy of LLMs 🤖

adversarial-machine-learning Awesome Lists 大语言模型 llm-security 隐私安全

Python

494

5 个月前

splx-ai / agentic-radar

A security scanner for your LLM agentic workflows

agentic-ai agentic-framework agentic-workflow 人工智能 ai-security 命令行界面 devsecops 大语言模型 llm-security red-teaming 安全 generative-ai mcp mcp-server

Python

428

1 天前

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

llm-security prompt-injection adversarial-attacks adversarial-machine-learning large-language-models llmops yara-scanner 安全

Python

377

1 年前

R3DRUN3 / sploitcraft

🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷

Cybersecurity Hacking offensive-security proof-of-concept redteam 教程人工智能 Amazon Web Services cloud container-security Docker Linux llm-security network-security Python Windows

Jupyter Notebook

196

23 天前

liu00222 / Open-Prompt-Injection

This repository provides a benchmark for prompt Injection attacks and defenses

llm-security llms prompt-injection 大语言模型

Python

183

2 天前

phantasmlabs / phantasm

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte

163

5 个月前

sshh12 / llm_backdoor

Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running any actual code on the victim's machine or thwart LLM-based fraud/moderation systems.

backdoor-attacks llm-security qwen2-5

Python

157

15 天前

yevh / TaaC-AI

AI-driven Threat modeling-as-a-Code (TaaC-AI)

application-security devsecops gpt gpt-3 gpt-4 threat threat-modeling 人工智能 llm-security claude-3 mistral-7b

HTML

130

10 个月前

ZenGuard-AI / fast-llm-security-guardrails

The fastest Trust Layer for AI Agents

llm-security 安全 agentic-ai ai-agent ai-agents

Python

129

1 个月前

Repello-AI / whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily

ai-security llm-security prompt-engineering

Python

115

9 个月前

arekusandr / last_layer

Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️

chatgpt-prompts jailbreak large-language-models llm-security prompt-engineering 安全 llm-local

Python

115

9 个月前