ai-security

This repository is primarily maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), artificial intelligence security, vulnerability research, exploit development, reverse engineering, and more.

🐢 Open-Source Evaluation & Testing for AI & LLM systems

A curated list of useful resources that cover Offensive AI.

A list of backdoor learning resources

a prompt injection scanner for custom LLM applications

A security scanner for your LLM agentic workflows

RuLES: a benchmark for evaluating rule-following in language models

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

A curated list of academic events on AI Security & Privacy

[CCS'24] SafeGen: Mitigating Unsafe Content Generation in Text-to-Image Models

Run and manage MCP servers easily and securely

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily

The official implementation of the CCS'23 paper, Narcissus clean-label backdoor attack -- only takes THREE images to poison a face recognition dataset in a clean-label way and achieves a 99.89% attack success rate.

Framework for testing vulnerabilities of large language models (LLM).

Cyber-Security Bible! Theory and Tools, Kali Linux, Penetration Testing, Bug Bounty, CTFs, Malware Analysis, Cryptography, Secure Programming, Web App Security, Cloud Security, Devsecops, Ethical Hacking, Social Engineering, Privacy, Incident Response, Threat Assestment, Personal Security, Ai Security, Android Security, Iot Security, Standards.

Code for "Adversarial attack by dropping information." (ICCV 2021)

Train AI (Keras + Tensorflow) to defend apps with Django REST Framework + Celery + Swagger + JWT - deploys to Kubernetes and OpenShift Container Platform

Performing website vulnerability scanning using OpenAI technologie

ATLAS tactics, techniques, and case studies data

this.env defines, locks, and hashes the environment to establish a reliable and secure operational context. By detecting and responding to changes, it ensures consistency and integrity, especially for intelligent systems and machine learning applications.