Skip to content
View ppradyoth's full-sized avatar
🏠
Working from home
🏠
Working from home

Organizations

@niegfg

Block or report ppradyoth

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ppradyoth/README.md

Typing SVG


I break production AI, then build the controls that hold.

I'm an AI security engineer and red teamer focused on prompt injection, agent tool abuse, model provenance, and runtime enforcement. These are my independent projects and public research.

What I'm working on:

  • Red teaming LLM applications and agent workflows for prompt injection, data leakage, intent drift, and tool misuse.
  • Building action-level policies, approvals, and session budgets for AI agents with Railproof.
  • Maintaining AgentInjectionBench: reproducible injection cases, benign controls, and inspectable tool-call traces.
  • Expanding hands-on training through 16 LLM security missions and 30 agentic security missions.
  • Checking model artifacts, agent configurations, and third-party skills before they reach a runtime.

Recognition: Inventor Recognition (Q4 2025) for filed patents · DEVUP 2026 speaker · SEP Engineer Committee Lead for 1,100+ early-career engineers

Portfolio · Research & evidence · Email


Merged External Contributions

4 merged PRs across 3 AI security, evaluation, and privacy tools.

Repository What the tool does My merged contributions
Presidio Detects, redacts, and anonymizes sensitive personal data (PII) in text, images, and structured data. #2254: Fixed YAML deny-list defaults that silently dropped matches at positive detection thresholds.
Promptfoo Evaluates and red teams LLM applications, agents, and RAG pipelines, with repeatable tests and CI integration. #9402: Fixed config merging that silently dropped distinct function-based providers from evaluations.
NVIDIA garak Scans LLMs for vulnerabilities including prompt injection, data leakage, jailbreaks, and harmful outputs. #1794: Fixed a z-rating evaluation crash caused by a removed calibration method.
#1791: Added regression coverage for configuration-file deduplication in scan reports.

Full contribution history · Merge status verified 17 Oct 2026.


🛡️ Featured AI Security Projects

Tools for testing agent behavior, enforcing action policies, and inspecting the models and configurations those agents depend on.

🎮 Prompt Injection CTF

46 LLM & Agentic Security Missions

Hands-on training across the OWASP LLM Top 10 (2025) and Agentic Top 10 (2026). Attack a constrained system, inspect the defense, and test whether legitimate work still succeeds.

  • 16 LLM missions + 30 agentic missions, with attacker and defender tracks
  • Defense replay and legitimate-task controls in the Agentic Security Lab
  • Free default practice without signup or an API key. Ranked runs require sign-in. Live-model grading is optional

Next.js Tailwind OWASP LLM and Agentic

Codebase  •  Play the CTF

🔬 AgentInjectionBench

Reproducible Tests for Agent Tool Use

A public synthetic case pack and runner for testing whether untrusted content redirects an agent's next action. Inspect generated tool calls and arguments against each case's execution contract.

  • 182 cases: 142 attacks + 40 benign controls across 7 attack categories
  • Saved traces, case IDs, and dataset fingerprints for repeatable before-and-after runs
  • Model adapters and a custom-agent interface. Built-in adapters simulate tool results and execute no external actions

182 synthetic cases Apache 2.0 Agentic AI benchmark

Codebase  •  Dataset  •  Interactive Space

Railproof

Security Contracts Before Tools Execute

An alpha enforcement library that puts a deterministic policy decision in front of wrapped tool calls. Check the exact action, identity, data provenance, and session state before application code runs.

  • Deny-by-default policies over tools, arguments, users, tenants, roles, and data labels
  • One-time approvals bound to the exact action, plus atomic session budgets
  • OpenAI and MCP adapters, policy replay, and redacted decision records

Alpha Python 3.11 or newer Apache 2.0

Codebase

knowyourai

Inspect Model Artifacts. Pin What You Approved.

A zero-dependency CLI for inspecting open-weight model metadata, structure, and chat templates without loading or running a model. Check approved artifacts for changes with a model lockfile.

  • GGUF, safetensors, Ollama, and Hugging Face model sources
  • Offline by default, with optional registry comparison and remote header inspection
  • ai.lock pins revisions and digests. check detects changes for CI

Alpha Python 3.11 or newer Zero dependencies

Codebase

agentscan

Static Security Checks for Agent Configurations

Scan MCP configurations, agent permissions, hooks, and instruction files for security signals before giving a coding agent access to a repository.

  • Permission bypasses, wildcard tool grants, broad filesystem roots, and hardcoded secrets
  • Claude Code, Cursor, Cline/Roo, Windsurf, and Copilot configuration coverage
  • No model calls or dependencies, with JSON/Markdown output and severity-based CI gates

Python static analysis MIT Zero dependencies

Codebase

Agent Supply Chain Guard

Scan Skills & Manifests Before an Agent Reads Them

A local scanner for instruction-bearing supply-chain files: third-party skills, MCP manifests, plugins, and READMEs. Findings are review signals, not proof of exploitation.

  • Hidden instructions, execution references, credential patterns, and broad permissions
  • Invisible Unicode controls and dangerous URL schemes
  • Dependency-free rules and a GitHub Action, with optional provider-backed review

Python local scanner Apache 2.0 GitHub Action

Codebase


Open Source

prompt-injection-ctf (⭐ 8) — 46 AI security missions: 16 covering the OWASP LLM Top 10 (2025) and 30 covering the OWASP Agentic Top 10 (2026). Attack, inspect defenses, and replay controls. Default practice needs no signup or API key. Ranked runs require sign-in.

AgentInjectionBench (⭐ 4) — 182 public synthetic cases: 142 attacks and 40 benign controls across 7 attack categories. Evaluate generated tool calls, arguments, and canary disclosures against explicit execution contracts, with saved traces and dataset fingerprints.

ai-security-resources (⭐ 4) — AI red-teaming tools, research, practical labs, and 7/30/100-day learning paths. Includes agent security, model scanning, standards, interview prep, and public attack taxonomies.

weighted-safety-refusal (⭐ 1) — Reference-free, severity-weighted evaluation of harmful refusal and matched benign compliance. Combines both axes into a calibrated safety score so refusing everything earns zero.

synaptic-wetware (⭐ 1) — Organoid intelligence simulator with Hodgkin–Huxley and Izhikevich neuron models, MEA burst detection, and DishBrain-inspired Pong.

railproof — Alpha enforcement library for AI agent actions. Deny-by-default policies check tools, arguments, identity, data labels, provenance, approvals, and session budgets before wrapped tools execute.

knowyourai — Zero-dependency model verification CLI for GGUF, safetensors, Ollama, and Hugging Face artifacts. Inspect metadata and chat templates without running a model, then pin approved artifacts in ai.lock and check for drift.

agentscan — Static security scanner for AI-agent configurations, MCP servers, permission settings, hooks, and instruction files. Flags risky grants and exposed secrets without model calls or dependencies.

on-device-ai-app-starter-kit — Browser-local GGUF inference, document retrieval, and source citations. Model setup downloads the artifacts; document processing and inference run locally in LOCAL MODE.

agent-supply-chain-guard — Local scanner for third-party agent skills, MCP manifests, plugins, and README files. Flags hidden instructions, execution references, credential patterns, broad permissions, and invisible Unicode controls.

yolobench — Sandboxed benchmark for coding-agent judgment when a requested action has an ambiguous or destructive target. Published results currently cover the scripted reference backend, not real coding agents.

intent-drift-playbook — Research-grounded taxonomy of multi-turn intent drift, with conceptual detection approaches for tracking behavior against the original task and instructions.

ai-security-tracker — Tracks public vulnerabilities, CVEs, and security activity across AI/ML repositories.

llm-ops-workshop — End-to-end MLOps workflow demonstrating model lifecycle, monitoring, and deployment practices.

📋 Full list of external contributions — repos outside my account where I've contributed (2020–present)


AI & LLM Security

LLMs & AI Platforms

Claude ChatGPT Gemini Grok Llama Mistral Copilot NVIDIA NIM Hugging Face

Red Team & Security Tools

Garak PyRIT Promptfoo Protect AI Prisma AIRS NeMo Guardrails Lakera Guard Burp Suite Counterfit

Frameworks & Standards

OWASP LLM Top 10 MITRE ATLAS NIST AI RMF


Connect

ppradyoth ppradyoth @ppradyoth ppradyoth ppradyoth @ppradyoth pradyothp ppradyoth ppradyoth


Tech Stack

python java spring docker kubernetes aws terraform kafka redis mysql grafana jenkins linux git postman raspberrypi c cplusplus css3 html5 javascript go nodejs mongodb firebase gcp heroku opencv pandas scikit_learn tensorflow tailwind photoshop


Pinned Loading

  1. prompt-injection-ctf prompt-injection-ctf Public

    Free prompt injection CTF: 16 LLM security missions plus a 30-mission Agentic Security Lab (OWASP Agentic Top 10), defender mode, optional live-model grading. No signup.

    HTML 8 3

  2. weighted-safety-refusal weighted-safety-refusal Public

    Severity-weighted LLM safety evaluation suite. Measures absolute refusal robustness across prompt injection, jailbreaking, data exfiltration, toxicity, and malware generation — with risk-adjusted c…

    Python 1

  3. AgentInjectionBench AgentInjectionBench Public

    Catch unsafe tool calls before you ship. Test prompt injection in tool-using agents with reproducible traces and benign controls.

    Python 4

  4. agentscan agentscan Public

    Security scanner for AI-agent configs: MCP servers, CLAUDE.md, settings, hooks. Zero-dependency static analysis.

    Python

  5. build-break-models-from-scratch build-break-models-from-scratch Public

    Build AI models from scratch, then break them — a gamified, CTF-style tour of how models work and how they fail. LLMs now (levels 1–5), diffusion later.

    Python

  6. jev-guard jev-guard Public

    Static code scanner (SAST linter) that finds insecure usage of Jev / TypeSafe guardrails in Python. Not a guardrail itself — build-time analysis, offline, no API key.

    Python