LLM Security Benchmarking Platform
20265 attacks and 3 defenses, benchmarked head-to-head on GT's HPC cluster.
Developed a solo agentic benchmarking platform (Python, LangChain, Slurm on the Georgia Tech HPC cluster) implementing 5 attacks and 3 defenses drawn from 5 papers. The runs revealed that 2 attacks defeated all defenses while 1 defense failed against basic prompt injection — grounding ongoing research into dynamic ML security defenses.
ML Security Research
