NYU_CTF_Bench

The NYU CTF Bench is a resource that provides a collection of 200 dockerized CTF challenges from the CSAW competitions, aimed at evaluating LLM agents. This repository offers easy deployment and interaction with challenges spanning six categories, including web and binary exploitation, enhancing the development of automation frameworks for CTF task resolution. Notably, it includes a robust structure for challenge metadata and supports both test and development datasets to aid in creating unbiased LLM agents.