oasis

OASIS is an open-source tool designed for benchmarking AI models in offensive security tasks such as vulnerability discovery, exploitation, and privilege escalation. Notable features include standardized Docker challenges, multi-provider benchmarking, automated analysis with MITRE ATT&CK mapping, and the Kryptsec Scoring Model (KSM) that evaluates methodology quality and success rates. The tool operates entirely locally, ensuring data privacy and no external account requirements.