CWEval

CWEval is a tool designed to assess both the functionality and security of code generated by large language models (LLMs) on a common set of programming tasks. Notable features include a Docker-based environment for easy setup, integration with various LLMs, and the ability to conduct simultaneous evaluations, offering parameters for model selection, sample generation, and parallel processing. This enables users to verify the integrity of LLM-generated code comprehensively.