CodeAttack

CodeAttack is a blackbox adversarial attack model specifically designed for pre-trained programming language models, effectively generating imperceptible adversarial code samples to exploit model vulnerabilities. It leverages code structure to demonstrate the susceptibility of various models, such as CodeT5 and CodeBERT, across translation, repair, and summarization tasks in multiple programming languages. Notable features include the use of abstract syntax tree (AST) and data flow graph (DFG) constraints, along with options to attack specific tokens, enhancing both efficiency and performance drop in victim models.