arachni

Arachni is a comprehensive web application security scanning framework designed for penetration testers and administrators. It features advanced capabilities for intelligently assessing the security of dynamic web applications, including an integrated browser environment for auditing client-side code and the ability to learn from application behavior to reduce false positives. Though primarily focused on web security, it can also be adapted for general-purpose scraping and data mining with custom components.