arachnado

Arachnado is a web crawling tool designed for targeted website scraping, utilizing a Tornado-based HTTP API and a Scrapy-based crawler. Its primary use case revolves around providing a user-friendly interface and configurability for website data extraction, with notable features including a web UI, configuration file support, and command-line options for flexible operation. Additionally, it includes testing capabilities with tox and allows for dynamic asset building during development.