Photon

Photon is a high-performance web crawler designed specifically for Open Source Intelligence (OSINT) purposes. It excels at extracting a variety of data types—including URLs, emails, social media accounts, files, and secret keys—while offering extensive customization options for crawls, such as timeout control and regex URL exclusions. Notable features include smart thread management, support for plugins, and a simple deployment via a lightweight Docker image.