hyphe

Hyphe is a research-driven web crawling tool designed for building web corpora and establishing networks between various web entities, such as individual pages and entire websites. Its notable features include customizable crawling settings, support for storing crawled data, and the ability to generate detailed exploratory networks, making it suitable for digital humanities research and web analysis. Hyphe can be easily installed via Docker, accommodating varying user needs and resource availability.