soft404

Soft404 is a classifier designed to detect soft 404 pages, which are incorrectly served with a 200 status despite indicating that content is not available. It provides a probability function for analyzing HTML content and can be utilized through command-line interfaces for both static and inline HTML. Key features include the ability to train the classifier on a dataset of 120,000 pages and comprehensive tools for data processing and model training.