autopager

Autopager is a Python package designed to detect and classify pagination links within web pages using machine learning techniques. Its primary use case is to extract pagination URLs and categorize `<a>` elements into meaningful classes such as "PAGE," "PREV," and "NEXT," enhancing the web scraping capabilities of developers. Notable features include the ability to utilize a prebuilt extraction model or custom models, compatibility with both HTML strings and various response types, and a high detection quality rate estimated to work for 90% of paginators across a wide range of websites.