AutoDroid

AutoDroid is a system designed for automating intelligent tasks on smartphones by leveraging large language models (LLMs). Built on the DroidBot framework, it facilitates the execution of app-specific tasks using captured screenshots and view hierarchies from the target applications, enabling users to automate interactions with various Android apps. Notable features include a dataset called DroidTask that provides comprehensive state and task information, along with the ability to specify tasks and outputs through command-line interfaces.