GPTZoo: A Large-scale Dataset of GPTs for the Research Community
Xinyi Hou, Yanjie Zhao, Shenao Wang, Haoyu Wang
TL;DR
GPTZoo tackles the lack of accessible, richly annotated GPT datasets by compiling 730,420 GPT instances with 21 metadata attributes and core content, sourced primarily from GPTs App and cross-validated with the OpenAI GPT Store. It introduces an automated data-collection and verification pipeline, along with a keyword-based CLI for efficient retrieval and analysis, enabling large-scale empirical study of GPT usage, performance, and evolution. The work documents dataset construction details, data quality checks, and an ethics-oriented access policy, aiming to support researchers while promoting responsible AI research. Overall, GPTZoo provides a practical, open resource to benchmark GPT deployments across domains and to inform researchers, policymakers, and practitioners about real-world GPT dynamics.
Abstract
The rapid advancements in Large Language Models (LLMs) have revolutionized natural language processing, with GPTs, customized versions of ChatGPT available on the GPT Store, emerging as a prominent technology for specific domains and tasks. To support academic research on GPTs, we introduce GPTZoo, a large-scale dataset comprising 730,420 GPT instances. Each instance includes rich metadata with 21 attributes describing its characteristics, as well as instructions, knowledge files, and third-party services utilized during its development. GPTZoo aims to provide researchers with a comprehensive and readily available resource to study the real-world applications, performance, and potential of GPTs. To facilitate efficient retrieval and analysis of GPTs, we also developed an automated command-line interface (CLI) that supports keyword-based searching of the dataset. To promote open research and innovation, the GPTZoo dataset will undergo continuous updates, and we are granting researchers public access to GPTZoo and its associated tools.