Investigating Developers' Preferences for Learning and Issue Resolution Resources in the ChatGPT Era

TL;DR

This study investigates how developers' learning and issue-resolution preferences evolve in the ChatGPT era by surveying 268 completed responses. It combines quantitative resource rankings with qualitative open-coding to assess the role of AI chatbots alongside video tutorials, written tutorials, API docs, Q&A forums, and search engines. Key findings show video tutorials remain the most favored for skill acquisition and exploring new technologies, while AI chatbots are increasingly valued as immediate, personalized complements and, in some cases, replacements for written tutorials and Q&A forums. The results inform educators and the software-development community about integrating AI tools with traditional learning resources, highlighting the need to balance accessibility, depth, and reliability as AI-assisted learning expands.

Abstract

The landscape of software developer learning resources has continuously evolved, with recent trends favoring engaging formats like video tutorials. The emergence of Large Language Models (LLMs) like ChatGPT presents a new learning paradigm. While existing research explores the potential of LLMs in software development and education, their impact on developers' learning and solution-seeking behavior remains unexplored. To address this gap, we conducted a survey targeting software developers and computer science students, gathering 341 responses, of which 268 were completed and analyzed. This study investigates how AI chatbots like ChatGPT have influenced developers' learning preferences when acquiring new skills, exploring technologies, and resolving programming issues. Through quantitative and qualitative analysis, we explore whether AI tools supplement or replace traditional learning resources such as video tutorials, written tutorials, and Q&A forums. Our findings reveal a nuanced view: while video tutorials continue to be highly preferred for their comprehensive coverage, a significant number of respondents view AI chatbots as potential replacements for written tutorials, underscoring a shift towards more interactive and personalized learning experiences. Additionally, AI chatbots are increasingly considered valuable supplements to video tutorials, indicating their growing role in the developers' learning resources. These insights offer valuable directions for educators and the software development community by shedding light on the evolving preferences toward learning resources in the era of ChatGPT.

Figures (2)

• Figure 1: Perceptions of AI Chatbots' Role with Respect to Other Programming Learning Resources
• Figure 2: Survey responses on the reliability and accuracy of AI chatbots