Pilot Study on Student Public Opinion Regarding GAI

TL;DR

This study investigates university students' attitudes toward generative AI in higher education, addressing a gap in classroom-based public opinion data. Using a pre/post survey design within GMU CDS 130 courses, it analyzes attitude shifts after a brief instructional video via a $Binomial(n,p)$ framework and exact Clopper–Pearson $CI$s. The findings reveal a very low participation rate (≈$0.044$; $95\\%$ CI $(0.009,0.124)$) and limited evidence of systematic opinion change, with some questions showing shifts while others remain stable. The work underscores the need for larger class samples and multiple iterations to achieve statistically robust insights, and it provides groundwork for incorporating GAI discussions into course design to foster informed, critical engagement.

Abstract

The emergence of generative AI (GAI) has sparked diverse opinions regarding its appropriate use across various domains, including education. This pilot study investigates university students' perceptions of GAI in higher education classrooms, aiming to lay the groundwork for understanding these attitudes. With a participation rate of approximately 4.4%, the study highlights the challenges of engaging students in GAI-related research and underscores the need for larger sample sizes in future studies. By gaining insights into student perspectives, instructors can better prepare to integrate discussions of GAI into their classrooms, fostering informed and critical engagement with this transformative technology.

Figures (8)

• Figure 1: Results for the survey question: Which statement comes closer to your view, even if neither is exactly right? a. Generative AI provides trustworthy responses. b. Generative AI provides untrustworthy responses.
• Figure 2: Results for the survey question: Generally speaking, would you say that it is okay to use generative AI to create art in the style of a deceased artist? a. Yes b. No
• Figure 3: Results for the survey question: Generally speaking, would you say that it is okay to use generative AI to create art in the style of an artist who is alive? a. Yes b. No
• Figure 4: Results for the survey question: Which of the following statements regarding instructors, generative AI, and the classroom use do you agree with the most? a. It is acceptable for instructors in my class to use generative AI for any task. b. It is unacceptable for instructors in my class to use generative AI for any task. c. Instructors can use generative AI for my class in a case-by-case basis. d. Not sure.
• Figure 5: Results for the survey question: Which of the following provides the most factual information? a. Generative AI (i.e., ChatGPT, Gemini, etc.) b. Internet search (i.e., Google, Bing, etc.) c. Neither