[Paper Review] Deconstructing Student Perceptions of Generative AI (GenAI) through an Expectancy Value Theory (EVT)-based Instrument

Cecilia Ka Yuk Chan, Wenxin Zhou|arXiv (Cornell University)|May 2, 2023

Ethics and Social Impacts of AI40 citations

TL;DR

The paper develops an EVT-based questionnaire to measure students' knowledge, perceived value, and perceived cost of GenAI and tests its relation to intention to use in higher education. Using a sample of 405 students and confirmatory factor analysis, it finds a strong positive link between perceived value and intention to use, and a weak negative link for perceived cost.

ABSTRACT

This study examines the relationship between student perceptions and their intention to use generative AI in higher education. Drawing on Expectancy-Value Theory (EVT), a questionnaire was developed to measure students' knowledge of generative AI, perceived value, and perceived cost. A sample of 405 students participated in the study, and confirmatory factor analysis was used to validate the constructs. The results indicate a strong positive correlation between perceived value and intention to use generative AI, and a weak negative correlation between perceived cost and intention to use. As we continue to explore the implications of generative AI in education and other domains, it is crucial to carefully consider the potential long-term consequences and the ethical dilemmas that may arise from widespread adoption.

Motivation & Objective

• Investigate how EVT constructs relate to students' intention to use Generative AI in higher education.
• Develop and validate a questionnaire measuring knowledge of GenAI, perceived value, and perceived cost.
• Examine the relationships among EVT constructs and intention to use GenAI.

Proposed method

• Developed a novel EVT-based questionnaire to assess knowledge, perceived value, and perceived cost of GenAI.
• Collected data from 405 students in higher education.
• Used confirmatory factor analysis to validate the measurement model.
• Examined correlations between perceived value/cost and intention to use GenAI.

Experimental results

Research questions

• RQ1 What is the structure and reliability of an EVT-based instrument for GenAI perceptions?
• RQ2 How do knowledge, perceived value, and perceived cost relate to students' intention to use GenAI?
• RQ3 Are there strong positive or negative associations between perceived value/cost and intention to use GenAI?

Key findings

• There is a strong positive correlation between perceived value and intention to use GenAI.
• There is a weak negative correlation between perceived cost and intention to use GenAI.
• The EVT-based instrument demonstrates construct validity via confirmatory factor analysis.