The university library will be closed from December 20, 2025 to January 11, 2026. From January 12, 2026, regular opening hours will apply again. Exception: The main medical library and the central library will be open again from January 5, 2026. Further information
  • A Comparison of Generative AI...

Result: A Comparison of Generative AI Solutions and Textbook Solutions in an Introductory Programming Course

Title:
A Comparison of Generative AI Solutions and Textbook Solutions in an Introductory Programming Course
Language:
English
Authors:
Ernst Bekkering, Patrick Harrington
Source:
Information Systems Education Journal. 2025 23(1):4-22.
Availability:
Information Systems and Computing Academic Professionals. Box 488, Wrightsville Beach, NC 28480. e-mail: publisher@isedj.org; Web site: http://isedj.org
Peer Reviewed:
Y
Page Count:
19
Publication Date:
2025
Document Type:
Academic journal Journal Articles<br />Reports - Research
Education Level:
Higher Education
Postsecondary Education
Descriptors:
Higher Education, Artificial Intelligence, Programming, Textbook Evaluation, Comparative Analysis, Technology Uses in Education, Technology Integration, Technological Advancement, Computer Science Education, Problem Solving
ISSN:
1545-679X
Entry Date:
2025
Accession Number:
EJ1462116
Database:
ERIC

Further information

Generative AI has recently gained the ability to generate computer code. This development is bound to affect how computer programming is taught in higher education. We used past programming assignments and solutions for textbook exercises in our introductory programming class to analyze how accurately one of the leading models, ChatGPT, generates solutions. We selected the ChatGPT-4 available through the Bing search engine for our testing. We used a one-tailed test to calculate success percentage of the textbook versus ChatGPT solutions to determine if there was a statistically significant difference. Neither the book nor ChatGPT provided perfect solutions. Analysis of the results showed that the generated code does not always meet the programming requirements, but also that instructions for generative AI coding and for traditional programming can be improved. We conclude with recommendations for incorporating generative AI in programming classes. [Note: The publication year (2024) shown in the citation on the PDF is incorrect. The correct publication year is 2025.]

As Provided