Exploring Student Preference Between AI-Powered ChatGPT and Human-Curated Stack Overflow in Resolving Programming Problems and Queries
2023 IEEE 15th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM)
Garcia, Manuel B.
Educational Innovation and Technology Hub
FEU Institute of Technology, Philippines
Revano Jr., Teodoro F.
College of Computer Studies and Multimedia Arts
FEU Institute of Technology, Philippines
Maaliw III, Renato. R.
College of Engineering
Southern Luzon State University, Philippines
Lagrazon, Pitz Gerald G.
College of Engineering
Southern Luzon State University, Philippines
Valderama, Arlene Mae C.
College of Computer Studies & Engineering
Jose Rizal University, Philippines
Happonen, Ari
School of Engineering Science
LUT University, Finland
Qureshi, Basit
College of Computer and Information Sciences
Prince Sultan University, Saudi Arabia
Yilmaz, Ramazan
Faculty of Science
Bartin University, Turkey
Abstract: Among computer programmers and developers, the user-oriented question-and-answer website of Stack Overflow is a useful platform for sourcing solutions to programming problems, exchanging insights, and accessing a wealth of shared knowledge. However, the timeliness of responses on this platform is frequently a limiting factor that ChatGPT could potentially address. The goal of this study was to explore the preferences of novice programmers between these platforms for finding answers to their programming questions. Anchored in the Technology Acceptance Model (TAM) and the Information Foraging Theory (IFT), the study investigates users' perceptions of usefulness, ease of use, information scent, cognitive effort, as well as overall preferences. Our findings show discernible variations in preferences within the group of students (i.e., application and website developers). In line with these results, we discussed theoretical and practical implications and suggested a dual-pronged approach to leverage both environments as coding assistants in computer programming education.
Keywords: ChatGPT, Stack Overflow, Computer Programming, Large Language Models, Artificial Intelligence, Problem Solving
Recommended Citation:
Garcia, M. B., Revano Jr., T. F., Maaliw III, R. R., Lagrazon, P. G. G., Valderama, A. M. C., Happonen, A., Qureshi, B., & Yilmaz, R. (2023). Exploring Student Preference Between AI-Powered ChatGPT and Human-Curated Stack Overflow in Resolving Programming Problems and Queries. 2023 IEEE 15th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), 1-6. https://doi.org/10.1109/HNICEM60674.2023.10589162.