Prompt-based instructional design in artificial intelligence-supported programming education
DOI:
https://doi.org/10.29352/mill0230.45667Keywords:
prompt-based instruction; generative artificial intelligence; programming education; computational thinking; self-regulated learningAbstract
Introduction: The rapid integration of generative artificial intelligence (AI) into programming education has transformed prompting from a technical interaction technique into a relevant instructional practice. However, research in higher education remains fragmented.
Objective: To synthesize empirical studies on prompt-based instruction in AI-supported programming education, examining conceptualizations, implementation strategies, learning outcomes, and research gaps.
Methods: A systematic review following PRISMA 2020 guidelines was conducted. Searches in Scopus and Web of Science identified peer-reviewed publications between 2023 and 2025. Twenty studies met the inclusion criteria and were analyzed through thematic synthesis.
Results: Prompting was conceptualized as a technical skill, iterative workflow process, self-regulatory mechanism, computational thinking scaffold, and system-embedded instructional feature. Structured scaffolds, including prompt templates, progressive prompting, and debugging cycles, were associated with improvements in computational thinking and interaction behaviors. Evidence for sustained learning gains remains limited.
Conclusion: Prompt-based instructional design is an emerging pedagogical domain whose effectiveness depends on alignment with computational thinking and self-regulated learning principles. Further longitudinal and theory-driven research is needed.
Downloads
References
Alves, P., & Pereira Cipriano, B. (2025). “Give me the code”: Log analysis of first-year CS students’ interactions with GPT. Proceedings of the International Conference on Computer Supported Education (CSEDU), 2. https://doi.org/10.5220/0013194400003932
Arora, U., Garg, A., Gupta, A., Jain, S., Mehta, R., Oberoi, R., Prachi, Raina, A., Saini, M., Sharma, S., Singh, J., Tyagi, S., & Kumar, D. (2025). Analyzing LLM usage in an advanced computing class in India. Proceedings of the 27th Australasian Computing Education Conference (ACE 2025). https://doi.org/10.1145/3716640.3716657
Aruleba, K., Sanusi, I. T., Obaido, G., Ogbuokiri, B., & Mienye, I. D. (2025). Beyond the prompt: Student strategies, ethical reflections, and learning with ChatGPT in computer science. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-025-09899-7
Becker, B. A., Denny, P., Finnie-Ansley, J., Luxton-Reilly, A., Prather, J., & Santos, E. A. (2023). Programming Is hard - or at least it used to be: Educational opportunities and challenges of AI code generation. Proceedings of the 54th ACM Technical Symposium on Computer Science Education (SIGSE 2023) 1. https://doi.org/10.1145/3545945.3569759
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems.
Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4). https://doi.org/10.1080/00461520.2014.965823
Finnie-Ansley, J., Denny, P., Becker, B. A., Luxton-Reilly, A., & Prather, J. (2022). The robots are coming: Exploring the implications of OpenAI Codex on introductory programming. ACM International Conference Proceeding Series. https://doi.org/10.1145/3511861.3511863
Garg, A., Nisumba Soodhani, K., & Rajendran, R. (2025). Enhancing data analysis and programming skills through structured prompt training: The impact of generative AI in engineering education. Computers and Education: Artificial Intelligence, 8. https://doi.org/10.1016/j.caeai.2025.100380
Gong, X., Xu, W., & Qiao, A. (2025). Exploring undergraduates’ computational thinking and human-computer interaction patterns in generative progressive prompt-assisted programming learning. International Journal of Educational Technology in Higher Education, 22(1). https://doi.org/10.1186/s41239-025-00552-y
Gunturi, S. V., Blum, J., & Love, T. (2025). An evaluation of prompt engineering strategies by college students in competitive programming tasks. https://doi.org/10.18260/1-2--57608
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. The Center for Curriculum Redesign.
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Kazemitabaar, M., Ye, R., Wang, X., Henley, A. Z., Denny, P., Craig, M., & Grossman, T. (2024). CodeAid: Evaluating a classroom deployment of an LLM-based programming assistant that balances student and educator needs. Proceedings of the CHI Conference on Human Factors in Computing Systems. (60), 1-20. https://doi.org/10.1145/3613904.3642773
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005). A study of the difficulties of novice programmers. ACM SIGCSE Bulletin, 37(3). https://doi.org/10.1145/1151954.1067453
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023). Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. ACM Computing Surveys, 55(9). https://doi.org/10.1145/3560815
López-Pernas, S., Misiejuk, K., Oliveira, E., & Saqr, M. (2025). The dynamics of the self-regulation process in student-AI interactions The case of problem-solving in programming education. Proceedings of 25th International Conference on Computing Education Research (Koli Calling 2025). https://doi.org/10.1145/3769994.3770043
Maher, M. Lou, Tadimalla, S. Y., & Dhamani, D. (2023). An exploratory study on the impact of AI tools on the student experience in programming courses: An intersectional analysis approach. Proceedings of the IEEE Frontiers in Education Conference (FIE), 1–5. https://doi.org/10.1109/FIE58773.2023.10343037
Majumdar, R., Prasad, P., & Sane, A. (2024). Mining epistemic actions of programming problem solving with Chat-GPT. Proceedings of the International Conference on Educational Data Mining. https://doi.org/10.5281/zenodo.12729902
Menon, P. (2025). Quantifying shortfalls in students’ AI-supported programming practices. Issues in Information Systems, 26(1). https://doi.org/10.48009/1_iis_134
Mueller, M., List, C., & Kipp, M. (2025). The power of context: An LLM-based programming tutor with focused and proactive feedback. Proceedings of the European Conference on Software Engineering Education (ECSEE 2025). https://doi.org/10.1145/3723010.3723034
Mutanga, M. B., Msane, J., Mndaweni, T. N., Hlongwane, B. B., & Ngcobo, N. Z. (2025). Exploring the impact of LLM prompting on students’ learning. Trends in Higher Education, 4(3). https://doi.org/10.3390/higheredu4030031
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. The BMJ, 372. https://doi.org/10.1136/bmj.n71
Rachmat, A., Watterson, C., & Lundqvist, K. (2025). The impact of chatbots on students’ reflective thinking in introductory programming course. Proceedings of the IEEE Global Engineering Education Conference (EDUCON). https://doi.org/10.1109/EDUCON62633.2025.11016417
Robins, A., Rountree, J., & Rountree, N. (2003). Learning and teaching programming: A review and discussion. Computer Science Education, 13(2). https://doi.org/10.1076/csed.13.2.137.14200
Roy, N., Horielko, O., & Omojokun, O. (2025). Integrating AI tools in advanced computer science curricula: A case study of course redesign. Proceedings of the ACM Global Computing Education Conference (CompEd 2025), 1. https://doi.org/10.1145/3736181.3747130
Scholl, A., Schiffner, D., & Kiesler, N. (2024). Analyzing chat protocols of novice programmers solving introductory programming tasks with ChatGPT. Lecture Notes in Informatics (LNI), P-356. https://doi.org/10.18420/delfi2024_05
Servín, C., Karichev, N. V., & Pagel, M. (2024). Unfolding programming: How to use AI tools in introductory computing courses. Proceedings of the Annual Conference on Information Technology Education (SIGITE 2024). https://doi.org/10.1145/3686852.3687073
Sun, D., Boudouaia, A., Yang, J., & Xu, J. (2024). Investigating students’ programming behaviors, interaction qualities and perceptions through prompt-based learning in ChatGPT. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03991-6
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4
Tripaldelli, A., Pozek, G., & Butka, B. (2024). Leveraging prompt engineering on ChatGPT for enhanced learning in CEC330: Digital system design in aerospace. Proceedings of the IEEE Global Engineering Education Conference (EDUCON). https://doi.org/10.1109/EDUCON60312.2024.10578705
Urhan, S., & Kocadere, S. A. (2024). Problem-solving through pair-programming: The mediational role of ChatGPT. Proceedings of the International Conference in Electronic Engineering, Information Technology and Education (EEITE 2024). https://doi.org/10.1109/EEITE61750.2024.10654434
vanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. In Educational Psychologist 46(4). https://doi.org/10.1080/00461520.2011.611369
Wightman, P. (2024). Twisted games: A first experience of inclusion of AI tools in first year programming classes. Proceedings of the IEEE Latin American Conference on Computational Intelligence (LA-CCI 2024). https://doi.org/10.1109/LA-CCI62337.2024.10814750
Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2). https://doi.org/10.1111/j.1469-7610.1976.tb00381.x
Zhai, X. (2023). ChatGPT for next generation science learning. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4331313
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice 41(2). https://doi.org/10.1207/s15430421tip4102_2
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Millenium - Journal of Education, Technologies, and Health
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who submit proposals for this journal agree to the following terms:
a) Articles are published under the Licença Creative Commons (CC BY 4.0), in full open-access, without any cost or fees of any kind to the author or the reader;
b) The authors retain copyright and grant the journal right of first publication, allowing the free sharing of work, provided it is correctly attributed the authorship and initial publication in this journal;
c) The authors are permitted to take on additional contracts separately for non-exclusive distribution of the version of the work published in this journal (eg, post it to an institutional repository or as a book), with an acknowledgment of its initial publication in this journal;
d) Authors are permitted and encouraged to publish and distribute their work online (eg, in institutional repositories or on their website) as it can lead to productive exchanges, as well as increase the impact and citation of published work
Documents required for submission
Article template (Editable format)
