ChatGPT as a Pedagogical Tool: Measuring Its Influence on Cognitive Engagement and Academic Achievement of Biology Students
Abstract
Abstract: Artificial intelligence technology has been integrated into educational practices and is considered to have a significant influence in improving the teaching and learning process. Biology is one of the science subjects considered as a complex subject and requires deep understanding. The presence of ChatGPT answers the existing problems by offering personalized explanations, interactive feedback, and structured answer recommendations to improve students' understanding and critical thinking. The application of artificial intelligence such as ChatGPT to educational practices has opened up new opportunities to improve learning processes and outcomes. This study explores the effect of using ChatGPT as a pedagogical tool on cognitive engagement and academic achievement of Biology students. This study uses a cross-sectional quantitative survey method with Structural Equation Modeling analysis. The research sample was Biology students consisting of three different batches. The results showed that ChatGPT as a pedagogical tool significantly increased students' cognitive engagement, which then could also mediate its effect on students' academic achievement. In addition, cognitive engagement also has an impact on the formation of Biology students' academic achievement. In general, these findings highlight a good relationship between ChatGPT use, cognitive engagement, and academic achievement, and underline its potential to create a student-centered adaptive learning environment. However, ChatGPT also has some drawbacks, such as over-reliance on technology by students, potential errors in assessment, and inequity related to access to computer devices. This study shows the importance of introducing and using artificial intelligence technology in learning strategies. The results can also provide recommendations for the development of AI in education from a research perspective for educators to make decisions. Further research is needed to explore the relationship in various educational contexts and populations.
Keywords: ChatGPT, cognitive engagement, academic achievement, biology students.
DOI: http://dx.doi.org/10.23960/jpmipa/v26i1.pp36-50
Full Text:
PDFReferences
Ajlouni, A. O. (2023). Students’ attitudes towards using chatgpt as a learning tool: the case of the university of Jordan. International Journal of Interactive Mobile Technologies (Ijim). https://doi.org/10.3991/ijim.v17i18.41753
Alshehri, B. (2023). Pedagogical paradigms in the ai era: insights from saudi educators on the long-term implications of ai integration in classroom teaching. Ijesa. https://doi.org/10.59992/ijesa.2023.v2n8p7
Barclay, D. W., & Thomson, R. (1995). The partial least squares (pls) approach to causal modeling, personal computer adoption and use as an illustration. Technology Studies, 2(2), 296–297.
Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology. https://doi.org/10.1037//0022-3514.51.6.1173
Celik, I. (2024). The affordances of artificial intelligence-based tools for supporting 21st-century skills: Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.9069
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A Review. Ieee Access. https://doi.org/10.1109/access.2020.2988510
Dai, W. (2023). Can large language models provide feedback to students? a case study on ChatGPT. https://doi.org/10.1109/icalt58122.2023.00100
Dao, P., & McDonough, K. (2018). Effect of proficiency on vietnamese efl learners’ engagement in peer interaction. International Journal of Educational Research. https://doi.org/10.1016/j.ijer.2018.01.008
El-Mansy, S. Y., Barbera, J., & Hartig, A. J. (2022). Investigating small-group cognitive engagement in general chemistry learning activities using qualitative content analysis and the ICAP Framework. Chemistry Education Research and Practice. https://doi.org/10.1039/d1rp00276g
Fornell, C., & F. larcke, D. (1981). Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.
Gökoğlu, S. (2024). Challenges and limitations of generative ai in education. https://doi.org/10.4018/979-8-3693-1351-0.ch008
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24.
Haqqu, R. (2024). Interaction process between humans and chatgpt in the context of interpersonal communication. Jurnal Ilmiah Liski (Lingkar Studi Komunikasi). https://doi.org/10.25124/liski.v10i1.7216
Hasanein, A. M. (2023). Drivers and consequences of chatgpt use in higher education: key stakeholder perspectives. European Journal of Investigation in Health Psychology and Education. https://doi.org/10.3390/ejihpe13110181
Henseler, J. (2012). PLS-MGA: A Non-parametric approach to partial least squares-based multi-group analysis. In W. A. Gaul, A. Geyer-Schulz, L. Schmidt-Thieme, & J. Kunze (Eds.), Challenges at the Interface of Data Analysis, Computer Science, and Optimization (pp. 495–501). Springer Berlin Heidelberg.
Hesam, M., & Abedi, A. (2020). Enhancing academic engagement of underachieving gifted students: the effects of martin’s educational program. Journal of Education and Health Promotion. https://doi.org/10.4103/jehp.jehp_715_19
Huesca, G. (2024). Effectiveness of using chatgpt as a tool to strengthen benefits of the flipped learning strategy. Education Sciences. https://doi.org/10.3390/educsci 14060660
Ibrahim, A. B. (2024). Assessing the knowledge and perception of artificial intelligence for teaching and research among lecturers in the faculties of arts in Nigeria. Journal of Global Research in Education and Social Science. https://doi.org/10.56557/jogress/2024/v18i28671
Jacob, M., Putri, Y. W., & Sihombing, S. O. (2020). Predicting green product purchase: applying a cognitive-affective-behavior hierarchy. Jurnal Siasat Bisnis. https://doi.org/10.20885/jsb.vol24.iss2.art1
Jamaluddin, A. Bin, Palennari, M., Fatmawati, A., & Rosba, E. (2023). SIRI learning model in empowering biology students’ critical thinking. Jurnal Penelitian Pendidikan IPA, 9(SpecialIssue), 22–29. https://doi.org/10.29303/jppipa.v9i specialissue.5511
Jang Jaya, R. S. (2018). The influence of transformational leadership on organizational commitment and job satisfaction with procedural justice as mediating variable. Benefit Jurnal Manajemen Dan Bisnis. https://doi.org/10.23917/benefit.v3i1.5155
Khan, H. A., Gul, R., & Zeb, M. (2023). The effect of students’ cognitive and emotional engagement on students’ academic success and academic productivity. Journal of Social Sciences Review. https://doi.org/10.54183/jssr.v3i1.141
Lehmeidi Dong, M., Feng, Z., McLamb, F., Griffin, L., Vazquez, A., Hirata, K. K., Bozinovic, L., Vasquez, M. F., & Bozinovic, G. (2023). Life science research immersion program improves stem-specific skills and science attitudes among precollege students. Journal of Microbiology & Biology Education, 24(1). https://doi.org/10.1128/jmbe.00078-22
Lumsden, J., Edwards, E. A., Lawrence, N., Coyle, D., & Munafò, M. R. (2016). Gamification of cognitive assessment and cognitive training: a systematic review of applications and efficacy. Jmir Serious Games. https://doi.org/10.2196/ games.5888
M. Manahan, M. J. (2024). learning environment and factors of academic performance among BSED Students. International Journal of Research Publications. https://doi.org/10.47119/ijrp1001431220246138
Mayarni, M., & Nopiyanti, E. (2021). Critical and analytical thinking skill in ecology learning: a correlational study. Jpbi (Jurnal Pendidikan Biologi Indonesia). https://doi.org/10.22219/jpbi.v7i1.13926
Naibert, N., Vaughan, E., Brevick, K., & Barbera, J. (2022). Exploring student perceptions of behavioral, cognitive, and emotional engagement at the activity level in general chemistry. journal of chemical education. https://doi.org/10.1021/acs. jchemed.1c01051
Newton, P. M. (2023). ChatGPT performance on mcq exams in higher education. A Pragmatic Scoping Review. https://doi.org/10.35542/osf.io/sytu3
Niraula, S. (2024). The impact of chatgpt on academia: a comprehensive analysis of ai policies across ut system academic institutions. Advances in Mobile Learning Educational Research. https://doi.org/10.25082/amler.2024.01.009
Nkomo, L. M., & Daniel, B. K. (2021). Sentiment analysis of student engagement with lecture recording. Techtrends. https://doi.org/10.1007/s11528-020-00563-8
Park, W., & Kwon, H. (2023). Implementing artificial intelligence education for middle school technology education in Republic of Korea. International Journal of Technology and Design Education. https://doi.org/10.1007/s10798-023-09812-2
Petrova, M., Buzko, I., & Dyachenko, Y. (2018). Cognitive, intelligence technologies and economic foundations of teaching of international economic relations and tourism. https://doi.org/10.22616/erdev2018.17.n170
Samala, A. D. (2024). An in-Depth review of chatgpt’s pros and cons for learning and teaching in education. International Journal of Interactive Mobile Technologies (Ijim). https://doi.org/10.3991/ijim.v18i02.46509
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-021-00292-9
Setiawan, A. G. (2023). Student’s cognitive engagement in teaching vocabulary through mnemonic strategy. pedagogy Journal of English Language Teaching. https://doi.org/10.32332/joelt.v11i2.7658
Shaikh, S. (2023). Assessing the usability of chatgpt for formal english language learning. European Journal of Investigation in Health Psychology and Education. https://doi.org/10.3390/ejihpe13090140
Soffer, T., Kahan, T., & Nachmias, R. (2019). Patterns of students’ utilization of flexibility in online academic courses and their relation to course achievement. The International Review of Research in Open and Distributed Learning. https://doi.org/10.19173/irrodl.v20i4.3949
Sumbal, A. (2024). Can ChatGPT-3.5 pass a medical exam? a systematic review of chatgpt’s performance in academic testing. Journal of Medical Education and Curricular Development. https://doi.org/10.1177/23821205241238641
Tian, W. (2024). AI Chatbots in chinese higher education: adoption, perception, and influence among graduate students an integrated analysis utilizing utaut and ecm models. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1268549
Tolentino, R. (2024). Curriculum frameworks and educational programs in ai for medical students, residents, and practicing physicians: scoping review. Jmir Medical Education. https://doi.org/10.2196/54793
Truong, H.-L. (2023). ChatGPT in education - a global and vietnamese research overview. https://doi.org/10.35542/osf.io/r4uhd
Victor, D. (2024). Factors and impacts of chatgpt adoptionfor academic purposes in higher learning institutions: Students’ Perspectives. https://doi.org/10.31235/ osf.io/qkhs4
Wati, A. P., Martha, J. A., Indrawati, A., & Kamaludin, M. B. (2021). Optimizing the cognitive abilities of students through learning methods and web-enhanced course media. Kne Social Sciences. https://doi.org/10.18502/kss.v5i8.9389
Williams, R., Ali, S., Devasia, N., DiPaola, D., Hong, J., Kaputsos, S. P., Jordan, B. T., & Breazeal, C. (2022). AI + Ethics curricula for middle school youth: lessons learned from three project-based curricula. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-022-00298-y
Woo, H. S., Kim, J. H., Kim, J. M., & Lee, W. G. (2020). Exploring the AI topic composition of k-12 using nmf-based topic modeling. International Journal on Advanced Science Engineering and Information Technology. https://doi.org/10.18517/ijaseit.10.4.12787
Worthing, K. A. (2024). Surveyed veterinary students in australia find chatgpt practical and relevant while expressing no concern about artificial intelligence replacing veterinarians. Veterinary Record Open. https://doi.org/10.1002/vro2.80
Xu, S., & Li, W. (2022). A Tool or a social being? a dynamic longitudinal investigation of functional use and relational use of ai voice assistants. New Media & Society. https://doi.org/10.1177/14614448221108112
Xu, X. (2024). Opportunities, challenges, and future directions of large language models, including chatgpt in medical education: a systematic scoping review. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/ jeehp.2024.21.6
Zeb, A. (2024). Exploring the role of chatgpt in higher education: opportunities, challenges and ethical considerations. International Journal of Information and Learning Technology. https://doi.org/10.1108/ijilt-04-2023-0046
Zhu, H., Zeng, H., Zhang, H., Zhang, H., Feng-jing, W., Guo, H., & Zhang, C. (2018). The preferred learning styles utilizing vark among nursing students with bachelor degrees and associate degrees in China. Acta Paulista De Enfermagem. https://doi.org/10.1590/1982-0194201800024
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Jurnal Pendidikan MIPA
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The copyright is reserved to The Jurnal Pendidikan MIPA that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.