Generative AI Competence and Student Engagement in Higher Education: Mediating Roles of Utilization, Autonomy, and Formal Learning

Samuel Nii Adamah Sampah; Macharious  Nabang; Elikem Kofi  Krampa; Mustapha  Issah; Francis  Koduah; Harry Barton  Essel; Joe  Adu-Agyem

doi:10.32674/3s3cx241

Authors

Samuel Nii Adamah Sampah Ho Technical University https://orcid.org/0000-0002-9753-0694
Macharious Nabang Bagabaga College of Education, Tamale, Northern Region, Ghana. https://orcid.org/0009-0008-4233-219X
Elikem Kofi Krampa Ho Technical University https://orcid.org/0000-0001-9160-6160
Mustapha Issah Center for National Culture https://orcid.org/0000-0002-1800-5980
Francis Koduah Visual Art Department, Adventist Girls SHS https://orcid.org/0009-0009-8957-7546
Harry Barton Essel Kwame Nkrumah University of Science and Technology https://orcid.org/0000-0001-7232-3640
Joe Adu-Agyem Kwame Nkrumah University of Science and Technology

DOI:

https://doi.org/10.32674/3s3cx241

Keywords:

AI formal learning, Educational implication, GenAI competence, GenAI utilization, Perceived autonomy, Students’ engagement

Abstract

This study investigates university students' competence and engagement with Generative AI applications, analyzing usage, perceived autonomy, and AI formal learning as predictive mediators. The study used a cross-sectional survey design to collect data from 262 students across various disciplines. Analysis using PLS-SEM revealed that GenAI competence is a powerful, direct driver of students’ engagement (β = 0.255, p < 0.001), accounting for 64.5% of its variance (R² = 0.645), with the direct path showing a small to medium effect size (f² = 0.117). This relationship is significantly mediated through three distinct pathways: GenAI utilization (β = 0.155, p < 0.001), Perceived Autonomy (β = 0.121, p = 0.005), and AI Formal Learning (β = 0.092, p = 0.005).

Author Biographies

Samuel Nii Adamah Sampah, Ho Technical University

Samuel Nii Adamah Sampah is a Lecturer in the Department of Industrial Art at Ho Technical University, Ghana. He holds both a Bachelor of Fine Arts and Master of Fine Arts in Sculpture from Kwame Nkrumah University of Science and Technology and is currently pursuing his PhD.
Macharious Nabang, Bagabaga College of Education, Tamale, Northern Region, Ghana.

Macharious Nabang is a lecturer at Bagabaga College of Education, Tamale, Northern Region, Ghana. He is currently pursuing a PhD at Kwame Nkrumah University of Science and Technology, Ghana.
Elikem Kofi Krampa , Ho Technical University

Elikem Kofi Krampa is a Lecturer at the Department of Mathematics and Statistics, Ho Technical University.
Mustapha Issah , Center for National Culture

Mustapha Issah is currently pursuing his PhD at the Department of Educational Innovations in Science and Technology - Kwame Nkrumah University of Science and Technology, Ghana.
Francis Koduah , Visual Art Department, Adventist Girls SHS

Francis Koduah is a versatile painter currently pursuing his PhD at the Department of Educational Innovations in Science and Technology - Kwame Nkrumah University of Science and Technology, Ghana.
Harry Barton Essel , Kwame Nkrumah University of Science and Technology

Prof. Harry Barton Essel is an accomplished Associate Professor in Art Design and Educational Technology at the Department of Educational Innovations in Science and Technology, Kwame Nkrumah University of Science and Technology (KNUST).
Joe Adu-Agyem , Kwame Nkrumah University of Science and Technology

Prof. Joe Adu-Agyem is an Associate Professor in Art Design and Educational Technology at the Department of Educational Innovations in Science and Technology, Kwame Nkrumah University of Science and Technology (KNUST).

References

A. de la Torre and M. Baldeon-Calisto (2024). Generative Artificial Intelligence in Latin American Higher Education: A Systematic Literature Review. 12th International Symposium on Digital Forensics and Security (ISDFS), San Antonio, TX, USA, 2024, pp. 1-7, https://doi.org/10.1109/ISDFS60797.2024.10527283

Acquah, B. Y. S., Arthur, F., Salifu, I., Mensah, E., Opoku, E., Nortey, S. A., & Tetteh, S. A. (2025). Modelling economics students’ use of ChatGPT and academic performance: insights from self-determination theory and epistemic curiosity. Discover Artificial Intelligence, 5(1), 1-24.

Acquah, B. Y. S., Arthur, F., Salifu, I., Quayson, E., & Nortey, S. A. (2024). Preservice teachers’ behavioural intention to use artificial intelligence in lesson planning: A dual-staged PLS-SEM-ANN approach. Computers and Education: Artificial Intelligence, 7, 100307.

Akour, I.A., Muhammad Alshurideh, H., Alzoubi, H.M., Alshurideh, M.T., & Ahmad Antouz, Y. (2023). Integrating Artificial Intelligence in Improving Educational System: The Mediating role of Smart Learning. 2023 International Conference on Business Analytics for Technology and Security (ICBATS), 1-5. https://doi.org/10.1109/ICBATS57792.2023.10111284

Almaiah, M. A., Ayouni, S., Hajjej, F., Lutfi, A., Almomani, O., & Awad, A. B. (2022). Smart Mobile Learning Success Model for higher Educational institutions in the context of the COVID-19 Pandemic. Electronics, 11(8), 1278. https://doi.org/10.3390/electronics11081278

Al-Zahrani, A. M. (2023). The impact of generative AI tools on researchers and research: Implications for academia in higher education. Innovations in Education and Teaching International, 1-15. https://doi.org/10.1080/14703297.2023.2271445

Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. https://doi.org/10.1037/0033-2909.103.3.411

Arthur, F., Salifu, I., & Abam Nortey, S. (2025). Predictors of higher education students’ behavioural intention and usage of ChatGPT: the moderating roles of age, gender and experience. Interactive Learning Environments, 33(2), 993-1019.

Benitez, J., Henseler, J., Castillo, A., & Schuberth, F. (2019). How to perform and report an impactful analysis using partial least squares: Guidelines for confirmatory and explanatory IS research. Information & Management, 57(2), 103168. https://doi.org/10.1016/j.im.2019.05.003

Bennett, E. E., & McWhorter, R. R. (2020). Digital technologies for teaching and learning. In The Handbook of Adult and Continuing Education (pp. 177-186). Routledge.

Boateng, R., Mbrokoh, A. S., Boateng, L., Senyo, P. K., & Ansong, E. (2016). Determinants of e-learning adoption among students of developing countries. International Journal of Information and Learning Technology, 33(4), 248–262. https://doi.org/10.1108/ijilt-02-2016-0008

Borah, A.R., T N, N., & Gupta, S. (2024). Improved Learning Based on GenAI. 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT), 1527-1532. https://doi.org/10.1109/IDCIoT59759.2024.10467943

Briones-Peñalver, A. J., Bernal-Conesa, J. A., & de Nieves-Nieto, C. (2018). Analysis of corporate social responsibility in Spanish agribusiness and its influence on innovation and performance. Corporate Social Responsibility and Environmental Management, 25(2), 182–193. https://doi.org/10.1002/csr.1448.

Chan, C.K., & Zhou, W. (2023). An expectancy value theory (EVT) based instrument for measuring student perceptions of generative AI. Smart Learning Environments, 10, 1-22. https://doi.org/10.1186/s40561-023-00284-4

Chasokela, D., & Hlongwane, J. (2024). Assessing Higher-Order and Critical skills in the era of Artificial Intelligence. In Advances in educational marketing, administration, and leadership book series (pp. 285–314). https://doi.org/10.4018/979-8-3693-6351-5.ch010

Chiu, T. K. (2021). Digital support for student engagement in blended learning based on self-determination theory. Computers in Human Behavior, 124, 106909. https://doi.org/10.1016/j.chb.2021.106909.

Chiu, T. K., Meng, H., Chai, C. S., King, I., Wong, S., & Yam, Y. (2021). Creation and evaluation of a pretertiary artificial intelligence (AI) curriculum. IEEE Transactions on Education, 65(1), 30-39. https://doi.org/10.1109/TE.2021.3085878

Choi, S. (2024). Investigating Students' Intentions to Use Generative AI in College Assignments: A Moderated Mediation Analysis of Perceived Unfairness and Detection Possibility. Korean Association For Learner-Centered Curriculum And Instruction. https://doi.org/10.22251/jlcci.2024.24.6.103

Chugh, R., Turnbull, D., Morshed, A., Sabrina, F., Azad, S., Mamunur, R. M., Kaisar, S., & Subramani, S. (2025). The Promise and Pitfalls: A Literature review of Generative Artificial intelligence as a learning assistant in ICT education. Computer Applications in Engineering Education, 33(2). https://doi.org/10.1002/cae.70002

Cohen, J. (1987). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587

Collie, R. J., & Martin, A. J. (2024). Teachers’ motivation and engagement to harness generative AI for teaching and learning: The role of contextual, occupational, and background factors. Computers and Education: Artificial Intelligence, 6, 100224.

Das, S., & Datta, B. (2024). Application of UTAUT2 on Adopting Artificial Intelligence Powered Lead Management System (AI-LMS) in passenger car sales. Technological Forecasting and Social Change, 201, 123241. https://doi.org/10.1016/j.techfore.2024.123241

Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319. https://doi.org/10.2307/249008

Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Springer Science & Business Media.

Devaki, V. (2024). Academic integrity and human cognitive development of learners. In Advances in educational marketing, administration, and leadership book series (pp. 195–222). https://doi.org/10.4018/979-8-3693-5443-8.ch007

Eke, D. O. (2023). ChatGPT and the rise of GenAI: Threat to academic integrity? Journal of Responsible Technology, 13, 100060. https://doi.org/10.1016/j.jrt.2023.100060

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 100198. https://doi.org/10.1016/j.caeai.2023.100198

Essel, H.B., Vlachopoulos, D., Tachie-Menson, A. Johnson, E. E., & Baah, P. K. (2022). The impact of a virtual teaching assistant (chatbot) on students' learning in Ghanaian higher education. Int J Educ Technol High Educ 19, 57. https://doi.org/10.1186/s41239-022-00362-6

Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American journal of theoretical and applied statistics, 5(1), 1-4. https://doi.org/10.11648/j.ajtas.20160501.11

Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104

Franke, G., & Sarstedt, M. (2019). Heuristics versus statistics in discriminant validity assessment: A meta-analysis. European Journal of Marketing, 53(11), 2432-2463.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059

Fredricks, J.A., McColskey, W. (2012). The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-report Instruments. In: Christenson, S., Reschly, A., Wylie, C. (eds) Handbook of Research on Student Engagement. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-2018-7_37

George, A. S., Baskar, T., & Srikaanth, P. B. (2024). The erosion of cognitive skills in the technological age: How reliance on technology impacts critical thinking, Problem-Solving, and creativity. puirp.com. https://doi.org/10.5281/zenodo.11671150

Ghimire, A. (2024). Generative AI in Education from the Perspective of Students, Educators, and Administrators. All Graduate Theses and Dissertations, from 2023 to Present. 124. https://digitalcommons.usu.edu/etd2023/124 https://doi.org/10.26076/c582-c0bc

Hair Jr, J., Hult, G. T., Ringle, C., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM) - Joseph F. Hair, Jr., G. Tomas M. Hult, Christian Ringle, Marko Sarstedt. In Sage (2nd ed.). SAGE Publications.

Hair Jr., J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate Data Analysis, (8th ed.). Cengage Learning, Hampshire, United Kingdom.

Heidari, E., Mehrvarz, M., Marzooghi, R., & Stoyanov, S. (2021). The role of digital informal learning in the relationship between students' digital competence and academic engagement during the COVID‐19 pandemic. Journal of Computer Assisted Learning, 37(4), 1154-1166.

Henseler, J., Dijkstra, T. K., Sarstedt, M., Ringle, C. M., Diamantopoulos, A., Straub, D. W., Ketchen, D. J., Hair, J. F., Hult, G. T. M., & Calantone, R. J. (2014). Common beliefs and reality about PLS. Organizational Research Methods, 17(2), 182–209. https://doi.org/10.1177/1094428114526928

Hidayat-Ur-Rehman, I. (2024). Digital competence and students’ engagement: a comprehensive analysis of smartphone utilization, perceived autonomy and formal digital learning as mediators. Interactive Technology and Smart Education. https://doi.org/10.1108/itse-09-2023-0189

Holec, H. (1981). Autonomy is the ability to take charge of one’s own learning.

Hsu, Y., & Ching, Y. (2023). Generative Artificial Intelligence in Education, Part One: the Dynamic Frontier. TechTrends, 67(4), 603–607. https://doi.org/10.1007/s11528-023-00863-9

Hu, L.T. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55

Kalota, F. (2024). A primer on generative artificial intelligence. Education Sciences, 14(2), 172. https://doi.org/10.3390/educsci14020172

Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learn. Individ. Differ. 103:102274. doi: https://doi.org/10.1016/j.lindif.2023.102274

Katz, E., Blumler, J. G., & Gurevitch, M. (1973). Uses and Gratifications research. The Public Opinion Quarterly, 37(4), 509–523. https://www.jstor.org/stable/2747854

Kelly, A., Sullivan, M., & Strampel, K. (2023). Generative artificial intelligence: University student awareness, experience, and confidence in use across disciplines. Journal of University Teaching & Learning Practice, 20(6). https://doi.org/10.53761/1.20.6.12

Khalikova, D. S. (2022). Autonomy In Language Teaching and Learning Process. International Journal of World Languages, 2(3).

Law, L. (2024). Application of generative artificial intelligence (GenAI) in language teaching and learning: A scoping literature review. Computers and Education Open, 100174. https://doi.org/10.1016/j.caeo.2024.100174

Liang J, Wang L, Luo J, Yan Y and Fan C (2023). The relationship between student interaction with generative artificial intelligence and learning achievement: serial mediating roles of self-efficacy and cognitive engagement. Front. Psychol. 14:1285392. https://doi.org/10.3389/fpsyg.2023.1285392

Masouleh, N. S., & Jooneghani, R. B. (2012). Autonomous learning: A teacher-less learning!. Procedia-Social and Behavioral Sciences, 55, 835-842. https://doi.org/10.1016/j.sbspro.2012.09.570

Nordhoff, S., Madigan, R., Van Arem, B., Merat, N., & Happee, R. (2020). Interrelationships among predictors of automated vehicle acceptance: a structural equation modelling approach. Theoretical Issues in Ergonomics Science, 1–26. https://doi.org/10.1080/1463922x.2020.1814446

Priamono, G.H., Hakim, A.R., & Daryono, R.W. (2024). The Influence of Artificial Intelligence (AI) and Mobile Learning on Learning Outcomes in Higher Education: Did the Mediation of Self-Competence Matter? Jurnal Penelitian dan Pengkajian Ilmu Pendidikan: e-Saintika. https://doi.org/10.36312/esaintika.v8i2.1902

Quarshie, A. N., Nkansah, G. B., & Oduro-Ofori, E. (2023). How Far Is Progress? Gender Dimensions of Student Enrollment in Higher Education in Ghana: The Case of Kwame Nkrumah University of Science and Technology. SAGE Open, 13(4). https://doi.org/10.1177/21582440231220456

R Core Team (2023). R: A Language and environment for statistical computing. (Version 4.3) [Computer software]. Retrieved from https://cran.r-project.org. (R packages retrieved from CRAN snapshot 2024-01-09).

Ringle, C.M., S. Wende, and J.-M. Becker (2022). SmartPLS 4. Oststeinbek: SmartPLS. Retrieved from https://www.smartpls.com/

Rosseel, Y., & Loh, W. W. (2024). A structural after measurement approach to structural equation modeling. Psychological Methods, 29(3), 561–588. https://doi.org/10.1037/met0000503

Rudolph, J., Ismail, M. F. B. M., & Popenici, S. (2024). Higher Education’s Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania. Journal of University Teaching and Learning Practice, 21(6), 1-35. https://doi.org/10.53761/54fs5e77

Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68.

Salifu, I., Arthur, F., Arkorful, V., Abam Nortey, S., & Solomon Osei-Yaw, R. (2024). Economics students’ behavioural intention and usage of ChatGPT in higher education: A hybrid structural equation modelling-artificial neural network approach. Cogent Social Sciences, 10(1), 2300177.

Soper D.S. (2023). A-priori sample size calculator for structural equation models [Computer Software]. Retrieved (July 15, 2024) from https://www.danielsoper.com/statcalc/calculator.aspx?id=8

Sullivan M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity. Journal of Applied Learning & Teaching, 6(1), 1-10. https://doi.org/10.37074/jalt.2023.6.1.17

Tarhini, A., Hone, K., Liu, X., & Tarhini, T. (2017). Examining the moderating effect of individual-level cultural values on users’ acceptance of E-learning in developing countries: a structural equation modeling of an extended technology acceptance model. Interactive Learning Environments, 25(3), 306-328. https://doi.org/10.1080/10494820.2015.1122635

The jamovi project (2024). jamovi. (Version 2.5) [Computer Software]. Retrieved from https://www.jamovi.org.

Tzirides, A. O., Saini, A., Zapata, G. C., Searsmith, D., Cope, B., Kalantzis, M., Castro, V., Kourkoulou, T., Jones, J., Abrantes da Silva, R., Whiting, J., & Kastania, N. P. (2023). GenAI: Implications and applications for education. ArXiv, abs/2305.07605. https://doi.org/10.48550/arXiv.2305.07605

Ursachi, G., Horodnic, I. A., & Zait, A. (2015). How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Economics and Finance, 20(15), 679–686. https://doi.org/10.1016/S2212-5671(15)00123-9

Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540

Widaman, K. F., & Revelle, W. (2023). Thinking thrice about sum scores, and then some more about measurement and analysis. Behavior research methods, 55(2), 788-806.

Xie, Z., Wu, X., & Xie, Y. (2024). Can interaction with generative artificial intelligence enhance learning autonomy? A longitudinal study from comparative perspectives of virtual companionship and knowledge acquisition preferences. J. Comput. Assist. Learn., 40, 2369-2384. https://doi.org/10.1111/jcal.13032

Yang, H., & Kyun, S. (2022). The current research trend of artificial intelligence in language learning: A systematic empirical literature review from an activity theory perspective. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.7492

Yang, Y., Luo, J., Yang, M., Yang, R., & Chen, J. (2024). From surface to deep learning approaches with Generative AI in higher education: an analytical framework of student agency. Studies in Higher Education, 49, 817 - 830.

Zawacki-Richter, O., Marín, V.I., Bond, M. et al. Systematic review of research on artificial intelligence applications in higher education – where are the educators?. Int J Educ Technol High Educ 16, 39 (2019). https://doi.org/10.1186/s41239-019-0171-0

Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: a systematic review. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00316-7

Zhang, K., & Aslan, A. B. (2021). AI technologies for education: Recent research & future directions. Computers and Education Artificial Intelligence, 2, 100025. https://doi.org/10.1016/j.caeai.2021.100025