University Students' Perception and Use of ChatGPT: Generative Artificial Intelligence (AI) in Higher Education
Keywords:
ChatGPT, University Students, Generative AI, Artificial Intelligence, Higher Education, Philippines
Abstract
This quantitative study examined how university students perceive and use generative AI technology, specifically ChatGPT, in higher education. The main objective is to explore and describe university students' perception and use of generative AI, particularly ChatGPT, in the context of higher education. A 5-point Likert scale questionnaire was adopted and used in the study. Five hundred students from various universities in Region XI were surveyed using a stratified random sampling technique. Further, the validity and reliability of the scale used in the study were assessed using Cronbach's Alpha and Factor Analysis and demonstrated acceptable construct validity and reliability indices. The findings revealed that university students demonstrated high levels of understanding, knowledge, perception of the advantages and disadvantages, positive attitude, and strong intention to use generative AI technologies in the context of higher education. Moreover, the respondents showed a moderate level of concern about generative AI.
References
1. Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), ep429. https://doi.org/10.30935/cedtech/13152
2. Agbaglo, E., & Bonsu, E. M. (2022). The role of digital technologies In higher education during the coronavirus pandemic: Insights from a Ghanaian university. Social Education Research, 45-57. https://doi.org/10.37256/ser.3320221402
3. Ajlouni, A.O., Wahba, F.A.A., & Almahaireh, A.S.F (2023, September 20). Students' Attitude Towards Using ChatGPT as a Learning Tool: The Case of the University of Jordan. International journal of interactive mobile technologies. https://doi.org/10.3991/ijim.v17i18.41753
4. Aljanabi, M., Yaseen, M., Ali, A., & Abed, S. (2023). ChatGpt: Open Possibilities. Iraqi Journal for Computer Science and Mathematics, 1(2023), 62–64. https://doi.org/10.52866/20ijcsm.2023.01.01.0018
5. Baidoo-Anu, D., & Ansah, L. O. (2023, March 21). Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of.. ResearchGate. https://www.researchgate.net/publication/369385210_Education_in_the_Era_of_Generative_Artificial_Intelligence_AI_Understanding_the_Potential_Benefits_of_ChatGPT_in_Promoting_Teaching_and_Learning
6. Bartlett, M.S. (1937). Properties of Sufficiency and Statistical Test. Proceedings of the Royal Society A, pp. 160, 268–282. https://doi.org/10.1098/rspa.1937.0109
7. Biswas, S. (2023). Importance of chat GPT in agriculture: According to chat GPT.
8. Bonsu, E. and Baffour-Koduah, D. (2023). From the consumers' side: Determining students' perception and intention to use a chatbot in Ghanaian higher education.. https://doi.org/10.21203/rs.3.rs-2686760/v1
9. Božić, Velibor & Poola, Indrasen. (2023). Chat GPT and education. 10.13140/RG.2.2.18837.40168.
10. Chan, C.K.Y., Hu, W. Students' voices on generative AI: perceptions, benefits, and challenges in higher education. Int J Educ Technol High Educ 20, 43 (2023). https://doi.org/10.1186/s41239-023-00411-8
11. ChatGPT in higher education: Considerations for academic integrity and student learning. (2023, March 21). Journal of Applied Learning and Teaching. https://doi.org/10.37074/jalt.2023.6.1.17
12. Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User Acceptance of computer technology: A comparison of two theoretical models. Management Science, 35, 982– 1003. https://doi.org/10.1080/02602938.2017.1356906
13. Eke, D.O. (2023). ChatGPT and the rise of generative AI: Threat to academic integrity? Journal of Responsible Technology 13. 100060 https://doi.org/10.1016/j.jrt.2023.100060
14. Field, A. (2013) Discovering Statistics using SPSS, 4th edn. London: SAGE.
15. Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., Fuller, S., Singh, M., Arora, P., Parlikad, A. K., Stankovski, V., Abraham, A., Ghosh, S. K., Lutfiyya, H., Kanhere, S. S., Bahsoon, R., Rana, O., Dustdar, S., Sakellariou, R., . . . Buyya, R. (2024, January 1). Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots. Internet of Things and Cyber-Physical Systems. Retrieved November 5, 2023, from https://doi.org/10.1016/j.iotcps.2023.06.002
16. Guadagnoli, E. and Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103(2), pp. 265-275.
17. Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
18. Haleem, Abid & Javaid, Mohd & Qadri, Mohd & Suman, R. (2022). Understanding the Role of Digital Technologies in Education: A review. Sustainable Operations and Computers. 3. 10.1016/j.susoc.2022.05.004
19. Han, Z., Battaglia, F., Udaiyar, A., Fooks, A., & Terlecky, S. (2023). An explorative assessment of chatbot as an aid in medical education: use it with caution.. https://doi.org/10.1101/2023.02.13.23285879
20. Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2023). Using AI to Write Scholarly Publications. Accountability in Research, 1-9.
21. Hu, G. (2023). Challenges for Enforcing Editorial Policies on AI-Generated Papers. Accountability in research (just-accepted). https://doi.org/10.1080/08989621.2023.2184262
22. Huh, S. (2023). Are chatbot's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study. Journal of Educational Evaluation for Health Professions, pp. 20, 1. https://doi.org/10.3352/jeehp.2023.20.01
23. Kaiser, H. F. (1974). An index of factorial simplicity. psychometrika, 39(1), 31-36.
24. Kang, H. (2013). A guide on using factor analysis in the assessment of construct validity. Journal of Korean Academy of Nursing, 43(5), 587. https://doi.org/10.4040/jkan.2013.43.5.587
25. Kaebnick, G. E., Magnus, D., Kao, A., Hosseini, M., Resnik, D. B., Dubljević, V., Rentmeester, C. A., Gordijn, B., & Cherry, M. J. (2023). Editors’ statement on the responsible use of generative artificial intelligence technologies in scholarly journal publishing. Developing World Bioethics. https://doi.org/10.1111/dewb.12424
26. Kohnke, L., Moorhouse, B., & Zou, D. (2023). Chatgpt for language teaching and learning. Relc Journal, 54(2), 537-550. https://doi.org/10.1177/00336882231162868
27. Kuzdeuov, A., Nurgaliyev, S., & Varol, H. A. (2023, February 13). ChatGPT for the Visually Impaired and Blind. https://doi.org/10.36227/techrxiv.22047080.v1
28. Mejia, M. and Sargent, J. (2023). Leveraging technology to develop students' critical thinking skills. Journal of Educational Technology Systems, 51(4), 393-418. https://doi.org/10.1177/00472395231166613
29. Mhlanga, D. (2023). Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. SSRN: 4354422. http://dx.doi.org/10.2139/ssrn.4354422
30. Moqbel, M. S. S., & Al-Kadi, A. M. T. (2023). Foreign language learning assessment in the age of ChatGPT: A theoretical account. Journal of English Studies in Arabia Felix, 2(1), 71- 84. https://doi.org/10.56540/jesaf.v2i1.62.
31. Ngo, A. (2023, September 14). The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning. (ijet). https://doi.org/10.3991/ijet.v18i17.39019
32. Omar Ibrahim Obaid, Ahmed Hussein Ali, & Yaseen, M. G. (2023). Impact of Chat GPT on Scientific Research: Opportunities, Risks, Limitations, and Ethical Issues. Iraqi Journal for Computer Science and Mathematics, 13–17. https://doi.org/10.52866/ijcsm.2023.04.04.002
33. Owens, B. (2023, February 20). How Nature readers are using ChatGPT. Nature; Nature Portfolio. https://doi.org/10.1038/d41586-023-00500-8
34. Raman, R., Mandal, S., Das, P., Kaur, T., JP, S., & Nedungadi, P. (2023). University students as early adopters of chatbot: innovation diffusion study. https://doi.org/10.21203/rs.3.rs-2734142/v1
35. Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., Sun, M., Day, I., Rather, R. A., & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning & Teaching, 6(1), 1-16. Advanced publication. https://doi.org/10.37074/jalt.2023.6.1.29.
36. Rudolph, J. (2023). Editorial 5(SI1): Technology and education: Innovation or hindrance? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2022.5.s1.1
37. Scherer, R., Siddiq, F., & Tondeur, J. (2019). The technology Aacceptancemodel (TAM): A meta-analytic structural equation modeling approach to explaining teachers' adoption of digital technology in education. Computers & Education, 128, 13-35
38. Shaikh, S., Yayilgan, S.Y., Klímová, B., & Pikhart, M. (2023). Assessing the usability of ChatGPT for formal English language learning. European Journal of Investigation in Health, Psychology, and Education, 13(9), 1937-1960. https://doi.org/10.3390/ejihpe13090140
39. Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2
40. Su, J. and Yang, W. (2023). Unlocking the power of ChatGPT: a framework for applying generative AI in education. Ecnu Review of Education, 6(3), 355-366. https://doi.org/10.1177/20965311231168423
41. Taber, K.S. (2018). The Use of Cronbach's Alpha When Developing and Reporting Research Instruments in Science Education. Res Sci Educ 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
42. Uddin, S., Albert, A., Ovid, A., & Alsharef, A. (2023). Leveraging chatbots to aid construction hazard recognition and support safety education and training. Sustainability, 15(9), 7121. https://doi.org/10.3390/su15097121
43. Vincent-Lancrin, S. and R. van der Vlies (2020). "Trustworthy artificial intelligence (AI) in education: Promises and challenges," OECD Education Working Papers, No. 218, OECD Publishing, Paris, https://doi.org/10.1787/a6c90fa9-en.
44. Witkovský, V. (2019). Computing the exact distribution of Bartlett's test statistic by numerical inversion of its characteristic function. Journal of Applied Statistics, 47(13–15), 2749–2764. https://doi.org/10.1080/02664763.2019.1675608
45. Wood, E., Ange, B., & Miller, D. (2021). Are we ready to integrate artificial intelligence literacy into the medical school curriculum: students and a faculty survey. Journal of Medical Education and Curricular Development, 8, 238212052110240. https://doi.org/10.1177/23821205211024078
46. Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3), 035027. https://doi.org/10.1088/1361-6552/acc5cf
2. Agbaglo, E., & Bonsu, E. M. (2022). The role of digital technologies In higher education during the coronavirus pandemic: Insights from a Ghanaian university. Social Education Research, 45-57. https://doi.org/10.37256/ser.3320221402
3. Ajlouni, A.O., Wahba, F.A.A., & Almahaireh, A.S.F (2023, September 20). Students' Attitude Towards Using ChatGPT as a Learning Tool: The Case of the University of Jordan. International journal of interactive mobile technologies. https://doi.org/10.3991/ijim.v17i18.41753
4. Aljanabi, M., Yaseen, M., Ali, A., & Abed, S. (2023). ChatGpt: Open Possibilities. Iraqi Journal for Computer Science and Mathematics, 1(2023), 62–64. https://doi.org/10.52866/20ijcsm.2023.01.01.0018
5. Baidoo-Anu, D., & Ansah, L. O. (2023, March 21). Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of.. ResearchGate. https://www.researchgate.net/publication/369385210_Education_in_the_Era_of_Generative_Artificial_Intelligence_AI_Understanding_the_Potential_Benefits_of_ChatGPT_in_Promoting_Teaching_and_Learning
6. Bartlett, M.S. (1937). Properties of Sufficiency and Statistical Test. Proceedings of the Royal Society A, pp. 160, 268–282. https://doi.org/10.1098/rspa.1937.0109
7. Biswas, S. (2023). Importance of chat GPT in agriculture: According to chat GPT.
8. Bonsu, E. and Baffour-Koduah, D. (2023). From the consumers' side: Determining students' perception and intention to use a chatbot in Ghanaian higher education.. https://doi.org/10.21203/rs.3.rs-2686760/v1
9. Božić, Velibor & Poola, Indrasen. (2023). Chat GPT and education. 10.13140/RG.2.2.18837.40168.
10. Chan, C.K.Y., Hu, W. Students' voices on generative AI: perceptions, benefits, and challenges in higher education. Int J Educ Technol High Educ 20, 43 (2023). https://doi.org/10.1186/s41239-023-00411-8
11. ChatGPT in higher education: Considerations for academic integrity and student learning. (2023, March 21). Journal of Applied Learning and Teaching. https://doi.org/10.37074/jalt.2023.6.1.17
12. Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User Acceptance of computer technology: A comparison of two theoretical models. Management Science, 35, 982– 1003. https://doi.org/10.1080/02602938.2017.1356906
13. Eke, D.O. (2023). ChatGPT and the rise of generative AI: Threat to academic integrity? Journal of Responsible Technology 13. 100060 https://doi.org/10.1016/j.jrt.2023.100060
14. Field, A. (2013) Discovering Statistics using SPSS, 4th edn. London: SAGE.
15. Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., Fuller, S., Singh, M., Arora, P., Parlikad, A. K., Stankovski, V., Abraham, A., Ghosh, S. K., Lutfiyya, H., Kanhere, S. S., Bahsoon, R., Rana, O., Dustdar, S., Sakellariou, R., . . . Buyya, R. (2024, January 1). Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots. Internet of Things and Cyber-Physical Systems. Retrieved November 5, 2023, from https://doi.org/10.1016/j.iotcps.2023.06.002
16. Guadagnoli, E. and Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103(2), pp. 265-275.
17. Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
18. Haleem, Abid & Javaid, Mohd & Qadri, Mohd & Suman, R. (2022). Understanding the Role of Digital Technologies in Education: A review. Sustainable Operations and Computers. 3. 10.1016/j.susoc.2022.05.004
19. Han, Z., Battaglia, F., Udaiyar, A., Fooks, A., & Terlecky, S. (2023). An explorative assessment of chatbot as an aid in medical education: use it with caution.. https://doi.org/10.1101/2023.02.13.23285879
20. Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2023). Using AI to Write Scholarly Publications. Accountability in Research, 1-9.
21. Hu, G. (2023). Challenges for Enforcing Editorial Policies on AI-Generated Papers. Accountability in research (just-accepted). https://doi.org/10.1080/08989621.2023.2184262
22. Huh, S. (2023). Are chatbot's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study. Journal of Educational Evaluation for Health Professions, pp. 20, 1. https://doi.org/10.3352/jeehp.2023.20.01
23. Kaiser, H. F. (1974). An index of factorial simplicity. psychometrika, 39(1), 31-36.
24. Kang, H. (2013). A guide on using factor analysis in the assessment of construct validity. Journal of Korean Academy of Nursing, 43(5), 587. https://doi.org/10.4040/jkan.2013.43.5.587
25. Kaebnick, G. E., Magnus, D., Kao, A., Hosseini, M., Resnik, D. B., Dubljević, V., Rentmeester, C. A., Gordijn, B., & Cherry, M. J. (2023). Editors’ statement on the responsible use of generative artificial intelligence technologies in scholarly journal publishing. Developing World Bioethics. https://doi.org/10.1111/dewb.12424
26. Kohnke, L., Moorhouse, B., & Zou, D. (2023). Chatgpt for language teaching and learning. Relc Journal, 54(2), 537-550. https://doi.org/10.1177/00336882231162868
27. Kuzdeuov, A., Nurgaliyev, S., & Varol, H. A. (2023, February 13). ChatGPT for the Visually Impaired and Blind. https://doi.org/10.36227/techrxiv.22047080.v1
28. Mejia, M. and Sargent, J. (2023). Leveraging technology to develop students' critical thinking skills. Journal of Educational Technology Systems, 51(4), 393-418. https://doi.org/10.1177/00472395231166613
29. Mhlanga, D. (2023). Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. SSRN: 4354422. http://dx.doi.org/10.2139/ssrn.4354422
30. Moqbel, M. S. S., & Al-Kadi, A. M. T. (2023). Foreign language learning assessment in the age of ChatGPT: A theoretical account. Journal of English Studies in Arabia Felix, 2(1), 71- 84. https://doi.org/10.56540/jesaf.v2i1.62.
31. Ngo, A. (2023, September 14). The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning. (ijet). https://doi.org/10.3991/ijet.v18i17.39019
32. Omar Ibrahim Obaid, Ahmed Hussein Ali, & Yaseen, M. G. (2023). Impact of Chat GPT on Scientific Research: Opportunities, Risks, Limitations, and Ethical Issues. Iraqi Journal for Computer Science and Mathematics, 13–17. https://doi.org/10.52866/ijcsm.2023.04.04.002
33. Owens, B. (2023, February 20). How Nature readers are using ChatGPT. Nature; Nature Portfolio. https://doi.org/10.1038/d41586-023-00500-8
34. Raman, R., Mandal, S., Das, P., Kaur, T., JP, S., & Nedungadi, P. (2023). University students as early adopters of chatbot: innovation diffusion study. https://doi.org/10.21203/rs.3.rs-2734142/v1
35. Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., Sun, M., Day, I., Rather, R. A., & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning & Teaching, 6(1), 1-16. Advanced publication. https://doi.org/10.37074/jalt.2023.6.1.29.
36. Rudolph, J. (2023). Editorial 5(SI1): Technology and education: Innovation or hindrance? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2022.5.s1.1
37. Scherer, R., Siddiq, F., & Tondeur, J. (2019). The technology Aacceptancemodel (TAM): A meta-analytic structural equation modeling approach to explaining teachers' adoption of digital technology in education. Computers & Education, 128, 13-35
38. Shaikh, S., Yayilgan, S.Y., Klímová, B., & Pikhart, M. (2023). Assessing the usability of ChatGPT for formal English language learning. European Journal of Investigation in Health, Psychology, and Education, 13(9), 1937-1960. https://doi.org/10.3390/ejihpe13090140
39. Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2
40. Su, J. and Yang, W. (2023). Unlocking the power of ChatGPT: a framework for applying generative AI in education. Ecnu Review of Education, 6(3), 355-366. https://doi.org/10.1177/20965311231168423
41. Taber, K.S. (2018). The Use of Cronbach's Alpha When Developing and Reporting Research Instruments in Science Education. Res Sci Educ 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
42. Uddin, S., Albert, A., Ovid, A., & Alsharef, A. (2023). Leveraging chatbots to aid construction hazard recognition and support safety education and training. Sustainability, 15(9), 7121. https://doi.org/10.3390/su15097121
43. Vincent-Lancrin, S. and R. van der Vlies (2020). "Trustworthy artificial intelligence (AI) in education: Promises and challenges," OECD Education Working Papers, No. 218, OECD Publishing, Paris, https://doi.org/10.1787/a6c90fa9-en.
44. Witkovský, V. (2019). Computing the exact distribution of Bartlett's test statistic by numerical inversion of its characteristic function. Journal of Applied Statistics, 47(13–15), 2749–2764. https://doi.org/10.1080/02664763.2019.1675608
45. Wood, E., Ange, B., & Miller, D. (2021). Are we ready to integrate artificial intelligence literacy into the medical school curriculum: students and a faculty survey. Journal of Medical Education and Curricular Development, 8, 238212052110240. https://doi.org/10.1177/23821205211024078
46. Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3), 035027. https://doi.org/10.1088/1361-6552/acc5cf
Published
2023-12-11
How to Cite
Obenza, B. N., Salvahan, A., Rios, A. N., Solo, A., Alburo, R. A., & Gabila, R. J. (2023). University Students’ Perception and Use of ChatGPT: Generative Artificial Intelligence (AI) in Higher Education. International Journal of Human Computing Studies, 5(12), 5-18. https://doi.org/10.31149/ijhcs.v5i12.5033
3.png)
