Balancing Ethics and Privacy in the Use of Artificial Intelligence in Institutions of Higher Learning: A Framework for Responsive AI Systems

Belinda Ndlovu, Kudakwashe Maguraushe

Abstract

Artificial Intelligence (AI) is swiftly revolutionising higher education, presenting substantial prospects for innovation while concurrently evoking ethical and privacy concerns. These concerns include issues such as intrusive data collection, algorithmic bias, threats to student autonomy, and unequal access to AI-enhanced learning. Without clear guidelines or institutional safeguards, there is a risk that AI systems may reinforce existing social inequalities, compromise student privacy, and erode the human-centred nature of teaching and learning. This research presents an AI framework that is responsive and ethical within the area of higher education. The process involved sixteen in-depth interviews from university students, administrators, lecturers, and IT professionals belonging to three separate universities, with the Technology Organisation Environment model and the sociocultural learning theory being employed. Thematic analysis identified ten critical themes centred around benefits, challenges, applications, responsible use, privacy and data security, ethical considerations, institutional policies and frameworks, training, equity, and sustainable AI use. The results indicate that institutions should take a proactive stance in dealing with these issues and harnessing AI's full potential. The study thus advances the formulation of policies that provide for the equitable distribution of AI technologies, with the accompanying strong emphasis on ethical principles and data security. In preserving academic integrity and enhancing educational processes, this research stresses the need to create collaborative environments among the major stakeholders. Thus, higher education, taking into consideration AI implementations aligned with learner, educator, and administrator interests, thereby offers the promise of navigating the complex terrain of AI integration.

Keywords

Artificial Intelligence; Ethics; Privacy; Responsive AI systems; Responsible use.

Full Text:

PDF

References

Abulibdeh, A., Zaidan, E., & Abulibdeh, R. (2024). Navigating the confluence of artificial intelligence and education for sustainable development in the era of industry 4.0: Challenges, opportunities, and ethical dimensions. Journal of Cleaner Production, 437, 140527. https://doi.org/10.1016/j.jclepro.2023.140527

Adelakun, B. O., Majekodunmi, T. G., & Akintoye, O. S. (2024). AI and ethical accounting: Navigating challenges and opportunities. International Journal of Advanced Economics, 6(6), 224–241. https://doi.org/10.51594/ijae.v6i6.1230

Adewale, A. (2024). Ethical issues in artificial intelligence adoption in African higher education institutions in Nigeria. African Journal of Information and Knowledge Management. https://doi.org/10.47604/ajikm.2735

Ait Ali, D., El Meniari, A., El Filali, S., Morabite, O., Senhaji, F., & Khabbache, H. (2023). Empirical research on technological pedagogical content knowledge (TPACK) framework in health professions education: A literature review. Medical Science Educator, 33(3), 791–803. https://doi.org/10.1007/s40670-023-01786-z

Akgun, S. (2022). Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI and Ethics, 2(3), 431–440. https://doi.org/10.1007/s43681-021-00096-7

Ayling, J., & Chapman, A. (2021). Putting AI ethics to work: are the tools fit for purpose? AI and Ethics, 2(3), 405–429. https://doi.org/10.1007/s43681-021-00084-x

Bolón-Canedo, V., Morán-Fernández, L., Cancela, B., & Alonso-Betanzos, A. (2024). A review of green artificial intelligence: Towards a more sustainable future. Neurocomputing, 599, 128096. https://doi.org/10.1016/j.neucom.2024.128096

Braun, V., & Clarke, V. (2012). Thematic analysis. In APA Handbook of Research Methods in Psychology, Vol 2: Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological (Vol. 2, pp. 57–71). https://doi.org/10.1037/13620-004

Celik, I. (2023). Towards Intelligent-TPACK: An empirical study on teachers' professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, 107468. https://doi.org/10.1016/j.chb.2022.107468

Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s43681-021-00096-7

Cumming, D., Saurabh, K., Rani, N., & Upadhyay, P. (2024). Towards AI ethics-led sustainability frameworks and toolkits: Review and research agenda. Journal of Sustainable Finance and Accounting, 1, 100003. https://doi.org/10.1016/j.josfa.2024.100003

de Almeida, P. G. R., dos Santos, C. D., & Farias, J. S. (2021). Artificial intelligence regulation: a framework for governance. Ethics and Information Technology, 23(3), 505–525. https://doi.org/10.1007/s10676-021-09593-z

Dhipayasa. (2023). Factors influencing the adoption of artificial intelligence for qualitative data analysis. [Journal Name], 13(1), 104–116. https://doi.org/10.46254/EU07.202400

Drach, I., Petroye, O., Borodiyenko, O., R., I., Bazeliuk, O., B., N., & Slobodianiuk, O. (2023). The use of artificial intelligence in higher education. International Scientific Journal of Universities and Leadership. https://doi.org/10.31874/2520-6702-2023-15-66-82

Dube, M., Dube, S., & Ndlovu, B. (2024). Factors influencing the adoption of AI chatbots by non-governmental organizations. https://doi.org/10.46254/EU07.20240155

Dube, S., Dube, S., Ndlovu, B. M., Maguraushe, K., Malungana, L., Kiwa, F. J., & Muduva, M. (2024). Students' perceptions of ChatGPT in education: A rapid systematic literature review. In Intelligent Computing (pp. 258–279). https://doi.org/10.1007/978-3-031-62273-1_18

Dube, S., Mutunhu, B., & Dube, S. P. (2023). Lecturers' experiences in teaching STEM courses online during COVID-19: Case of a Zimbabwean university. The IAFOR Conference on Educational Research & Innovation: 2023 Official Conference Proceedings, 53–65. https://doi.org/10.22492/issn.2435-1202.2023.5

Dube, S., Ndlovu, B., & Dube, S. P. (2024). A conceptualized framework of university students' perceptions of ChatGPT as a tool for learning and research. [Conference Proceedings], 325–339. https://doi.org/10.22492/issn.2188-1162.2024.26

Erin, H., & Shuguang, L. (2021). AI: new source of competitiveness in higher education. Competitiveness Review: An International Business Journal. https://doi.org/10.1108/cr-03-2021-0045

Gartner, S., & Krasna, M. (2023). Artificial intelligence in education - ethical framework. Mediterranean Conference on Embedded Computing. https://doi.org/10.1109/MECO58584.2023.10155012

Golzar, J., & Noor, S. (2022). Defining convenience sampling in a scientific research. International Journal of Education and Language Studies, 1(November), 72–77.

Hoti, E. (2015). The technological, organisational and environmental framework of IS innovation adaption in small and medium enterprises. International Journal of Business and Management, 3(4), 1–14. https://doi.org/10.20472/bm.2015.3.4.001

Ifenthaler, D., Majumdar, R., Gorissen, P., Judge, M., Mishra, S., Raffaghelli, J., & Shimada, A. (2024). Artificial intelligence in education: Implications for policymakers, researchers, and practitioners. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-024-09747-0

Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389–399. https://doi.org/10.1038/s42256-019-0088-2

Jowarder, M. I. (2023). The influence of ChatGPT on social science students: Insights drawn from undergraduate students in the United States. Indonesian Journal of Innovation and Applied Sciences (IJIAS), 3(2), 194–200. https://doi.org/10.47540/ijias.v3i2.878

Kapuya, T., Kubiku, W., Dube, M., Ndlovu, B., & Mukudu, T. (2024). Ethical AI frameworks: Balancing privacy, consent and responsible use. Landi. https://doi.org/10.46254/EU07.20240168

Kumar, P., Kaur, S., & Kumar, R. (2024). Balancing innovation and ethics: The integration of artificial intelligence in higher education.

Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Sage Publications, Inc. https://doi.org/10.1016/0147-1767(85)90062-8

Maguraushe, K., da Veiga, A., & Martins, N. (2024). A personal information privacy perceptions model for university students. Information Security Journal: A Global Perspective, 33(4), 394–424. https://doi.org/10.1080/19393555.2024.2329554

Maguraushe, K., Masimba, F., & Muderedzwa, M. (2022). Shrinking the digital divide in online learning beyond the COVID-19 pandemic: A systematic literature review. 2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT), 1–7. https://doi.org/10.1109/ZCICT55726.2022.10046024

Masimba, F., & Maguraushe, K. (2022). Understanding e-learning adoption and acceptance during the Covid-19 pandemic: The influence of self efficacy. 2022 1st Zimbabwe Conference of Information and Communication Technologies (ZCICT), 1–6. https://doi.org/10.1109/ZCICT55726.2022.10046037

Massaty, M. H., Fahrurozi, S. K., & Budiyanto, C. W. (2024). The role of AI in fostering computational thinking and self-efficacy in educational settings: A systematic review. IJIE (Indonesian Journal of Informatics Education), 8(1). https://doi.org/10.20961/ijie.v8i1.89596

Mnguni, N. M., Nkomo, N., Maguraushe, K., & Mutanga, B. M. (2024). An experimental study of the efficacy of prompting strategies in guiding ChatGPT for a computer programming task. Journal of Information Systems and Informatics, 6(3), 1346–1359. https://doi.org/10.51519/journalisi.v6i3.783

Moyo, S., Nyoni, P., Ndlovu, B., Dube, S., Sibanda, C., & Dzinomwa, M. (2024). Assessment of students' experiences and viewpoints in using chatbots for education practice: A university case of a developing country. The European Conference on Education 2024. https://doi.org/10.22492/issn.2188-1162.2024.59

Mutunhu, B., Dube, S., Dube, S. P., & Mpofu, S. (2022). A framework for transitioning to virtual classes during life-threatening pandemics like COVID-19. European Conference on E-Learning, 21(1), 279–287. https://doi.org/10.34190/ecel.21.1.900

Mutunhu, B., Dube, S., Ncube, N., & Sibanda, S. (2022). Cyber security awareness and education framework for Zimbabwe universities: A case of National University of Science and Technology. Proceedings of the International Conference on Industrial Engineering and Operations Management Nsukka, Nigeria, 5–7.

Naderifar, M., Goli, H., & Ghaljaie, F. (2017). Snowball sampling: A purposeful method of sampling in qualitative research. Strides in Development of Medical Education, 14(3). https://doi.org/10.5812/sdme.67670

Ndlovu, B., Migioni, Z. T., Dube, S., & Nyoni, P. (2023). Betr Selektr: A university program recommender system utilising personality type and academic results. The Barcelona Conference on Education 2023: Official Conference Proceedings, 701–715. https://doi.org/10.22492/issn.2435-9467.2023.55

Ndlovu, B. M., Maphosa, N., & Dube, S. (2023). Virtual reality (VR) simulation of chemistry lab using blender and unity. The IAFOR Conference on Educational Research & Innovation: 2023 Official Conference Proceedings, 101–109. https://doi.org/10.22492/issn.2435-1202.2023.8

Ndlovu, R., Ndlovu, K., Chivunga, S., Mkwebu, L., Ndlovu, B., & Dube, S. (2024). Exploring the transformative effects of artificial intelligence and its impact on educational practices. https://doi.org/10.46254/EU07.20240185

Ndlovu, S., Dube, S., Ndlovu, B., & Maguraushe, K. (2025). Artificial intelligence chatbots in education: Academics beliefs, concerns and pathways for integration. [Journal Name], 7(2). https://doi.org/10.24002/ijis.v7i2.10805

Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B. P. T. (2023). Ethical principles for artificial intelligence in education. Education and Information Technologies, 28(4), 4221–4241. https://doi.org/10.1007/s10639-022-11316-w

Pin, C., & Liepp, S. I. (2023). Semi-structured interviews. LIEPP Methods Brief, (4).

Revesai, Z., Tungwa, B., Chisosa, T. A., & Meki, V. R. (2024). Digital empowerment in social work: Leveraging AI to enhance educational access in developing nations. IJIE (Indonesian Journal of Informatics Education), 8(2). https://doi.org/10.20961/ijie.v8i2.92951

Robinson, P., & Jonathan, B. (2008). Convenience samples and caregiving research: how generalisable are the findings? The Gerontologist. https://doi.org/10.1093/GERONT/48.6.8202

Saunders, M., Bristow, A., Thornhill, A., & Lewis, P. (2019). Understanding research philosophy and approaches to theory development. In M. N. K. Saunders, P. Lewis, & A. Thornhill (Eds.), Research methods for business students (8th ed., pp. 128–171). Pearson Education.

Smith, S., Tate, M., Freeman, K., & Walsh, A. (2024). A university framework for the responsible use of generative AI in research. ArXiv Preprint ArXiv:2404.19244. https://arxiv.org/abs/2404.19244

Tabbakh, A., Al Amin, L., Islam, M., Mahmud, G. M. I., Chowdhury, I. K., & Mukta, M. S. H. (2024). Towards sustainable AI: a comprehensive framework for Green AI. Discover Sustainability, 5(1), 408. https://doi.org/10.1007/s43621-024-00641-4

Tella, A., Owoeye, P. O., & Dunmade, A. O. (2024). Access to, use, and effect of open educational resources: The perspectives of LIS academics in selected Nigerian universities. IJIE (Indonesian Journal of Informatics Education), 8(2). https://doi.org/10.20961/ijie.v8i2.85288

Tirado, A. M., Mulholland, P., & Fernandez, M. (2024). Towards an operational responsible AI framework for learning analytics in higher education. ArXiv.Org. https://doi.org/10.48550/ARXIV.2410.05827

Tornatzky, L. G., Fleischer, M., & Chakrabarti, A. K. (1990). Processes of technological innovation. Lexington books.

Venkatesh, V., Thong, J. Y. L., & Xu, X. (2016). Unified theory of acceptance and use of technology: A synthesis and the road ahead. Journal of the Association for Information Systems, 17(5), 328–376. https://doi.org/10.17705/1jais.00428

Villegas-Ch, W., & Garcia-Ortiz, J. (2023). Toward a comprehensive framework for ensuring security and privacy in artificial intelligence. Electronics. https://doi.org/10.3390/electronics12183786

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

Wynand, G., & Patrick, V. M. (2024). A framework for the application of AI in higher education in association with APPETD and Swiss Institute for Management and Innovation. International Conference on Medical Imaging, Electronic Imaging, Information Technologies and Sensors. https://doi.org/10.1117/12.3030740

Xulu, H. H., Hlongwa, N. S., & Maguraushe, K. (2024). Unlocking the potential of AI in higher education: A multi-dimensional study of ChatGPT adoption at a South African university. Atlantis Highlights in Social Sciences, Education and Humanities. Atlantis Press International BV. https://doi.org/10.2991/978-94-6463-630-7

Yang, E., & Beil, C. (2024). Ensuring data privacy in AI/ML implementation. New Directions for Higher Education. https://doi.org/10.1002/he.20509

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education - where are the lecturers? International Journal of Educational Technology in Higher Education, 16(1). https://doi.org/10.1186/s41239-019-0171-0

Zouhaier, S., Beatriz, B., & Villarejo, C. (2023). Navigating the ethical challenges of artificial intelligence in higher education: An analysis of seven global AI ethics policies.

DOI: https://doi.org/10.20961/ijie.v9i1.100723