UPSI Digital Repository (UDRep)
|
|
|
Abstract : Universiti Pendidikan Sultan Idris |
This study reviews recently published scientific literature on the use of chatbot in education, in order to: (a) identify the potential contribution of the incorporation of chatbot as educational tool in educational institutions, (b) present a synthesis of the available empirical evidence on the educational effectiveness of chatbot as an educational tool, and (c) define future research perspectives concerning educational chatbot. From 369 sources, 25 studies on chatbots and their application in education were selected through a step?by?step procedure based on the guidelines of the modified PRISMA framework, using a set of predefined criteria between 2016 2021 in five prestigious databases (a) Ebscohost, (b) Emerald, (c) ScienceDirect, (d) SpringerLink, and (e) Scopus. For each article, we analyse the purpose of the study, the content to be taught with the aid of chatbot, the type of chatbot used, the research method used, and the sample characteristics (sample size, age range of students and/or level of education) and the results observed. The articles reviewed suggest that educational chatbot usually acts as an element that enhances learning and other benefits; however, this is not always the case, as there are still few studies that have reported adverse situations. The outcomes of the literature review are discussed in terms of their implications for future research and can provide helpful guidance for educators, practitioners and researchers in terms of design, implementation and research in the area. 2023 by the authors. |
References |
G. J. Hwang and C. Y. Chang, “A review of opportunities and challenges of chatbots in education,” Interactive Learning Environments, pp. 1-14, 2021. J. Grossman, Z. Lin, H. Sheng, J. T. Z. Wei, J. J. Williams, and S. Goel, “MathBot: Transforming online resources for learning math into conversational interactions,” in Proc. AAAI 2019 Story-Enabled Intelligence, 2019. S. Ruan, A. Willis, Q. Xu, G. M. Davis, L. Jiang, E. Brunskill, and J. A. Landay, “Bookbuddy: Turning digital materials into interactive foreign language lessons through a voice chatbot,” in Proc. the Sixth (2019) ACM Conference on Learning@ Scale, June, 2019, pp. 1-4. A. van Heerden, X. Ntinga, and K. Vilakazi, “The potential of conversational agents to provide a rapid HIV counseling and testing services,” in Proc. 2017 International Conference on the Frontiers and Advances in Data Science (FADS), October, 2017, pp. 80-85, IEEE. R. Winkler and M. Söllner, “Unleashing the potential of chatbots in education: A state-of-the-art analysis,” in Proc. Academy of Management Annual Meeting (AOM), 2018. E. Vázquez-Cano, S. Mengual-Andrés, and E. López-Meneses, “Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments,” International Journal of Educational Technology in Higher Education, vol. 18, no. 1, pp. 1-20, 2021. J. F. Pane, E. D. Steiner, M. D. Baird, L. S. Hamilton, and J. D. Pane. (2017). How does personalized learning affect student achievement? [Online]. Available: https://doi.org/10.7249/RB9994 M. S. Shail, “Using micro-learning on mobile applications to increase knowledge retention and work performance: A review of literature,” Cureus, vol. 11, no. 8, e5307, 2019. L. Giurgiu, “Microlearning an evolving elearning trend,” Scientific Bulletin-Nicolae Balcescu Land Forces Academy, vol. 22, no. 1, pp.18-23, 2017. S. A. Nikou and A. A. Economides, “Mobile-based Assessment: Integrating acceptance and motivational factors into a combined model of self-determination theory and technology acceptance,” Computers in Human Behavior, vol. 68, pp. 83-95, 2017. G. Garcia-Brustenga, M. Fuertes-Alpiste, and N. Molas-Castells. (2018). Briefing paper: Chatbots in education. Barcelona: eLearn Center. Universitat Oberta de Catalunya. [Online]. Available: https://doi.org/10.7238/elc.chatbots.2018 S. Kowalski, R. Hoffmann, R. Jain, and M. Mumtaz, “Universities services in the new social ecosystems: Using conversational agents to help teach information security risk analysis,” in Proc. SOTICS 2011, The First International Conference on Social Eco-Informatics, 2011, pp. 91-94. G. Cameron, D. Cameron, G. Megaw, R. Bond, M. Mulvenna, S. O‟Neill, and M. McTear, “Towards a chatbot for digital counselling,” in Proc. The 31st International BCS Human Computer Interaction Conference (HCI 2017), vol. 31, July 2017, pp. 1-7. R. Singh. (2018). AI and chatbots in education: What does the future hold? [Online]. Available: https://chatbotsmagazine.com/ai-and-chatbots-in-education-what-does-the-futurehold-9772f5c13960 R. S. Baker, “Stupid tutoring systems, intelligent humans,” International Journal of Artificial Intelligence in Education, vol. 26, no. 2, pp. 600-614, 2016. S. Wollny, J. Schneider, D. Di Mitri, J. Weidlich, M. Rittberger, and H. Drachsler, “Are we there yet? — A systematic literature review on chatbots in education,” Frontiers in Artificial Intelligence, vol. 4, 2021. D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and PRISMA Group*, “Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement,” Annals of Internal Medicine, vol. 151, no. 4, pp. 264-269, 2009. D. L. Kirkpatrick, Kirkpatrick (2006) Evaluating Training Programmes: The Four Levels, 1994. E. Oliveira, P. G. de Barba, and L. Corrin, “Enabling adaptive, personalised and context-aware interaction in a smart learning environment: Piloting the iCollab system,” Australasian Journal of Educational Technology, vol. 37, no. 2, pp. 1-23, 2021. J. H. Han, K. Shubeck, G. H. Shi, X. E. Hu, L. Yang, L. J. Wang, and G. Biswas, “Teachable agent improves affect regulation,” Educational Technology & Society, vol. 24, no. 3, pp. 194-209, 2021. B. D. Nye, P. I. Pavlik, A. Windsor, A. M. Olney, M. Hajeer, and X. Hu, “SKOPE-IT (Shareable Knowledge Objects as Portable Intelligent Tutors): overlaying natural language tutoring on an adaptive learning system for mathematics,” International Journal of STEM Education, vol. 5, no. 1, pp. 1-20, 2018. A. J. Gonzalez, J. R. Hollister, R. F. DeMara, J. Leigh, B. Lanman, , S. Y. Lee, and B. Wilder, “AI in informal science education: Bringing Turing back to life to perform the Turing test,” International Journal of Artificial Intelligence in Education, vol. 27, no. 2, pp. 353-384, 2017. N. A. M. Mokmin and N. A. Ibrahim, “The evaluation of chatbot as a tool for health literacy education among undergraduate students,” Education and Information Technologies, vol. 26, no. 5, pp. 6033-6049, 2021. F. Grivokostopoulou, K. Kovas, and I. Perikos, “The effectiveness of embodied pedagogical agents and their impact on students learning in virtual worlds,” Applied Sciences, vol. 10, no. 5, p. 1739, 2020. Q. Yin and M. Satar, “English as a foreign language learner interactions with chatbots: Negotiation for meaning,” International Online Journal of Education and Teaching (IOJET), 2020. L. K. Fryer, K. Nakao, and A. Thompson, “Chatbot learning partners: Connecting learning experiences, interest and competence,” Computers in Human Behavior, vol. 93, pp. 279-289, 2019. J. Q. Pérez, T. Daradoumis, and J. M. M. Puig, “Rediscovering the use of chatbots in education: A systematic literature review,” Computer Applications in Engineering Education, vol, 28, no. 6, pp. 1549-1565, 2020. P. Smutny and P. Schreiberova, “Chatbots for learning: A review of educational chatbots for the Facebook Messenger,” Computers & Education, vol. 151, p. 103862, 2020. L. K. Fryer, M. Ainley, A. Thompson, A. Gibson, and Z. Sherlock, “Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partners,” Computers in Human Behavior, vol. 75, pp. 461-468, 2017. A. V. Diachenko, B. P. Morgunov, T. P. Melnyk, O. I. Kravchenko, and L. V. Zubchenko, “The use of innovative pedagogical technologies for automation of the specialists' professional training,” International Journal of Higher Education, vol. 8, no. 6, pp. 288-295, 2019. J. Pereira, M. Fernández-Raga, S. Osuna-Acedo, M. Roura-Redondo, O. Almazán-López, and A. Buldón-Olalla, “Promoting learners‟ voice productions using chatbots as a tool for improving the learning process in a MOOC,” Technology, Knowledge and Learning, vol. 24, no. 4, pp.545-565, 2019. P. Vanichvasin, “Chatbot development as a digital learning tool to increase students' research knowledge,” International Education Studies, vol. 14, no. 2, pp. 44-53, 2021. S. B. Rodzman, N. A. Bakar, Y. H. Choo, S. A. Aljunid, N. K. Ismail, N. Abd Rahman, and M. M. Rosli, “I-ONAr: A rule-based machine learning approach for intelligent assessment in an online learning environment,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 17, no. 2, pp. 1021-1028, 2020. |
This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials. You may use the digitized material for private study, scholarship, or research. |