Virtual teaching assistant for capturing facial and pose landmarks of the students in the classroom using deep learning

Roznim Mohamad Rasli

QR Code Link :
Type :	article
Subject :	T Technology (General)
ISSN :	1548-3673
Main Author :	Roznim Mohamad Rasli
Title :	Virtual teaching assistant for capturing facial and pose landmarks of the students in the classroom using deep learning

Place of Production :	Tanjung Malim
Publisher :	Fakulti Komputeran dan Meta Teknologi
Year of Publication :	2023
Notes :	International Journal of e-Collaboration
Corporate Name :	Universiti Pendidikan Sultan Idris
HTTP Link :	Click to view web link

Abstract : Universiti Pendidikan Sultan Idris

This research focuses on the learning challenges that both students and teachers face during the learning process. It addresses the different techniques and methods used for face recognition. The proposed VTA model uses the convolutional neural networks to recognize the identities of the student. It gathers the facial expressions and body poses of each student in the classroom and predicts the attention level of that student, thus determining his/her learning capabilities. This research will help the students achieve their learning objectives by being able to get an accurate and real evaluation of their contribution and attention during the classes. Also, the proposed VTA model helps the teacher get some insight into his/her teaching methodologies during the class as the model will observe and record the attentiveness of the students. This research will have a significant positive impact on student success and on effective lecturing. 2023 IGI Global. All rights reserved.

References

Aggarwal, C. C. (2018). Neural Networks and Deep Learning. In Neural Networks and Deep Learning. doi:10.1007/978-3-319-94463-0

Agravante, D. J., De Magistris, G., Munawar, A., Vinayavekhin, P., & Tachibana, R. (2018). Deep Learning with Predictive Control for Human Motion Tracking. Cornell University.

Azeez, R. A., & Azeez, P. Z. (2018). Incorporating Body Language into EFL Teaching. Koya University Journal of Humanities and Social Sciences, 1(1), 36–45. Advance online publication. doi:10.14500/kujhss.v1n1y2018. pp36-45

Bakken, J. P., Varidireddy, N., & Uskov, V. L. (2020). Smart Universities: Gesture Recognition Systems for College Students with Disabilities. Smart Innovation. Systems and Technologies, 188, 393–411. Advance online publication. doi:10.1007/978-981-15-5584-8_34

Bataeva, A. (2021). Google AI neural network simulates camera movement. https://neurohive.io/en/applications/google-ai-neural-network-simulates-camera-movement/

Campesato, O. (2020). Artificial Intelligence. Machine Learning, and Deep Learning. Cinelli, L., Chaves, G., & Lima, M. (2018). Vessel Classification through Convolutional Neural Networks using Passive Sonar Spectrogram Images. 10.14209/sbrt.2018.340

Dahlgren, R. L. (n.d.). From martyrs to murderers : Images of teachers and teaching in Hollywood films. Academic Press.

Fuzail, M., Muhammad, H., Nouman, F., Mushtaq, M. O., Raza, B., Tayyab, A., & Waqas Talib, M. (2014). Face Detection System for Attendance of Class Students. International Journal of Multidisciplinary Sciences and Engineering, 5(4).

Hatt, M., Parmar, C., Qi, J., & El Naqa, I. (2019). Machine (Deep) Learning Methods for Image Processing and Radiomics. IEEE Transactions on Radiation and Plasma Medical Sciences, 3(2), 104–108. Advance online publication. doi:10.1109/TRPMS.2019.2899538

Hazim Barnouti, N., Sameer Mahmood Al-Dabbagh, S., & Esam Matti, W. (2016). Face Recognition: A Literature Review. International Journal of Applied Information Systems, 11(4), 21–31. Advance online publication. doi:10.5120/ijais2016451597

Hutter, F. (2019). Automated Machine Learning. Springer. doi:10.1007/978-3-030-05318-5

Kamani, M. H., Safari, O., Mortazavi, S. A., Mehraban Sang Atash, M., & Azghadi, N. M. (2017). Using an image processing based technique and predictive models for assessing lipid oxidation in rainbow trout fillet. Food Bioscience, 19, 42–48. Advance online publication. doi:10.1016/j.fbio.2017.05.005

Kamarudin, N., Jumadi, N. A., Mun, N. L., Keat, N. C., Ching, A. H. K., Mahmud, W. M. H. W., Morsin, M., & Mahmud, F. (2019). Implementation of haar cascade classifier and eye aspect ratio for driver drowsiness detection using raspberry Pi. Universal Journal of Electrical and Electronic Engineering, 6(5), 67–75. Advance online publication. doi:10.13189/ujeee.2019.061609

Khan, A., & Ghosh, S. K. (2021). Student performance analysis and prediction in classroom learning: A review of educational data mining studies. Education and Information Technologies, 26(1), 205–240. Advance online publication. doi:10.1007/s10639-020-10230-3

Kubat, M. (2017). An Introduction to Machine Learning. In An Introduction to Machine Learning. doi:10.1007/978-3-319-63913-0

Marr, B., & Ward, M. (2019). Artificial intelligence in practice : how 50 successful companies used artificial intelligence to solve problems. Academic Press.

Mitchell. (1997). Machine Learning textbook. McGraw Hill. Mittal, A. (2020). Haar Cascades, Explained. https://medium.com/analytics-vidhya/haar-cascades-explained38210e57970d

Nagabhushan, P., Singh, S. K., & Partha Roy, B. R. (2017). Computer Vision and Image Processing. Springer.

Naveed, M., Alrammal, M., & Bensefia, A. (2020). HGM: A Novel Monte-Carlo Simulations based Model for Malware Detection. IOP Conference Series. Materials Science and Engineering, 946(1), 012003. Advance online publication. doi:10.1088/1757-899X/946/1/012003

Ng, A. (2018). Machine Learning Yearning: Technical Strategy for AI Engineers in the Era of Deep Learning [Draft Version]. https://gallery.mailchimp.com/dc3a7ef4d750c0abfc19202a3/files/5dd91615-3b3f-4f5d-bbfb4ebd8608d330/Ng_MLY01_13.pdf

Pedamkar. (2020). Machine Learning vs Predictive Modelling. Academic Press.

Raschka, S., Patterson, J., & Nolet, C. (2020). Machine learning in python: Main developments and technology trends in data science, machine learning, and artificial intelligence. Information, 11(4). doi:10.3390/info11040193

Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews. Data Mining and Knowledge Discovery, 3(1), 12–27. Advance online publication. doi:10.1002/widm.1075

Wang, S. (2019). Using deep neural networks for accurate hand0-tracking on Oculus Quest. https://ai.facebook.com/blog/hand-tracking-deep-neural-networks/

Yang, M.-H. (2000). Hand gesture recognition and face detection in images. ProQuest Dissertations and Theses.

Zakaria, R. (2017). Smart Motion Detection : Security System Using Raspberry Pi. Journal of the Engineering Research Institute, 30.

This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to previous page