Modeling Face Detection Application Using Convolutional Neural Network and Face-API for Effective and Efficient Online Attendance Tracking

Carles Juliandy; Ng Poi Wong; Darwin

doi:10.15575/join.v9i1.1203

Authors

Carles Juliandy Department of Information Technology, Universitas Mikroskil, Indonesia
Ng Poi Wong Department Computer Science, Universitas Mikroskil, Indonesia
Darwin Department Computer Science, Universitas Mikroskil, Indonesia

DOI:

https://doi.org/10.15575/join.v9i1.1203

Keywords:

Tracking Attendance, Face-API, Convolutional Neural Network, Online Meeting Class

Abstract

The pandemic of Covid-19 emergency has ended, but it gives us a new lifestyle every aspect of life and also in the education aspect has changed. At that moment as one of the ways to prevent pandemic infection, many governments give the policy to close the offline class and continue with online classes. The online class system encountered several problems and one of those problems was to track the students’ attendance to ensure all the students were attending the class. The teacher needed extra effort to track it because they needed to call the students one by one which is wasting time and sometimes would miss the presence of the students who attend the class. To make it effective efficient accurate and time-consuming when tracking attendance in online classes for teachers, we proposed the face detection model which combines face-api.js and CNN to detect and recognize the students’ faces to help teachers track attendance by just uploading the screenshot image of the online meeting application. We tested our model with accuracy and speed testing. With 3 images of every student’s face as training data, our model was able to recognize the face with 100% accuracy in just 41,65 seconds which is faster than calling students one by one that need almost 3 to 5 minutes if there are many students. Future research can be done by focusing research on improving the model to detect the students’ faces with different brightness, contrast, and saturation because students may not have the same place and condition when joining an online meeting class.

References

A. A. Oloyede, N. Faruk, and W. O. Raji, “COVID-19 lockdown and remote attendance teaching in developing countries: A review of some online pedagogical resources,” African Journal of Science, Technology, Innovation and Development, vol. 0, no. 0, pp. 1–19, 2021, doi: 10.1080/20421338.2021.1889768.

“Coronavirus Outbreak,” Website page. Accessed: Sep. 01, 2021. [Online]. Available: https://www.worldometers.info/coronavirus/

T. Singhal, “A Review of Coronavirus Disease-2019 (COVID-19),” Indian J Pediatr, vol. 87, no. 4, pp. 281–286, 2020, doi: 10.1007/s12098-020-03263-6.

World Health Organization (WHO), “Statement on the fifteenth meeting of the IHR (2005) Emergency Committee on the COVID-19 pandemic,” https://www.who.int/news/item/05-05-2023-statement-on-the-fifteenth-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-coronavirus-disease-(covid-19)-pandemic.

A. Supriyanto, S. Hartini, W. N. Irdasari, A. Miftahul, S. Oktapiana, and S. D. Mumpuni, “Teacher professional quality: Counselling services with technology in Pandemic Covid-19,” Counsellia: Jurnal Bimbingan dan Konseling, vol. 10, no. 2, p. 176, 2020, doi: 10.25273/counsellia.v10i2.7768.

H. H. S. Simon Burgess, “Schools, skills, and learning: The impact of COVID-19 on education.” Accessed: Sep. 01, 2021. [Online]. Available: https://voxeu.org/article/impact-covid-19-education

R. Taufiq, M. Baharun, B. Sunaryo, B. Pudjoatmodjo, and W. M. Utomo, “Indonesia: Covid-19 and E-Learning in Student Attendance Method,” SciTech Framework, vol. 2, no. 1, pp. 12–22, 2020.

B. Setiawan, Sofyan Rofi, and Tri Endang Jatmikowati, “The Student Learning Activity Levels on the Online Learning During the Covid-19 Pandemic,” Jurnal Pendidikan Islam Indonesia, vol. 5, no. 2, pp. 186–197, 2021, doi: 10.35316/jpii.v5i2.289.

L. Kamelia, E. A. D. Hamidi, W. Darmalaksana, and A. Nugraha, “Real-Time Online Attendance System Based on Fingerprint and GPS in the Smartphone,” Proceeding of 2018 4th International Conference on Wireless and Telematics, ICWT 2018, pp. 2018–2021, 2018, doi: 10.1109/ICWT.2018.8527837.

P. S. Helode, Dr. K. H. Walse, and Karande M.U., “An Online Secure Social Networking with Friend Discovery System,” International Journal of Innovative Research in Computer and Communication Engineering, vol. 5, no. 4, pp. 8198–8205, 2017, doi: 10.15680/IJIRCCE.2017.

Andi, R. Purba, and R. Yunis, “Application of Blockchain Technology to Prevent The Potential Of Plagiarism in Scientific Publication,” Proceedings of 2019 4th International Conference on Informatics and Computing, ICIC 2019, 2019, doi: 10.1109/ICIC47613.2019.8985920.

“Face-API JS.” [Online]. Available: https://justadudewhohacks.github.io/face-api.js

C. Li and C. Li, “Web Front-End Realtime Face Recognition Based on TFJS,” Proceedings - 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2019, 2019, doi: 10.1109/CISP-BMEI48845.2019.8965963.

X. M. Zhao and C. B. Wei, “A real-time face recognition system based on the improved LBPH algorithm,” 2017 IEEE 2nd International Conference on Signal and Image Processing, ICSIP 2017, vol. 2017-Janua, pp. 72–76, 2017, doi: 10.1109/SIPROCESS.2017.8124508.

V. Vibin Mammen, S. Thokaiandal, C. S. Sindhuja, V. Mekala, M. Manimegalai, and N. Prabhuram, “A comprehensive study on academic and industry authentication and attendance systems,” International Journal of Scientific and Technology Research, vol. 9, no. 3, pp. 5426–5432, 2020.

F. Sultana, A. Sufian, and P. Dutta, “Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey,” Knowl Based Syst, vol. 201–202, pp. 1–38, 2020, doi: 10.1016/j.knosys.2020.106062.

J. Xu, Y. Zhang, and D. Miao, “Three-way confusion matrix for classification: A measure driven view,” Inf Sci (N Y), vol. 507, pp. 772–794, 2020, doi: 10.1016/j.ins.2019.06.064.

A. Nuhi, A. Memeti, F. Imeri, and B. Cico, “Smart Attendance System using QR Code,” 2020 9th Mediterranean Conference on Embedded Computing, MECO 2020, pp. 8–11, 2020, doi: 10.1109/MECO49872.2020.9134225.

D. Yin, R. G. Lopes, J. Shlens, E. D. Cubuk, and J. Gilmer, “A Fourier perspective on model robustness in computer vision,” Adv Neural Inf Process Syst, vol. 32, no. NeurIPS, 2019.

M. Yu, L. Gong, and S. Kollias, “Computer vision based fall detection by a convolutional neural network,” ICMI 2017 - Proceedings of the 19th ACM International Conference on Multimodal Interaction, vol. 2017-Janua, pp. 416–420, 2017, doi: 10.1145/3136755.3136802.

Y. Jia et al., “Caffe,” pp. 675–678, 2014, doi: 10.1145/2647868.2654889.

Z. Qin, F. Yu, C. Liu, and X. Chen, “How convolutional neural networks see the world --- A survey of convolutional neural network visualization methods,” Mathematical Foundations of Computing, vol. 1, no. 2, pp. 149–180, 2018, doi: 10.3934/mfc.2018008.

U. R. Acharya et al., “A deep convolutional neural network model to classify heartbeats,” Comput Biol Med, vol. 89, no. September, pp. 389–396, 2017, doi: 10.1016/j.compbiomed.2017.08.022.

N. Kalchbrenner, E. Grefenstette, and P. Blunsom, “A convolutional neural network for modelling sentences,” 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference, vol. 1, pp. 655–665, 2014, doi: 10.3115/v1/p14-1062.

B. G. Weinstein, “A computer vision for animal ecology,” Journal of Animal Ecology, vol. 87, no. 3, pp. 533–545, 2018, doi: 10.1111/1365-2656.12780.

K. Shan, J. Guo, W. You, D. Lu, and R. Bie, “Automatic facial expression recognition based on a deep convolutional-neural-network structure,” Proceedings - 2017 15th IEEE/ACIS International Conference on Software Engineering Research, Management and Applications, SERA 2017, pp. 123–128, 2017, doi: 10.1109/SERA.2017.7965717.