Lobe Software's Accuracy in Analyzing Human Facial Expressions: Accuracy of Using Lobe Software in Analyzing Human Facial Expressions

Hamzarudin Hikmatiar; Adi Jufriansah; Jayadin

doi:10.56741/esl.v2i01.288

Authors

Hamzarudin Hikmatiar
hamzarudinhikmatiar90@gmail.com
IKIP Muhammadiyah Maumere
Adi Jufriansah IKIP Muhammadiyah Maumere
Jayadin IKIP Muhammadiyah Maumere

Keywords:

Accuracy, Artificial Intelligence, Facial Expression, Lobe Software

Abstract

The face constitutes a research subject for analyzing human facial expressions, as it can provide insights into an individual's emotions. Facial expressions are identified through changes in key facial features such as the eyes, eyebrows, mouth, and forehead. The field of education has witnessed rapid technological advancements, especially in light of the pandemic. Consequently, the need for the development of technology has become increasingly pressing. This study aims to evaluate the accuracy of Lobe software in analyzing human facial expressions. The sample population for this research comprised students from IKIP Muhammadiyah Maumere, Indonesia, with a sample size of 19 selected using a simple random sampling method. The results of the analysis showed that the accuracy of the software was pretty good, with a score of 90% for each category of neutral, sad, happy, and angry faces. The questionnaire data analysis yielded a score of 84%, which is only 6% lower than the score achieved through the students' self-reporting, implying an error rate of less than 10% if validated.

Downloads

Download data is not yet available.

References

A. Hendrawan, B. A. Pramono, and W. Adhiwibowo, “Penggunaan Model Hidden Markov dan Metode Neural Network sebagai Penerapan Teknologi Pengenalan Wajah,” Sci. Comput. Sci. Informatics J., vol. 2, no. 1, pp. 13–19, 2019, doi: 10.22487/j26204118.2019.v2.i1.12173.

F. Sarasati, Widiastuti, E. Firasari, and F. L. D. Cahyanti, “Implementasi Metode Principal Component Analysis untuk Sistem Pengenalan Wajah,” Juranal Infortech, vol. 3, no. 2, pp. 152–156, 2021.

L. Yan, Y. Shi, M. Wei, and Y. Wu, “Multi-feature fusing local directional ternary pattern for facial expressions signal recognition based on video communication system,” Alexandria Eng. J., vol. 63, pp. 307–320, 2022, doi: 10.1016/j.aej.2022.08.003.

B. Hardiansyah and P. N. Primandari, “Sistem Pakar Pengenalan Ekspresi Wajah Manusia Menggunakan Metode Kohonen Self Organizing Dan Principal Componen Analysis,” INTEGER J. Inf. Technol. ISSN 2579-566X, vol. 3, no. 2, pp. 43–54, 2018, doi: 10.31284/j.integer.2018.v3i2.310.

F. D. Sukma and R. Mukhaiyar, “Alat Pendeteksi Ekspresi Wajah pada Pengendara Berbasis Image Processing,” JTEIN J. Tek. Elektro Indones., vol. 3, no. 2, pp. 364–373, 2022.

N. K. Suarni, P. H. Suputra, and G. R. Dantes, “Face-Expressiondetection : Pendeteksian Ekspresi Wajah dalam Rangka Optimalisasi Fungsi Sisteme-Learning dalam Proses Belajar Mengajar,” in Seminar nasional Riset Inovatif II, 2014, pp. 1252–1260.

Husdi, “Pengenalan Ekspresi Wajah Pengguna Elearning Menggunakan Artificial Neural Network dengan Fitur Ekstraksi Local Binary Pattern dan Gray Level Co-Occurrence Matrix,” Ilk. J. Ilm., vol. 8, no. 3, pp. 212–219, 2016.

F. Long, T. Wu, J. R. Movellan, M. S. Bartlett, and G. Littlewort, “Learning spatiotemporal features by using independent component analysis with application to facial expression recognition,” Neurocomputing, vol. 93, pp. 126–132, 2012, doi: 10.1016/j.neucom.2012.04.017.

L. A. A. Mahmuddah, S. A. Wibowo, and G. Budiman, “Analisis Performasi pada Pengambilan URL Berbasis Web Crawling dengan Menggunakan Teknologi Pengenalan Wajah YOLOv3,” e-Proceeding Eng., vol. 8, no. 5, pp. 4756–4767, 2021.

M. K. Anam, “Metode Eigenface / Principle Component Analysis (PCA) Untuk Identifikasi Wajah Manusia,” J. Tek. Inform. Unis, vol. 6, no. 2, pp. 82–88, 2018.

I. U. Wahyu Mulyono, D. R. Ignatius Moses Setiadi, A. Susanto, E. H. Rachmawanto, A. Fahmi, and Muljono, “Performance Analysis of Face Recognition using Eigenface Approach,” in Proceedings - 2019 International Seminar on Application for Technology of Information and Communication (iSemantic), 2019, pp. 12–16, doi: 10.1109/ISEMANTIC.2019.8884225.

A. Arifandi, “Identifikasi dan Prediksi Umur Serta Jenis Kelamin Berdasarkan Citra Wajah Menggunakan Algoritma Convolutional Neural Network (CNN),” RAINSTEK J. Terap. Sains Teknol., vol. 4, no. 2, pp. 89–96, 2022.

Microsoft, “Machyne Learning Made Easy,” https://www.lobe.ai/, 2022. https://www.lobe.ai/.

Y. Hartiwi, E. Rasywir, Y. Pratama, and P. A. Jusia, “Eksperimen Pengenalan Wajah dengan fitur Indoor Positioning System menggunakan Algoritma CNN,” Paradig. - J. Komput. dan Inform., vol. 22, no. 2, pp. 109–116, 2020, doi: 10.31294/p.v22i2.8906.

D. Firmansyah and Dede, “Teknik Pengambilan Sampel Umum dalam Metodologi Penelitian: Literature Review,” J. Ilm. Pendidik. Holistik, vol. 1, no. 2, pp. 85–114, 2022, doi: 10.55927/jiph.v1i2.937.

Y. Huang et al., “Curricularface: Adaptive Curriculum Learning Loss for Deep Face Recognition,” in Proceedings of the IEEE (CVPR), 2020, pp. 5900–5909, doi: 10.1109/CVPR42600.2020.00594.

I. Azhari and Fitriyani, “Implementasi Algoritma Convolutional Neural Network dalam Deteksi Emosi Manusia Berdasarkan Ekspresi Wajah,” eProsiding Tek. Inform., vol. 1, no. 1, pp. 112–118, 2021, [Online]. Available: http://eprosiding.ars.ac.id/index.php/pti/article/view/198%0Ahttps://eprosiding.ars.ac.id/index.php/pti/article/download/198/113.

I. D. Raji, T. Gebru, M. Mitchell, J. Buolamwini, J. Lee, and E. Denton, “Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing,” in AIES 2020 - Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 2020, pp. 145–151, doi: 10.1145/3375627.3375820.

B. Jin, L. Cruz, and N. Goncalves, “Deep Facial Diagnosis: Deep Transfer Learning from Face Recognition to Facial Diagnosis,” IEEE Access, vol. 4, pp. 1–14, 2016, doi: 10.1109/ACCESS.2020.3005687.

G. Yang et al., “Face Mask Recognition System with YOLOV5 Based on Image Recognition 2020,” in 2020 IEEE 6th International Conference on Computer and Communications Face, 2020, pp. 1398–1404, doi: 10.1109/ICSIP52628.2021.9688725.

D. Setiawan, S. Widodo, T. Ridwan, and R. Ambari, “Perancangan Deteksi Emosi Manusia berdasarkan Ekspresi Wajah Menggunakan Algoritma VGG16,” Syntax J. Inform., vol. 11, no. 01, pp. 01–12, 2022, doi: 10.35706/syji.v11i01.6594.

U. Ayvaz, H. Gürüler, and M. O. Devrim, “Use of Facial Emotion Recognition in E-Learning Systems,” Inf. Technol. Learn. Tools, vol. 60, no. 4, pp. 95–104, 2017, doi: 10.33407/itlt.v60i4.1743.

E. Zadobrischi, L. M. Cosovanu, M. Negru, and M. DImian, “Detection of emotional states through the facial expressions of drivers embedded in a portable system dedicated to vehicles,” in Telecommunications Forum TELFOR 2020, 2020, pp. 1–5, doi: 10.1109/TELFOR51502.2020.9306572.

W. Wang, K. Xu, H. Niu, and X. Miao, “Emotion Recognition of Students Based on Facial Expressions in Online Education Based on the Perspective of Computer Simulation,” Complexity, pp. 1–9, 2020, doi: 10.1155/2020/4065207.

A. S.P, P. S, and K. G, “Facial Expression Analysis of Students in Classroom using Machine Learning Technique,” Int. J. Curr. Adv. Res., vol. 8, no. 07, pp. 1–5, 2019.

Y. Ueda, “Understanding Mood of the Crowd with Facial Expressions: Majority Judgment for Evaluation of Statistical Summary Perception,” Attention, Perception, Psychophys., vol. 84, no. 3, pp. 843–860, 2022, doi: 10.3758/s13414-022-02449-8.

B. Dixit and A. Gaikwad, “Facial Expressions Based Emotion Recognition Through Feature Fusion Approach,” in Proceedings of 2018 the 8th International Workshop on Computer Science and Engineering, WCSE 2018, 2018, pp. 258–263, doi: 10.18178/wcse.2018.06.046.