Skip to main content
Erschienen in:
Buchtitelbild

2024 | OriginalPaper | Buchkapitel

Advancing Online Education: An Artificial Intelligence Applied System for Monitoring and Improving Employee Engagement in Enterprise Information Systems

verfasst von : Nguyen Thanh Son, Trong Tien Hoang, Satyam Mishra, Nguyen Thi Bich Thuy, Tran Huu Tam, Cong-Doan Truong

Erschienen in: Nature of Computation and Communication

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Online learning has gained significant popularity, but maintaining learner focus remains a challenge, especially in financial enterprise training systems. The need for training has increased with banking and finance digitalization trends, yet high learning curves and prolonged sessions often lead to distractions. This research introduces an online learning tool that monitors and quantifies learner attention in real-time. Using the MobileNet Convolutional Neural Network, we detect seven core emotions, which, combined with attention scores, form a Concentration Index (CI). Learners are then categorized as “Highly-engaged,” “Normally Engaged,” or “Disengaged.” With 70% accuracy on training and 65% on testing, our engagement metrics provide actionable insights for educators and administrators, enhancing virtual learning and aiding in analytical problem-solving strategies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Meyen, E.L., Aust, R.J., Bui, Y.N., Isaacson, R.: Assessing and monitoring student progress in an e-learning personnel preparation environment. Teach. Educ. Spec. Educ. 25, 187–198 (2002)CrossRef Meyen, E.L., Aust, R.J., Bui, Y.N., Isaacson, R.: Assessing and monitoring student progress in an e-learning personnel preparation environment. Teach. Educ. Spec. Educ. 25, 187–198 (2002)CrossRef
3.
Zurück zum Zitat Guncaga, J., Lopuchova, J., Ferdianova, V., Zacek, M., Ashimov, Y.: Survey on online learning at universities of Slovakia, Czech Republic and Kazakhstan during the COVID-19 pandemic. Educ. Sci. 12, 458 (2022)CrossRef Guncaga, J., Lopuchova, J., Ferdianova, V., Zacek, M., Ashimov, Y.: Survey on online learning at universities of Slovakia, Czech Republic and Kazakhstan during the COVID-19 pandemic. Educ. Sci. 12, 458 (2022)CrossRef
4.
Zurück zum Zitat Dumford, A.D., Miller, A.L.: Online learning in higher education: exploring advantages and disadvantages for engagement. J. Comput. High. Educ. 30, 452–465 (2018)CrossRef Dumford, A.D., Miller, A.L.: Online learning in higher education: exploring advantages and disadvantages for engagement. J. Comput. High. Educ. 30, 452–465 (2018)CrossRef
5.
Zurück zum Zitat Ortony, A., Clore, G.L., Collins, A.: The Cognitive structure of emotions cambridge. UK: Cambridge University Press (1988) Ortony, A., Clore, G.L., Collins, A.: The Cognitive structure of emotions cambridge. UK: Cambridge University Press (1988)
6.
Zurück zum Zitat Krithika, L.B., GG, L.P.: Student emotion recognition system (SERS) for e-learning improvement based on learner concentration metric. Procedia Comput. Sci. 85, 767–776 (2016) Krithika, L.B., GG, L.P.: Student emotion recognition system (SERS) for e-learning improvement based on learner concentration metric. Procedia Comput. Sci. 85, 767–776 (2016)
7.
Zurück zum Zitat Picard, R.W., et al.: Affective learning—a manifesto. BT Technol. J. 22, 253–269 (2004)CrossRef Picard, R.W., et al.: Affective learning—a manifesto. BT Technol. J. 22, 253–269 (2004)CrossRef
9.
Zurück zum Zitat Du Boulay, B., Luckin, R.: Modelling human teaching tactics and strategies for tutoring systems. Int. J. Artif. Intell. Educ. 12, 235–256 (2001) Du Boulay, B., Luckin, R.: Modelling human teaching tactics and strategies for tutoring systems. Int. J. Artif. Intell. Educ. 12, 235–256 (2001)
10.
Zurück zum Zitat de Vicente, A., Pain, H.: Informing the detection of the students’ motivational state: an empirical study. In: Cerri, S.A., Gouardères, G., Paraguaçu, F. (eds.) Intelligent Tutoring Systems: 6th International Conference, ITS 2002 Biarritz, France and San Sebastian, Spain, June 2–7, 2002 Proceedings, pp. 933–943. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47987-2_93CrossRef de Vicente, A., Pain, H.: Informing the detection of the students’ motivational state: an empirical study. In: Cerri, S.A., Gouardères, G., Paraguaçu, F. (eds.) Intelligent Tutoring Systems: 6th International Conference, ITS 2002 Biarritz, France and San Sebastian, Spain, June 2–7, 2002 Proceedings, pp. 933–943. Springer, Heidelberg (2002). https://​doi.​org/​10.​1007/​3-540-47987-2_​93CrossRef
11.
Zurück zum Zitat Den Uyl, M., Van Kuilenburg, H.: The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior, pp. 589–590. Citeseer (2005) Den Uyl, M., Van Kuilenburg, H.: The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior, pp. 589–590. Citeseer (2005)
12.
Zurück zum Zitat Happy, S., George, A., Routray, A.: A real time facial expression classification system using local binary patterns. In: 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI), pp. 1–5. IEEE (2012) Happy, S., George, A., Routray, A.: A real time facial expression classification system using local binary patterns. In: 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI), pp. 1–5. IEEE (2012)
13.
Zurück zum Zitat Woolf, B., Burelson, W., Arroyo, I.: Emotional intelligence for computer tutors. In: Workshop On Modeling and Scaffolding Affective Experiences to Impact Learning at 13th International Conference on Artificial Intelligence in Education, Los Angeles, California. (2007) Woolf, B., Burelson, W., Arroyo, I.: Emotional intelligence for computer tutors. In: Workshop On Modeling and Scaffolding Affective Experiences to Impact Learning at 13th International Conference on Artificial Intelligence in Education, Los Angeles, California. (2007)
14.
Zurück zum Zitat Feidakis, M., Daradoumis, T., Caballé, S., Conesa, J.: Measuring the Impact of Emotion Awareness on e-learning Situations. In: 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 391–396. IEEE (2013) Feidakis, M., Daradoumis, T., Caballé, S., Conesa, J.: Measuring the Impact of Emotion Awareness on e-learning Situations. In: 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 391–396. IEEE (2013)
15.
Zurück zum Zitat Startsev, M., Zemblys, R.: Evaluating eye movement event detection: a review of the state of the art. Behav. Res. Methods 55, 1653–1714 (2023)CrossRef Startsev, M., Zemblys, R.: Evaluating eye movement event detection: a review of the state of the art. Behav. Res. Methods 55, 1653–1714 (2023)CrossRef
16.
Zurück zum Zitat Deubel, H., Schneider, W.X.: Saccade target selection and object recognition: evidence for a common attentional mechanism. Vision. Res. 36, 1827–1837 (1996)CrossRef Deubel, H., Schneider, W.X.: Saccade target selection and object recognition: evidence for a common attentional mechanism. Vision. Res. 36, 1827–1837 (1996)CrossRef
17.
Zurück zum Zitat Lu, Y., Liu, C., Chang, F., Liu, H., Huan, H.: JHPFA-Net: Joint Head Pose and Facial Action Network for Driver Yawning Detection Across Arbitrary Poses in Videos. IEEE Trans. Intell. Transp. Syst. 24, 11850–11863 (2023)CrossRef Lu, Y., Liu, C., Chang, F., Liu, H., Huan, H.: JHPFA-Net: Joint Head Pose and Facial Action Network for Driver Yawning Detection Across Arbitrary Poses in Videos. IEEE Trans. Intell. Transp. Syst. 24, 11850–11863 (2023)CrossRef
19.
Zurück zum Zitat Ezerceli, Ö., Eskil, M.T.: Convolutional neural network (CNN) algorithm based facial emotion recognition (FER) system for FER-2013 dataset. In: 2022 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), pp. 1–6. IEEE (2013) Ezerceli, Ö., Eskil, M.T.: Convolutional neural network (CNN) algorithm based facial emotion recognition (FER) system for FER-2013 dataset. In: 2022 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), pp. 1–6. IEEE (2013)
20.
Zurück zum Zitat Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23, 1499–1503 (2016)CrossRef Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23, 1499–1503 (2016)CrossRef
21.
Zurück zum Zitat Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017) Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861 (2017)
22.
Zurück zum Zitat Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017) Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
23.
Zurück zum Zitat Sharma, P., et al.: Student engagement detection using emotion analysis, eye tracking and head movement with machine learning. In: Reis, A., Barroso, J., Martins, P., Jimoyiannis, A., Huang, R.-M., Henriques, R. (eds.) Technology and Innovation in Learning, Teaching and Education: Third International Conference, TECH-EDU 2022, Lisbon, Portugal, August 31–September 2, 2022, Revised Selected Papers, pp. 52–68. Springer Nature Switzerland, Cham (2022). https://doi.org/10.1007/978-3-031-22918-3_5CrossRef Sharma, P., et al.: Student engagement detection using emotion analysis, eye tracking and head movement with machine learning. In: Reis, A., Barroso, J., Martins, P., Jimoyiannis, A., Huang, R.-M., Henriques, R. (eds.) Technology and Innovation in Learning, Teaching and Education: Third International Conference, TECH-EDU 2022, Lisbon, Portugal, August 31–September 2, 2022, Revised Selected Papers, pp. 52–68. Springer Nature Switzerland, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-22918-3_​5CrossRef
24.
Zurück zum Zitat Mishra, S., Minh, C.S., Chuc, H.T., Long, T.V., Nguyen, T.T.: Automated Robot (Car) using Artificial Intelligence. In: 2021 International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), pp. 319–324. IEEE (2021) Mishra, S., Minh, C.S., Chuc, H.T., Long, T.V., Nguyen, T.T.: Automated Robot (Car) using Artificial Intelligence. In: 2021 International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), pp. 319–324. IEEE (2021)
26.
Zurück zum Zitat Mishra, S., Thanh, L.T.: SATMeas - object detection and measurement: canny edge detection algorithm. In: Pan, X., Jin, T., Zhang, L.-J. (eds.) Artificial Intelligence and Mobile Services – AIMS 2022: 11th International Conference, Held as Part of the Services Conference Federation, SCF 2022, Honolulu, HI, USA, December 10–14, 2022, Proceedings, pp. 91–101. Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-031-23504-7_7CrossRef Mishra, S., Thanh, L.T.: SATMeas - object detection and measurement: canny edge detection algorithm. In: Pan, X., Jin, T., Zhang, L.-J. (eds.) Artificial Intelligence and Mobile Services – AIMS 2022: 11th International Conference, Held as Part of the Services Conference Federation, SCF 2022, Honolulu, HI, USA, December 10–14, 2022, Proceedings, pp. 91–101. Springer International Publishing, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-23504-7_​7CrossRef
27.
Zurück zum Zitat Shorten, C., Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data 6, 1–48 (2019)CrossRef Shorten, C., Khoshgoftaar, T.M.: A survey on image data augmentation for deep learning. J. Big Data 6, 1–48 (2019)CrossRef
28.
Zurück zum Zitat Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35, 1299–1312 (2016)CrossRef Tajbakhsh, N., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35, 1299–1312 (2016)CrossRef
Metadaten
Titel
Advancing Online Education: An Artificial Intelligence Applied System for Monitoring and Improving Employee Engagement in Enterprise Information Systems
verfasst von
Nguyen Thanh Son
Trong Tien Hoang
Satyam Mishra
Nguyen Thi Bich Thuy
Tran Huu Tam
Cong-Doan Truong
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-59462-5_1

Premium Partner