Main Article Content
Abstract
This research develops a novel virtual teacher personalized interaction model integrating multimodal affective computing with multi-agent coordination mechanisms to address fundamental limitations in emotional intelligence and adaptive capabilities within contemporary educational technology systems. A three-layer distributed architecture was implemented, incorporating synchronized multimodal emotion recognition through confidence-weighted fusion of facial, vocal, and textual data streams, Byzantine Fault Tolerant consensus algorithms for coordinated multi-agent decision-making, and dynamic personality adaptation mechanisms based on Big Five psychological modeling. Experimental validation employed 500 participants across diverse educational contexts using established emotion recognition benchmarks supplemented with domain-specific educational interaction datasets. The multimodal emotion fusion component achieved 91.2% recognition accuracy, with overall system performance reaching 89.7% under realistic educational conditions while demonstrating substantial educational effectiveness improvements, including 43% higher learner engagement scores, 37% emotional satisfaction enhancement, 30% learning effectiveness increase, and 40% knowledge retention improvement compared to traditional virtual teaching approaches. Multi-agent coordination exhibited superior decision quality with 31% improvement over single-agent baselines, though personality adaptation effectiveness varied significantly across learner populations with 88% success rates for extraverted individuals compared to 65% for high-neuroticism learners. The integrated approach successfully bridges the emotional intelligence gap in virtual educational systems through sophisticated technological convergence, establishing theoretical foundations for distributed educational intelligence while revealing important implementation challenges. This research enables the development of emotionally responsive virtual teachers capable of sustained personalized instruction across diverse educational contexts, though deployment requires careful consideration of privacy protection and institutional adaptation requirements for broader educational technology transformation.
Keywords
Article Details
References
- Pei, G., et al., Affective computing: Recent advances, challenges, and future trends. Intelligent Computing, 2024. 3: p. 0076.http://dx.doi.org/10.34133/icomputing.0076
- Vistorte, A.O.R., et al., Integrating artificial intelligence to assess emotions in learning environments: a systematic literature review. Frontiers in psychology, 2024. 15: p. 1387089.http://dx.doi.org/10.3389/fpsyg.2024.1387089
- Sethi, S.S. and K. Jain, AI technologies for social emotional learning: recent research and future directions. Journal of Research in Innovative Teaching & Learning, 2024. 17(2): p. 213-225.http://dx.doi.org/10.1108/JRIT-03-2024-0073
- Schroeder, N.L. and S.D. Craig, Learning with virtual humans: Introduction to the special issue. 2021, Taylor & Francis. p. 1-7.http://dx.doi.org/10.1080/15391523.2020.1863114
- Alzubaidi, L., et al., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of big Data, 2021. 8: p. 1-74.http://dx.doi.org/10.1186/s40537-021-00444-8
- Lv, Z., et al., Deep learning for intelligent human–computer interaction. Applied Sciences, 2022. 12(22): p. 11457.http://dx.doi.org/10.3390/app122211457
- Lippert, A., et al., Multiple agent designs in conversational intelligent tutoring systems. Technology, Knowledge and Learning, 2020. 25(3): p. 443-463.http://dx.doi.org/10.1007/s10758-019-09431-8
- Kabudi, T., I. Pappas, and D.H. Olsen, AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and education: Artificial intelligence, 2021. 2: p. 100017.http://dx.doi.org/10.1016/j.caeai.2021.100017
- Létourneau, A., et al., A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. npj Science of Learning, 2025. 10(1): p. 29.http://dx.doi.org/10.1038/s41539-025-00320-7
- Lin, C.-C., A.Y. Huang, and O.H. Lu, Artificial intelligence in intelligent tutoring systems toward sustainable education: a systematic review. Smart Learning Environments, 2023. 10(1): p. 41.http://dx.doi.org/10.1186/s40561-023-00260-y
- Essa, S.G., T. Celik, and N.E. Human-Hendricks, Personalized adaptive learning technologies based on machine learning techniques to identify learning styles: A systematic literature review. IEEE Access, 2023. 11: p. 48392-48409.http://dx.doi.org/10.1109/ACCESS.2023.3276439
- Ortega‐Ochoa, E., M. Arguedas, and T. Daradoumis, Empathic pedagogical conversational agents: a systematic literature review. British Journal of Educational Technology, 2024. 55(3): p. 886-909.http://dx.doi.org/10.1111/bjet.13413
- Pereira, D.S., et al., Here's to the future: Conversational agents in higher education-a scoping review. International Journal of Educational Research, 2023. 122: p. 102233.http://dx.doi.org/10.1016/j.ijer.2023.102233
- Yusuf, H., A. Money, and D. Daylamani-Zad, Pedagogical AI conversational agents in higher education: a conceptual framework and survey of the state of the art. Educational technology research and development, 2025: p. 1-60.http://dx.doi.org/10.1007/s11423-025-10447-4
- Zhang, Y. and W. Pan, A scoping review of embodied conversational agents in education: trends and innovations from 2014 to 2024. Interactive Learning Environments, 2025: p. 1-22.http://dx.doi.org/10.1080/10494820.2025.2468972
- Lampropoulos, G., et al., Affective computing in augmented reality, virtual reality, and immersive learning environments. Electronics, 2024. 13(15): p. 2917.http://dx.doi.org/10.3390/electronics13152917
- Fernández-Herrero, J., Evaluating recent advances in affective intelligent tutoring systems: A scoping review of educational impacts and future prospects. 2024.http://dx.doi.org/10.3390/educsci14080839
- Spice, B., New AI enables teachers to rapidly develop intelligent tutoring systems. Carnegie Mellon University, May, 2020. 6: p. 2020.https://www.cmu.edu/dietrich/news/news-stories/2020/april/intelligent-tutor.html
- Hube, N., et al., A study on the influence of situations on personal avatar characteristics. Visual Computing for Industry, Biomedicine, and Art, 2024. 7(1): p. 23.http://dx.doi.org/10.1186/s42492-024-00174-7
- Winkler, R., et al. Sara, the lecturer: Improving learning in online education with a scaffolding-based conversational agent. in Proceedings of the 2020 CHI conference on human factors in computing systems. 2020.http://dx.doi.org/10.1145/3313831.3376781
- Alqarni, A., Artificial Intelligence‐Critical Pedagogic: Design and Psychologic Validation of a Teacher‐Specific Scale for Enhancing Critical Thinking in Classrooms. Journal of Computer Assisted Learning, 2025. 41(3): p. e70039.http://dx.doi.org/10.1111/jcal.70039
- Halkiopoulos, C. and E. Gkintoni, Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology—A systematic analysis. Electronics, 2024. 13(18): p. 3762.http://dx.doi.org/10.3390/electronics13183762
- Salloum, S.A., et al., Emotion recognition for enhanced learning: using AI to detect students’ emotions and adjust teaching methods. Smart Learning Environments, 2025. 12(1): p. 21.http://dx.doi.org/10.1186/s40561-025-00374-5
- Wang, T., et al. Llm-powered multi-agent framework for goal-oriented learning in intelligent tutoring system. in Companion Proceedings of the ACM on Web Conference 2025. 2025.http://dx.doi.org/10.48550/arXiv.2501.15749
- MADHAVAN, S.M.M.K., et al., Multi-Agent System for Cognitive Assessment using Deep Learning. Science and Technology, 2025. 7(02).https://www.ijadst.com/ajradmin/certificates/467/IJADST_20250479.pdf
- Chu, Z., et al., Llm agents for education: Advances and applications. arXiv preprint arXiv:2503.11733, 2025.http://dx.doi.org/10.48550/arXiv.2503.11733
- Lindberg, S., Using virtual simulations with avatars to train pre-service special needs teachers’ relational competence: possibilities and limitations. Cogent Education, 2025. 12(1): p. 2457290.http://dx.doi.org/10.1080/2331186X.2025.2457290
- Son, G., A. Tiemann, and M. Rubo, I am here with you: an examination of factors relating to social presence in social VR. Frontiers in Virtual Reality, 2025. 6: p. 1558233.http://dx.doi.org/10.3389/frvir.2025.1558233
- Strielkowski, W., et al., AI‐driven adaptive learning for sustainable educational transformation. Sustainable Development, 2025. 33(2): p. 1921-1947.http://dx.doi.org/10.1002/sd.3221
- Park, J., et al. The Impact of Observer Presence on Trainees' Mental States and Performance in Remote Military Training with Virtual Humans in Mixed Reality Environment. in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. 2025.http://dx.doi.org/10.1145/3706598.371351
References
Pei, G., et al., Affective computing: Recent advances, challenges, and future trends. Intelligent Computing, 2024. 3: p. 0076.http://dx.doi.org/10.34133/icomputing.0076
Vistorte, A.O.R., et al., Integrating artificial intelligence to assess emotions in learning environments: a systematic literature review. Frontiers in psychology, 2024. 15: p. 1387089.http://dx.doi.org/10.3389/fpsyg.2024.1387089
Sethi, S.S. and K. Jain, AI technologies for social emotional learning: recent research and future directions. Journal of Research in Innovative Teaching & Learning, 2024. 17(2): p. 213-225.http://dx.doi.org/10.1108/JRIT-03-2024-0073
Schroeder, N.L. and S.D. Craig, Learning with virtual humans: Introduction to the special issue. 2021, Taylor & Francis. p. 1-7.http://dx.doi.org/10.1080/15391523.2020.1863114
Alzubaidi, L., et al., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of big Data, 2021. 8: p. 1-74.http://dx.doi.org/10.1186/s40537-021-00444-8
Lv, Z., et al., Deep learning for intelligent human–computer interaction. Applied Sciences, 2022. 12(22): p. 11457.http://dx.doi.org/10.3390/app122211457
Lippert, A., et al., Multiple agent designs in conversational intelligent tutoring systems. Technology, Knowledge and Learning, 2020. 25(3): p. 443-463.http://dx.doi.org/10.1007/s10758-019-09431-8
Kabudi, T., I. Pappas, and D.H. Olsen, AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and education: Artificial intelligence, 2021. 2: p. 100017.http://dx.doi.org/10.1016/j.caeai.2021.100017
Létourneau, A., et al., A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. npj Science of Learning, 2025. 10(1): p. 29.http://dx.doi.org/10.1038/s41539-025-00320-7
Lin, C.-C., A.Y. Huang, and O.H. Lu, Artificial intelligence in intelligent tutoring systems toward sustainable education: a systematic review. Smart Learning Environments, 2023. 10(1): p. 41.http://dx.doi.org/10.1186/s40561-023-00260-y
Essa, S.G., T. Celik, and N.E. Human-Hendricks, Personalized adaptive learning technologies based on machine learning techniques to identify learning styles: A systematic literature review. IEEE Access, 2023. 11: p. 48392-48409.http://dx.doi.org/10.1109/ACCESS.2023.3276439
Ortega‐Ochoa, E., M. Arguedas, and T. Daradoumis, Empathic pedagogical conversational agents: a systematic literature review. British Journal of Educational Technology, 2024. 55(3): p. 886-909.http://dx.doi.org/10.1111/bjet.13413
Pereira, D.S., et al., Here's to the future: Conversational agents in higher education-a scoping review. International Journal of Educational Research, 2023. 122: p. 102233.http://dx.doi.org/10.1016/j.ijer.2023.102233
Yusuf, H., A. Money, and D. Daylamani-Zad, Pedagogical AI conversational agents in higher education: a conceptual framework and survey of the state of the art. Educational technology research and development, 2025: p. 1-60.http://dx.doi.org/10.1007/s11423-025-10447-4
Zhang, Y. and W. Pan, A scoping review of embodied conversational agents in education: trends and innovations from 2014 to 2024. Interactive Learning Environments, 2025: p. 1-22.http://dx.doi.org/10.1080/10494820.2025.2468972
Lampropoulos, G., et al., Affective computing in augmented reality, virtual reality, and immersive learning environments. Electronics, 2024. 13(15): p. 2917.http://dx.doi.org/10.3390/electronics13152917
Fernández-Herrero, J., Evaluating recent advances in affective intelligent tutoring systems: A scoping review of educational impacts and future prospects. 2024.http://dx.doi.org/10.3390/educsci14080839
Spice, B., New AI enables teachers to rapidly develop intelligent tutoring systems. Carnegie Mellon University, May, 2020. 6: p. 2020.https://www.cmu.edu/dietrich/news/news-stories/2020/april/intelligent-tutor.html
Hube, N., et al., A study on the influence of situations on personal avatar characteristics. Visual Computing for Industry, Biomedicine, and Art, 2024. 7(1): p. 23.http://dx.doi.org/10.1186/s42492-024-00174-7
Winkler, R., et al. Sara, the lecturer: Improving learning in online education with a scaffolding-based conversational agent. in Proceedings of the 2020 CHI conference on human factors in computing systems. 2020.http://dx.doi.org/10.1145/3313831.3376781
Alqarni, A., Artificial Intelligence‐Critical Pedagogic: Design and Psychologic Validation of a Teacher‐Specific Scale for Enhancing Critical Thinking in Classrooms. Journal of Computer Assisted Learning, 2025. 41(3): p. e70039.http://dx.doi.org/10.1111/jcal.70039
Halkiopoulos, C. and E. Gkintoni, Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology—A systematic analysis. Electronics, 2024. 13(18): p. 3762.http://dx.doi.org/10.3390/electronics13183762
Salloum, S.A., et al., Emotion recognition for enhanced learning: using AI to detect students’ emotions and adjust teaching methods. Smart Learning Environments, 2025. 12(1): p. 21.http://dx.doi.org/10.1186/s40561-025-00374-5
Wang, T., et al. Llm-powered multi-agent framework for goal-oriented learning in intelligent tutoring system. in Companion Proceedings of the ACM on Web Conference 2025. 2025.http://dx.doi.org/10.48550/arXiv.2501.15749
MADHAVAN, S.M.M.K., et al., Multi-Agent System for Cognitive Assessment using Deep Learning. Science and Technology, 2025. 7(02).https://www.ijadst.com/ajradmin/certificates/467/IJADST_20250479.pdf
Chu, Z., et al., Llm agents for education: Advances and applications. arXiv preprint arXiv:2503.11733, 2025.http://dx.doi.org/10.48550/arXiv.2503.11733
Lindberg, S., Using virtual simulations with avatars to train pre-service special needs teachers’ relational competence: possibilities and limitations. Cogent Education, 2025. 12(1): p. 2457290.http://dx.doi.org/10.1080/2331186X.2025.2457290
Son, G., A. Tiemann, and M. Rubo, I am here with you: an examination of factors relating to social presence in social VR. Frontiers in Virtual Reality, 2025. 6: p. 1558233.http://dx.doi.org/10.3389/frvir.2025.1558233
Strielkowski, W., et al., AI‐driven adaptive learning for sustainable educational transformation. Sustainable Development, 2025. 33(2): p. 1921-1947.http://dx.doi.org/10.1002/sd.3221
Park, J., et al. The Impact of Observer Presence on Trainees' Mental States and Performance in Remote Military Training with Virtual Humans in Mixed Reality Environment. in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. 2025.http://dx.doi.org/10.1145/3706598.371351