Main Article Content

Abstract

This research develops a novel virtual teacher personalized interaction model integrating multimodal affective computing with multi-agent coordination mechanisms to address fundamental limitations in emotional intelligence and adaptive capabilities within contemporary educational technology systems. A three-layer distributed architecture was implemented, incorporating synchronized multimodal emotion recognition through confidence-weighted fusion of facial, vocal, and textual data streams, Byzantine Fault Tolerant consensus algorithms for coordinated multi-agent decision-making, and dynamic personality adaptation mechanisms based on Big Five psychological modeling. Experimental validation employed 500 participants across diverse educational contexts using established emotion recognition benchmarks supplemented with domain-specific educational interaction datasets. The multimodal emotion fusion component achieved 91.2% recognition accuracy, with overall system performance reaching 89.7% under realistic educational conditions while demonstrating substantial educational effectiveness improvements, including 43% higher learner engagement scores, 37% emotional satisfaction enhancement, 30% learning effectiveness increase, and 40% knowledge retention improvement compared to traditional virtual teaching approaches. Multi-agent coordination exhibited superior decision quality with 31% improvement over single-agent baselines, though personality adaptation effectiveness varied significantly across learner populations with 88% success rates for extraverted individuals compared to 65% for high-neuroticism learners. The integrated approach successfully bridges the emotional intelligence gap in virtual educational systems through sophisticated technological convergence, establishing theoretical foundations for distributed educational intelligence while revealing important implementation challenges. This research enables the development of emotionally responsive virtual teachers capable of sustained personalized instruction across diverse educational contexts, though deployment requires careful consideration of privacy protection and institutional adaptation requirements for broader educational technology transformation.

Keywords

Virtual teacher Affective computing Multi-agent systems Personalized learning Intelligent teaching systems

Article Details

Author Biographies

Rili Dang, Universiti Tun Hussein Onn Malaysia (UTHM), Panchor 84600, Johor, Malaysia

Rili DANG is currently pursuing the doctoral degree in Vocational and Technical Education with Universiti Tun Hussein Onn Malaysia (UTHM), Panchor , Johor, Malaysia. Additionally, she works in student management at Zhuhai City Polytechnic, Zhuhai , Guangdong, China.

Noorazman Abd Samad, Universiti Tun Hussein Onn Malaysia (UTHM), Panchor 84600, Johor, Malaysia

Noorazman Abd Samad is the Principal Investigator at the Faculty of Technical and Vocational Education, Data Analytics and Applications (DAA), Universiti Tun Hussein Onn Malaysia (UTHM).

How to Cite
Dang, R., & Abd Samad, N. (2025). Research on a virtual teacher personalized interaction model integrating affective computing and multi-agent systems. Future Technology, 4(4), 159–172. Retrieved from https://fupubco.com/futech/article/view/458
Bookmark and Share

References

  1. Pei, G., et al., Affective computing: Recent advances, challenges, and future trends. Intelligent Computing, 2024. 3: p. 0076.http://dx.doi.org/10.34133/icomputing.0076
  2. Vistorte, A.O.R., et al., Integrating artificial intelligence to assess emotions in learning environments: a systematic literature review. Frontiers in psychology, 2024. 15: p. 1387089.http://dx.doi.org/10.3389/fpsyg.2024.1387089
  3. Sethi, S.S. and K. Jain, AI technologies for social emotional learning: recent research and future directions. Journal of Research in Innovative Teaching & Learning, 2024. 17(2): p. 213-225.http://dx.doi.org/10.1108/JRIT-03-2024-0073
  4. Schroeder, N.L. and S.D. Craig, Learning with virtual humans: Introduction to the special issue. 2021, Taylor & Francis. p. 1-7.http://dx.doi.org/10.1080/15391523.2020.1863114
  5. Alzubaidi, L., et al., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of big Data, 2021. 8: p. 1-74.http://dx.doi.org/10.1186/s40537-021-00444-8
  6. Lv, Z., et al., Deep learning for intelligent human–computer interaction. Applied Sciences, 2022. 12(22): p. 11457.http://dx.doi.org/10.3390/app122211457
  7. Lippert, A., et al., Multiple agent designs in conversational intelligent tutoring systems. Technology, Knowledge and Learning, 2020. 25(3): p. 443-463.http://dx.doi.org/10.1007/s10758-019-09431-8
  8. Kabudi, T., I. Pappas, and D.H. Olsen, AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and education: Artificial intelligence, 2021. 2: p. 100017.http://dx.doi.org/10.1016/j.caeai.2021.100017
  9. Létourneau, A., et al., A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. npj Science of Learning, 2025. 10(1): p. 29.http://dx.doi.org/10.1038/s41539-025-00320-7
  10. Lin, C.-C., A.Y. Huang, and O.H. Lu, Artificial intelligence in intelligent tutoring systems toward sustainable education: a systematic review. Smart Learning Environments, 2023. 10(1): p. 41.http://dx.doi.org/10.1186/s40561-023-00260-y
  11. Essa, S.G., T. Celik, and N.E. Human-Hendricks, Personalized adaptive learning technologies based on machine learning techniques to identify learning styles: A systematic literature review. IEEE Access, 2023. 11: p. 48392-48409.http://dx.doi.org/10.1109/ACCESS.2023.3276439
  12. Ortega‐Ochoa, E., M. Arguedas, and T. Daradoumis, Empathic pedagogical conversational agents: a systematic literature review. British Journal of Educational Technology, 2024. 55(3): p. 886-909.http://dx.doi.org/10.1111/bjet.13413
  13. Pereira, D.S., et al., Here's to the future: Conversational agents in higher education-a scoping review. International Journal of Educational Research, 2023. 122: p. 102233.http://dx.doi.org/10.1016/j.ijer.2023.102233
  14. Yusuf, H., A. Money, and D. Daylamani-Zad, Pedagogical AI conversational agents in higher education: a conceptual framework and survey of the state of the art. Educational technology research and development, 2025: p. 1-60.http://dx.doi.org/10.1007/s11423-025-10447-4
  15. Zhang, Y. and W. Pan, A scoping review of embodied conversational agents in education: trends and innovations from 2014 to 2024. Interactive Learning Environments, 2025: p. 1-22.http://dx.doi.org/10.1080/10494820.2025.2468972
  16. Lampropoulos, G., et al., Affective computing in augmented reality, virtual reality, and immersive learning environments. Electronics, 2024. 13(15): p. 2917.http://dx.doi.org/10.3390/electronics13152917
  17. Fernández-Herrero, J., Evaluating recent advances in affective intelligent tutoring systems: A scoping review of educational impacts and future prospects. 2024.http://dx.doi.org/10.3390/educsci14080839
  18. Spice, B., New AI enables teachers to rapidly develop intelligent tutoring systems. Carnegie Mellon University, May, 2020. 6: p. 2020.https://www.cmu.edu/dietrich/news/news-stories/2020/april/intelligent-tutor.html
  19. Hube, N., et al., A study on the influence of situations on personal avatar characteristics. Visual Computing for Industry, Biomedicine, and Art, 2024. 7(1): p. 23.http://dx.doi.org/10.1186/s42492-024-00174-7
  20. Winkler, R., et al. Sara, the lecturer: Improving learning in online education with a scaffolding-based conversational agent. in Proceedings of the 2020 CHI conference on human factors in computing systems. 2020.http://dx.doi.org/10.1145/3313831.3376781
  21. Alqarni, A., Artificial Intelligence‐Critical Pedagogic: Design and Psychologic Validation of a Teacher‐Specific Scale for Enhancing Critical Thinking in Classrooms. Journal of Computer Assisted Learning, 2025. 41(3): p. e70039.http://dx.doi.org/10.1111/jcal.70039
  22. Halkiopoulos, C. and E. Gkintoni, Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology—A systematic analysis. Electronics, 2024. 13(18): p. 3762.http://dx.doi.org/10.3390/electronics13183762
  23. Salloum, S.A., et al., Emotion recognition for enhanced learning: using AI to detect students’ emotions and adjust teaching methods. Smart Learning Environments, 2025. 12(1): p. 21.http://dx.doi.org/10.1186/s40561-025-00374-5
  24. Wang, T., et al. Llm-powered multi-agent framework for goal-oriented learning in intelligent tutoring system. in Companion Proceedings of the ACM on Web Conference 2025. 2025.http://dx.doi.org/10.48550/arXiv.2501.15749
  25. MADHAVAN, S.M.M.K., et al., Multi-Agent System for Cognitive Assessment using Deep Learning. Science and Technology, 2025. 7(02).https://www.ijadst.com/ajradmin/certificates/467/IJADST_20250479.pdf
  26. Chu, Z., et al., Llm agents for education: Advances and applications. arXiv preprint arXiv:2503.11733, 2025.http://dx.doi.org/10.48550/arXiv.2503.11733
  27. Lindberg, S., Using virtual simulations with avatars to train pre-service special needs teachers’ relational competence: possibilities and limitations. Cogent Education, 2025. 12(1): p. 2457290.http://dx.doi.org/10.1080/2331186X.2025.2457290
  28. Son, G., A. Tiemann, and M. Rubo, I am here with you: an examination of factors relating to social presence in social VR. Frontiers in Virtual Reality, 2025. 6: p. 1558233.http://dx.doi.org/10.3389/frvir.2025.1558233
  29. Strielkowski, W., et al., AI‐driven adaptive learning for sustainable educational transformation. Sustainable Development, 2025. 33(2): p. 1921-1947.http://dx.doi.org/10.1002/sd.3221
  30. Park, J., et al. The Impact of Observer Presence on Trainees' Mental States and Performance in Remote Military Training with Virtual Humans in Mixed Reality Environment. in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. 2025.http://dx.doi.org/10.1145/3706598.371351