Article Sidebar

Download
PDF
Statistic
Read Counter : 113 Download : 46

Main Article Content

Abstract

The emergence of ChatGPT in November 2022 disrupted practice in knowledge work and defied performance-measurement systems in human-exclusive task accomplishment under unprecedented comparability. This current study fills the gap in the literature between traditional models of appraisal and AI-enabled workspaces through the development of an evidence-based model of measuring performance in human-AI collaborative settings. Drawing on systematic analysis of 5,000 LinkedIn job adverts and 2,000 Indeed salary information between 2022-2024, the present study examined the shift in performance needs and skill needs in knowledge sectors following the release of ChatGPT. The study's findings indicated that AI skills are especially needed in 27.8% of knowledge workers' jobs, with a growth rate of 376% since the release of ChatGPT. AI-trained staff are rewarded with a 17.7% overall premium for their wages, and occupational competence varies from 43.2% in high-tech to 9.7% in the public sector. Systematic skill differences cannot be captured by conventional measuring systems, according to the results. The study discovers a three-dimensional model for measuring performance, including AI Tool Mastery, Collaborative Work Quality, and Human-AI Synergy to measure hybrid skills developed through human-machine collaboration. The research establishes the theory of performance management by developing operational measurement solutions for companies going through workplace redesign due to AI.

Keywords

Performance evaluation ChatGPT Human-AI collaboration Knowledge workers AI skills

Article Details

Author Biographies

Zhixin Yu, University College Dublin, National University of Ireland, Dublin, Ireland, D04V1W8

ZHI-XIN YU,Male
Currently pursuing a Master’s degree in Management at University College Dublin, Ireland. His academic focus includes:
Market, brand, and customer relationship research and development; marketing strategy formulation, data analytics-driven decision-making, and implementation; new retail, supply chain, IoT, and consumer experience research; macroeconomic and digital economy policy analysis; public administration and management decision theory; human resources and performance management; production operation planning and decision-making, among other areas.

Zhicheng Yu, University College Dublin, National University of Ireland, Dublin, Ireland, D04V1W8

ZHI-CHENG YU,Male
Currently pursuing a Master’s degree in Management at University College Dublin, Ireland. His academic focus includes:
Market, brand, and customer relationship research and development; marketing strategy formulation, data analytics-driven decision-making, and implementation; new retail, supply chain, IoT, and consumer experience research; macroeconomic and digital economy policy analysis; public administration and management decision theory; human resources and performance management; production operation planning and decision-making, among other areas.

How to Cite
Yu, Z., & Yu, Z. (2025). Reconstruction of knowledge worker performance evaluation system in the ChatGPT era: an exploratory study based on human-AI collaborative work model. Future Technology, 5(1), 47–54. Retrieved from https://fupubco.com/futech/article/view/540
Download Citation
Endnote/Zotero/Mendeley (RIS)
BibTeX
Bookmark and Share

References

  1. Y. K. Dwivedi et al., "Opinion Paper:“So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy," International journal of information management, vol. 71, p. 102642, 2023. https://doi.org/10.1016/j.ijinfomgt.2023.102642
  2. S. Noy and W. Zhang, "Experimental evidence on the productivity effects of generative artificial intelligence," Science, vol. 381, no. 6654, pp. 187-192, Jul 14 2023, doi: 10.1126/science.adh2586. DOI:10.1126/science.adh2586
  3. E. Brynjolfsson, D. Li, and L. Raymond, "Generative AI at work," The Quarterly Journal of Economics, vol. 140, no. 2, pp. 889-942, 2025. https://doi.org/10.1093/qje/qjae044
  4. A. M. Bettayeb, M. Abu Talib, A. Z. Sobhe Altayasinah, and F. Dakalbab, "Exploring the impact of ChatGPT: conversational AI in education," in Frontiers in Education, 2024, vol. 9: Frontiers Media SA, p. 1379796. https://doi.org/10.3389/feduc.2024.1379796
  5. A. M. Hasanein and A. E. E. Sobaih, "Drivers and consequences of ChatGPT use in higher education: Key stakeholder perspectives," European journal of investigation in health, psychology and education, vol. 13, no. 11, pp. 2599-2614, 2023. https://doi.org/10.3390/ejihpe13110181
  6. S. Mahapatra, "Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study," Smart Learning Environments, vol. 11, no. 1, p. 9, 2024. https://doi.org/10.1186/s40561-024-00295-9
  7. H. Jo and D.-H. Park, "AI in the workplace: Examining the effects of ChatGPT on information support and knowledge acquisition," International Journal of Human–Computer Interaction, vol. 40, no. 23, pp. 8091-8106, 2024. https://doi.org/10.1080/10447318.2023.2278283
  8. T. C. Brown, P. O’Kane, B. Mazumdar, and M. McCracken, "Performance management: A scoping review of the literature and an agenda for future research," Human Resource Development Review, vol. 18, no. 1, pp. 47-82, 2019. DOI:10.1177/1534484318798533
  9. A. S. DeNisi and K. R. Murphy, "Performance appraisal and performance management: 100 years of progress?," J Appl Psychol, vol. 102, no. 3, pp. 421-433, Mar 2017, doi: 10.1037/apl0000085. https://doi.org/10.1037/apl0000085
  10. S. Bankins, A. C. Ocampo, M. Marrone, S. L. D. Restubog, and S. E. Woo, "A multilevel review of artificial intelligence in organizations: Implications for organizational behavior research and practice," Journal of organizational behavior, vol. 45, no. 2, pp. 159-182, 2024. https://doi.org/10.1002/job.2735
  11. G. Fragiadakis, C. Diou, G. Kousiouris, and M. Nikolaidou, "Evaluating human-ai collaboration: A review and methodological framework," arXiv preprint arXiv:2407.19098, 2024. https://doi.org/10.48550/arXiv.2407.19098
  12. A. Przegalinska, T. Triantoro, A. Kovbasiuk, L. Ciechanowski, R. B. Freeman, and K. Sowa, "Collaborative AI in the workplace: Enhancing organizational performance through resource-based and task-technology fit perspectives," International Journal of Information Management, vol. 81, p. 102853, 2025.https://doi.org/10.1016/j.ijinfomgt.2024.102853
  13. Y. Liu and Y. Li, "Does human-AI collaboration promote or hinder employees’ safety performance? A job demands-resources perspective," Safety Science, vol. 188, p. 106872, 2025. https://doi.org/10.1016/j.ssci.2025.106872
  14. J. Senoner, S. Schallmoser, B. Kratzwald, S. Feuerriegel, and T. Netland, "Explainable AI improves task performance in human-AI collaboration," Sci Rep, vol. 14, no. 1, p. 31150, Dec 28 2024. https://doi.org/10.1038/s41598-024-82501-9
  15. S. Berretta, A. Tausch, G. Ontrup, B. Gilles, C. Peifer, and A. Kluge, "Defining human-AI teaming the human-centered way: a scoping review and network analysis," Frontiers in Artificial Intelligence, vol. 6, p. 1250725, 2023. https://doi.org/10.3389/frai.2023.1250725
  16. Y. Wen, J. Wang, and X. Chen, "Trust and AI weight: human-AI collaboration in organizational management decision-making," Frontiers in Organizational Psychology, vol. 3, p. 1419403, 2025. https://doi.org/10.3389/forgp.2025.1419403
  17. Y. Y. Liao, E. Soltani, A. Iqbal, and R. van der Meer, "The utility of performance review systems: a total quality management perspective," Strategic Change, vol. 33, no. 4, pp. 287-310, 2024. https://doi.org/10.1002/jsc.2580
  18. L. Babashahi et al., "AI in the workplace: A systematic review of skill transformation in the industry," Administrative Sciences, vol. 14, no. 6, p. 127, 2024. https://doi.org/10.3390/admsci14060127
  19. S. Morandini, F. Fraboni, M. De Angelis, G. Puzzo, D. Giusino, and L. Pietrantoni, "The impact of artificial intelligence on workers’ skills: Upskilling and reskilling in organisations," Informing Science, vol. 26, pp. 39-68, 2023. https://doi.org/10.28945/5078
  20. D. Tranfield, D. Denyer, and P. Smart, "Towards a methodology for developing evidence‐informed management knowledge by means of systematic review," British journal of management, vol. 14, no. 3, pp. 207-222, 2003. https://doi.org/10.1111/1467-8551.00375
  21. S. Zhang, A. H. A. Hamid, and B. S. Alias, "A Study on Research Performance Evaluation: A Systematic Literature Review," Journal of Scientometric Research, vol. 14, no. 2, pp. 383-398, 2025. https://doi.org/10.5530/jscires.20251910
  22. P. Varsha, A. Chakraborty, and A. K. Kar, "How to undertake an impactful literature review: Understanding review approaches and guidelines for high-impact systematic literature reviews," South Asian Journal of Business and Management Cases, vol. 13, no. 1, pp. 18-35, 2024. DOI:10.1177/22779779241227654
  23. C. Mio, A. Costantini, and S. Panfilo, "Performance measurement tools for sustainable business: A systematic literature review on the sustainability balanced scorecard use," Corporate social responsibility and environmental management, vol. 29, no. 2, pp. 367-384, 2022. https://doi.org/10.1002/csr.2206
  24. A. Cebulla and Z. Szpak, "Workplace Relations with AI in Mind: What Is Likely to Change?," in The Future of Work and Technology: Chapman and Hall/CRC, 2023, pp. 151-172. https://doi.org/10.1201/9781003393757-8
  25. M. Mitchell, "Why AI is harder than we think," arXiv preprint arXiv:2104.12871, 2021. https://doi.org/10.48550/arXiv.2104.12871
  26. Woodruff, Allison, et al. "How knowledge workers think generative ai will (not) transform their industries." Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. 2024.https://doi.org/10.1145/3613904.364270
  27. J. Howard, "Artificial intelligence: Implications for the future of work," Am J Ind Med, vol. 62, no. 11, pp. 917-926, Nov 2019, doi: 10.1002/ajim.23037. https://doi.org/10.1002/ajim.23037
  28. A. Zirar, S. I. Ali, and N. Islam, "Worker and workplace Artificial Intelligence (AI) coexistence: Emerging themes and research agenda," Technovation, vol. 124, p. 102747, 2023. https://doi.org/10.1016/j.technovation.2023.102747
  29. M. I. Biswas, M. S. Talukder, and A. R. Khan, "Who do you choose? Employees' perceptions of artificial intelligence versus humans in performance feedback," China Accounting and Finance Review, vol. 26, no. 4, pp. 512-532, 2024. https://doi.org/10.1108/CAFR-08-2023-0095
  30. I. do Carmo Lameque, M. J. P. Velez, and C. M. D. A. Botelho, "Purposes of performance appraisal: A systematic review and agenda for future research," International Journal of Professional Business Review: Int. J. Prof. Bus. Rev., vol. 8, no. 7, p. 40, 2023. DOI:10.26668/businessreview/2023.v8i7.2274
  31. R. Bukartaite and D. Hooper, "Automation, artificial intelligence and future skills needs: an Irish perspective," European Journal of Training and Development, vol. 47, no. 10, pp. 163-185, 2023. https://doi.org/10.1108/EJTD-03-2023-0045
  32. K. R. Murphy, "Performance evaluation will not die, but it should," Human Resource Management Journal, vol. 30, no. 1, pp. 13-31, 2020. https://doi.org/10.1111/1748-8583.12259
  33. H. G. Óskarsdóttir, G. V. Oddsson, J. Þ. Sturluson, and R. J. Sæmundsson, "Towards a holistic framework of knowledge worker productivity," Administrative sciences, vol. 12, no. 2, p. 50, 2022. https://doi.org/10.3390/admsci12020050
  34. M. Cosa and R. Torelli, "Digital transformation and flexible performance management: A systematic literature review of the evolution of performance measurement systems," Global Journal of Flexible Systems Management, vol. 25, no. 3, pp. 445-466, 2024. https://doi.org/10.1007/s40171-024-00409-9
  35. H. Sandall, L. M. C. e. Silva, and F. Queiroga, "A comprehensive approach to job performance in the service sector: A systematic literature review," BAR-Brazilian Administration Review, vol. 19, no. 02, p. e210046, 2022. DOI:10.1590/1807-7692bar2022210046
  36. H. M. Alzoubi, M. In'airat, and G. Ahmed, "Investigating the impact of total quality management practices and Six Sigma processes to enhance the quality and reduce the cost of quality: the case of Dubai," International journal of business excellence, vol. 27, no. 1, pp. 94-109, 2022. DOI:10.1504/IJBEX.2020.10039342
  37. N. Khan, Z. Khan, A. Koubaa, M. K. Khan, and R. B. Salleh, "Global insights and the impact of generative AI-ChatGPT on multidisciplinary: a systematic review and bibliometric analysis," Connection science, vol. 36, no. 1, p. 2353630, 2024. DOI:10.36227/techrxiv.171466626.67294030/v1
  38. J. Dempere, K. Modugu, A. Hesham, and L. K. Ramasamy, "The impact of ChatGPT on higher education," in Frontiers in Education, 2023, vol. 8: Frontiers Media SA, p. 1206936. https://doi.org/10.3389/feduc.2023.1206936
  39. L. Isiaku, A. S. Muhammad, H. I. Kefas, and F. C. Ukaegbu, "Enhancing technological sustainability in academia: leveraging ChatGPT for teaching, learning and evaluation," Quality Education for All, vol. 1, no. 1, pp. 385-416, 2024. https://doi.org/10.1108/QEA-07-2024-0055