Main Article Content
Abstract
Teacher education programs rarely know which of their students will finish training with a weak sense of themselves as teachers, although such students may be more likely to leave the profession early. This study examined whether weak professional identity among pre-service early childhood teachers in China can be predicted one or two survey waves in advance. We analyzed an open three-wave panel of 1,646 students, trained logistic regression, random forest, and XGBoost models on measures of teacher support, teaching efficacy, and identity, and interpreted the predictions with SHapley Additive exPlanations (SHAP). XGBoost reached an area under the curve (AUC) of 0.712 from first-wave data and 0.749 from second-wave data, and its predicted risks were well calibrated. Logistic regression performed almost as well. Prior identity accounted for most of the predictive accuracy, since a model using first-wave identity alone reached 0.709. Support and efficacy sharpened the separation of individual risk estimates and showed where each student's risk came from. A model built from five subscales of support and efficacy plus demographics, without any identity items, still reached 0.677. Volitional identity, a student's commitment to choosing teaching, was the strongest predictor, and students scoring below 3.0 on it were nearly three times as likely as others to report weak identity two waves later. A program able to counsel one student in five would reach about two in five of the students later at risk, and about half of the students it selected would be true cases.
Keywords
Article Details
References
- Y. Yang, N. Rao, and J. Sun, "From pre-service preparation to professional development: Early childhood teachers' learning experiences, ECE quality, and child development in China," Early Education and Development, vol. 35, no. 5, pp. 1080-1102, 2024, doi: 10.1080/10409289.2024.2336659.
- Q. Ma, "A critical realist explanation of Chinese early childhood teachers' professional identity," Early Childhood Education Journal, vol. 54, no. 7, pp. 6281-6291, 2026, doi: 10.1007/s10643-026-02306-5.
- D. Beijaard, P. C. Meijer, and N. Verloop, "Reconsidering research on teachers' professional identity," Teaching and Teacher Education, vol. 20, no. 2, pp. 107-128, 2004, doi: 10.1016/j.tate.2003.07.001.
- C. Beauchamp and L. Thomas, "Understanding teacher identity: an overview of issues in the literature and implications for teacher education," Cambridge Journal of Education, vol. 39, no. 2, pp. 175-189, 2009, doi: 10.1080/03057640902902252.
- J. Y. Hong, "Pre-service and beginning teachers' professional identity and its relation to dropping out of the profession," Teaching and Teacher Education, vol. 26, no. 8, pp. 1530-1543, 2010, doi: 10.1016/j.tate.2010.06.003.
- D. J. Madigan and L. E. Kim, "Towards an understanding of teacher attrition: A meta-analysis of burnout, job satisfaction, and teachers' intentions to quit," Teaching and Teacher Education, vol. 105, Art. no. 103425, 2021, doi: 10.1016/j.tate.2021.103425.
- S. M. Lundberg and S.-I. Lee, "A unified approach to interpreting model predictions," in Advances in Neural Information Processing Systems 30, 2017, pp. 4765-4774. [Online]. Available: https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html
- S. M. Lundberg, G. Erion, H. Chen, A. DeGrave, J. M. Prutkin, B. Nair, R. Katz, J. Himmelfarb, N. Bansal, and S.-I. Lee, "From local explanations to global understanding with explainable AI for trees," Nature Machine Intelligence, vol. 2, no. 1, pp. 56-67, 2020, doi: 10.1038/s42256-019-0138-9.
- A. K. V. Olsen, I. G. H. Kjær, and K. S. Spieler, "Predictors of professional identity among early childhood teacher students," Education Sciences, vol. 14, no. 6, Art. no. 589, 2024, doi: 10.3390/educsci14060589.
- Y. Dai, X. Yang, and D. Li, "The formation of pre-service ECE teachers' professional identity: The roles of self-efficacy, learning motivation, and engagement," Acta Psychologica, vol. 265, Art. no. 106625, 2026, doi: 10.1016/j.actpsy.2026.106625.
- Y. Liu and Z. Xin, "Emotional labor and professional identity among pre-service early childhood teachers: the mediating role of emotional exhaustion and the moderating role of social and emotional competence," Frontiers in Psychology, vol. 17, Art. no. 1830373, 2026, doi: 10.3389/fpsyg.2026.1830373.
- X. Tian, M. Liu, and T. Yue, "Understanding professional identity through policy and support perceptions: A latent profile study of pre-service preschool teachers in China," Education Sciences, vol. 16, no. 7, Art. no. 1069, 2026, doi: 10.3390/educsci16071069.
- K. Ann and N. Boonnam, "A framework for predicting preservice teacher performance using machine learning and SMOTE-based class imbalance handling," Discover Education, vol. 5, no. 1, Art. no. 765, 2026, doi: 10.1007/s44217-026-02058-9.
- T. Yue, "Dataset for 'Professional identity development among preservice early childhood teachers: A cross-lagged panel network analysis of teacher self-efficacy and perceived teacher support'," Zenodo, 2026, doi: 10.5281/zenodo.20790669.
- F. Rodrigues and M. J. Mogarro, "Student teachers' professional identity: A review of research contributions," Educational Research Review, vol. 28, Art. no. 100286, 2019, doi: 10.1016/j.edurev.2019.100286.
- M. Izadinia, "A review of research on student teachers' professional identity," British Educational Research Journal, vol. 39, no. 4, pp. 694-713, 2013, doi: 10.1080/01411926.2012.679614.
- C. Lamote and N. Engels, "The development of student teachers' professional identity," European Journal of Teacher Education, vol. 33, no. 1, pp. 3-18, 2010, doi: 10.1080/02619760903457735.
- F. Hanna, R. Oostdam, S. E. Severiens, and B. J. H. Zijlstra, "Domains of teacher identity: A review of quantitative measurement instruments," Educational Research Review, vol. 27, pp. 15-27, 2019, doi: 10.1016/j.edurev.2019.01.003.
- E. T. Canrinus, M. Helms-Lorenz, D. Beijaard, J. Buitink, and A. Hofman, "Self-efficacy, job satisfaction, motivation and commitment: exploring the relationships between indicators of teachers' professional identity," European Journal of Psychology of Education, vol. 27, no. 1, pp. 115-132, 2012, doi: 10.1007/s10212-011-0069-2.
- X. Ren, R. Feng, Z. Yan, J. Liu, and Z. Guo, "The relationship between occupational stigma consciousness and occupational identity among pre-service early childhood education teachers in China: a four-year longitudinal study," Frontiers in Psychology, vol. 17, Art. no. 1793509, 2026, doi: 10.3389/fpsyg.2026.1793509.
- R. M. Ryan and E. L. Deci, "Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being," American Psychologist, vol. 55, no. 1, pp. 68-78, 2000, doi: 10.1037/0003-066X.55.1.68.
- A. Bandura, "Self-efficacy: Toward a unifying theory of behavioral change," Psychological Review, vol. 84, no. 2, pp. 191-215, 1977, doi: 10.1037/0033-295X.84.2.191.
- S. Gibson and M. H. Dembo, "Teacher efficacy: A construct validation," Journal of Educational Psychology, vol. 76, no. 4, pp. 569-582, 1984, doi: 10.1037/0022-0663.76.4.569.
- G. Yu, T. Xin, and J. Shen, "Teacher's sense of teaching efficacy: Its structure and influencing factors," Acta Psychologica Sinica, vol. 27, no. 2, pp. 159-166, 1995 (in Chinese). [Online]. Available: https://journal.psych.ac.cn/xlxb/CN/Y1995/V27/I2/159
- R. M. Klassen and M. M. Chiu, "The occupational commitment and intention to quit of practicing and pre-service teachers: Influence of self-efficacy, job stress, and teaching context," Contemporary Educational Psychology, vol. 36, no. 2, pp. 114-129, 2011, doi: 10.1016/j.cedpsych.2011.01.002.
- M. Tschannen-Moran and A. W. Hoy, "Teacher efficacy: capturing an elusive construct," Teaching and Teacher Education, vol. 17, no. 7, pp. 783-805, 2001, doi: 10.1016/S0742-051X(01)00036-1.
- A. J. Bowers, R. Sprott, and S. A. Taff, "Do we know who will drop out? A review of the predictors of dropping out of high school: Precision, sensitivity, and specificity," The High School Journal, vol. 96, no. 2, pp. 77-100, 2013, doi: 10.1353/hsj.2013.0000.
- C. Romero and S. Ventura, "Educational data mining and learning analytics: An updated survey," WIREs Data Mining and Knowledge Discovery, vol. 10, no. 3, Art. no. e1355, 2020, doi: 10.1002/widm.1355.
- T. Chen and C. Guestrin, "XGBoost: A scalable tree boosting system," in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 785-794, doi: 10.1145/2939672.2939785.
- J. H. Friedman, "Greedy function approximation: A gradient boosting machine," The Annals of Statistics, vol. 29, no. 5, pp. 1189-1232, 2001, doi: 10.1214/aos/1013203451.
- R. Shwartz-Ziv and A. Armon, "Tabular data: Deep learning is not all you need," Information Fusion, vol. 81, pp. 84-90, 2022, doi: 10.1016/j.inffus.2021.11.011.
- S. Tao, H. Zhang, and L. Ding, "Explainable machine learning for sustainable education: Predicting college students' reliance on generative artificial intelligence," Acta Psychologica, vol. 265, Art. no. 106622, 2026, doi: 10.1016/j.actpsy.2026.106622.
- G. Słowiński, Y. Kapranov, and B. Iwanowska, "Threshold-like structure and barrier-benefit asymmetry in students' behavioural intention toward e-learning: An explainable machine learning analysis in post-pandemic higher education," Sustainability, vol. 18, no. 10, Art. no. 4633, 2026, doi: 10.3390/su18104633.
- E. Christodoulou, J. Ma, G. S. Collins, E. W. Steyerberg, J. Y. Verbakel, and B. Van Calster, "A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models," Journal of Clinical Epidemiology, vol. 110, pp. 12-22, 2019, doi: 10.1016/j.jclinepi.2019.02.004.
- S. Varma and R. Simon, "Bias in error estimation when using cross-validation for model selection," BMC Bioinformatics, vol. 7, Art. no. 91, 2006, doi: 10.1186/1471-2105-7-91.
- B. Van Calster, D. J. McLernon, M. van Smeden, L. Wynants, and E. W. Steyerberg, "Calibration: the Achilles heel of predictive analytics," BMC Medicine, vol. 17, Art. no. 230, 2019, doi: 10.1186/s12916-019-1466-7.
- A. J. Vickers and E. B. Elkin, "Decision curve analysis: A novel method for evaluating prediction models," Medical Decision Making, vol. 26, no. 6, pp. 565-574, 2006, doi: 10.1177/0272989X06295361.
- H. Khosravi, S. Buckingham Shum, G. Chen, C. Conati, Y.-S. Tsai, J. Kay, S. Knight, R. Martinez-Maldonado, S. Sadiq, and D. Gašević, "Explainable artificial intelligence in education," Computers and Education: Artificial Intelligence, vol. 3, Art. no. 100074, 2022, doi: 10.1016/j.caeai.2022.100074.
- C. Rudin, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead," Nature Machine Intelligence, vol. 1, no. 5, pp. 206-215, 2019, doi: 10.1038/s42256-019-0048-x.
- G. S. Collins, K. G. M. Moons, P. Dhiman, R. D. Riley, A. L. Beam, B. Van Calster, et al., "TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods," BMJ, vol. 385, Art. no. e078378, 2024, doi: 10.1136/bmj-2023-078378.
- R. S. Baker and A. Hawn, "Algorithmic bias in education," International Journal of Artificial Intelligence in Education, vol. 32, no. 4, pp. 1052-1092, 2022, doi: 10.1007/s40593-021-00285-9.
- E. Štrumbelj and I. Kononenko, "Explaining prediction models and individual predictions with feature contributions," Knowledge and Information Systems, vol. 41, no. 3, pp. 647-665, 2014, doi: 10.1007/s10115-013-0679-x.
- L. Breiman, "Random forests," Machine Learning, vol. 45, no. 1, pp. 5-32, 2001, doi: 10.1023/A:1010933404324.
- T. Saito and M. Rehmsmeier, "The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets," PLOS ONE, vol. 10, no. 3, Art. no. e0118432, 2015, doi: 10.1371/journal.pone.0118432.
- C. Nadeau and Y. Bengio, "Inference for the generalization error," Machine Learning, vol. 52, no. 3, pp. 239-281, 2003, doi: 10.1023/A:1024068626366.
- K. Aas, M. Jullum, and A. Løland, "Explaining individual predictions when features are dependent: More accurate approximations to Shapley values," Artificial Intelligence, vol. 298, Art. no. 103502, 2021, doi: 10.1016/j.artint.2021.103502.
- M. J. Pencina, R. B. D'Agostino Sr, R. B. D'Agostino Jr, and R. S. Vasan, "Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond," Statistics in Medicine, vol. 27, no. 2, pp. 157-172, 2008, doi: 10.1002/sim.2929.
- M. J. Pencina, R. B. D'Agostino Sr, and E. W. Steyerberg, "Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers," Statistics in Medicine, vol. 30, no. 1, pp. 11-21, 2011, doi: 10.1002/sim.4085.
- Y. Kim, J. Dykema, J. Stevenson, P. Black, and D. P. Moberg, "Straightlining: Overview of measurement, comparison of indicators, and effects in mail-web mixed-mode surveys," Social Science Computer Review, vol. 37, no. 2, pp. 214-233, 2019, doi: 10.1177/0894439317752406.
- Y. Lou, R. Caruana, J. Gehrke, and G. Hooker, "Accurate intelligible models with pairwise interactions," in Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2013, pp. 623-631, doi: 10.1145/2487575.2487579.
- S. R. Seaman and I. R. White, "Review of inverse probability weighting for dealing with missing data," Statistical Methods in Medical Research, vol. 22, no. 3, pp. 278-295, 2013, doi: 10.1177/0962280210395740.
- D. R. Roberts, V. Bahn, S. Ciuti, M. S. Boyce, J. Elith, G. Guillera-Arroita, et al., "Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure," Ecography, vol. 40, no. 8, pp. 913-929, 2017, doi: 10.1111/ecog.02881.
- S. N. Wood, "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 73, no. 1, pp. 3-36, 2011, doi: 10.1111/j.1467-9868.2010.00749.x.
- F. Pedregosa et al., "Scikit-learn: Machine learning in Python," Journal of Machine Learning Research, vol. 12, pp. 2825-2830, 2011. [Online]. Available: https://jmlr.org/papers/v12/pedregosa11a.html
References
Y. Yang, N. Rao, and J. Sun, "From pre-service preparation to professional development: Early childhood teachers' learning experiences, ECE quality, and child development in China," Early Education and Development, vol. 35, no. 5, pp. 1080-1102, 2024, doi: 10.1080/10409289.2024.2336659.
Q. Ma, "A critical realist explanation of Chinese early childhood teachers' professional identity," Early Childhood Education Journal, vol. 54, no. 7, pp. 6281-6291, 2026, doi: 10.1007/s10643-026-02306-5.
D. Beijaard, P. C. Meijer, and N. Verloop, "Reconsidering research on teachers' professional identity," Teaching and Teacher Education, vol. 20, no. 2, pp. 107-128, 2004, doi: 10.1016/j.tate.2003.07.001.
C. Beauchamp and L. Thomas, "Understanding teacher identity: an overview of issues in the literature and implications for teacher education," Cambridge Journal of Education, vol. 39, no. 2, pp. 175-189, 2009, doi: 10.1080/03057640902902252.
J. Y. Hong, "Pre-service and beginning teachers' professional identity and its relation to dropping out of the profession," Teaching and Teacher Education, vol. 26, no. 8, pp. 1530-1543, 2010, doi: 10.1016/j.tate.2010.06.003.
D. J. Madigan and L. E. Kim, "Towards an understanding of teacher attrition: A meta-analysis of burnout, job satisfaction, and teachers' intentions to quit," Teaching and Teacher Education, vol. 105, Art. no. 103425, 2021, doi: 10.1016/j.tate.2021.103425.
S. M. Lundberg and S.-I. Lee, "A unified approach to interpreting model predictions," in Advances in Neural Information Processing Systems 30, 2017, pp. 4765-4774. [Online]. Available: https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html
S. M. Lundberg, G. Erion, H. Chen, A. DeGrave, J. M. Prutkin, B. Nair, R. Katz, J. Himmelfarb, N. Bansal, and S.-I. Lee, "From local explanations to global understanding with explainable AI for trees," Nature Machine Intelligence, vol. 2, no. 1, pp. 56-67, 2020, doi: 10.1038/s42256-019-0138-9.
A. K. V. Olsen, I. G. H. Kjær, and K. S. Spieler, "Predictors of professional identity among early childhood teacher students," Education Sciences, vol. 14, no. 6, Art. no. 589, 2024, doi: 10.3390/educsci14060589.
Y. Dai, X. Yang, and D. Li, "The formation of pre-service ECE teachers' professional identity: The roles of self-efficacy, learning motivation, and engagement," Acta Psychologica, vol. 265, Art. no. 106625, 2026, doi: 10.1016/j.actpsy.2026.106625.
Y. Liu and Z. Xin, "Emotional labor and professional identity among pre-service early childhood teachers: the mediating role of emotional exhaustion and the moderating role of social and emotional competence," Frontiers in Psychology, vol. 17, Art. no. 1830373, 2026, doi: 10.3389/fpsyg.2026.1830373.
X. Tian, M. Liu, and T. Yue, "Understanding professional identity through policy and support perceptions: A latent profile study of pre-service preschool teachers in China," Education Sciences, vol. 16, no. 7, Art. no. 1069, 2026, doi: 10.3390/educsci16071069.
K. Ann and N. Boonnam, "A framework for predicting preservice teacher performance using machine learning and SMOTE-based class imbalance handling," Discover Education, vol. 5, no. 1, Art. no. 765, 2026, doi: 10.1007/s44217-026-02058-9.
T. Yue, "Dataset for 'Professional identity development among preservice early childhood teachers: A cross-lagged panel network analysis of teacher self-efficacy and perceived teacher support'," Zenodo, 2026, doi: 10.5281/zenodo.20790669.
F. Rodrigues and M. J. Mogarro, "Student teachers' professional identity: A review of research contributions," Educational Research Review, vol. 28, Art. no. 100286, 2019, doi: 10.1016/j.edurev.2019.100286.
M. Izadinia, "A review of research on student teachers' professional identity," British Educational Research Journal, vol. 39, no. 4, pp. 694-713, 2013, doi: 10.1080/01411926.2012.679614.
C. Lamote and N. Engels, "The development of student teachers' professional identity," European Journal of Teacher Education, vol. 33, no. 1, pp. 3-18, 2010, doi: 10.1080/02619760903457735.
F. Hanna, R. Oostdam, S. E. Severiens, and B. J. H. Zijlstra, "Domains of teacher identity: A review of quantitative measurement instruments," Educational Research Review, vol. 27, pp. 15-27, 2019, doi: 10.1016/j.edurev.2019.01.003.
E. T. Canrinus, M. Helms-Lorenz, D. Beijaard, J. Buitink, and A. Hofman, "Self-efficacy, job satisfaction, motivation and commitment: exploring the relationships between indicators of teachers' professional identity," European Journal of Psychology of Education, vol. 27, no. 1, pp. 115-132, 2012, doi: 10.1007/s10212-011-0069-2.
X. Ren, R. Feng, Z. Yan, J. Liu, and Z. Guo, "The relationship between occupational stigma consciousness and occupational identity among pre-service early childhood education teachers in China: a four-year longitudinal study," Frontiers in Psychology, vol. 17, Art. no. 1793509, 2026, doi: 10.3389/fpsyg.2026.1793509.
R. M. Ryan and E. L. Deci, "Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being," American Psychologist, vol. 55, no. 1, pp. 68-78, 2000, doi: 10.1037/0003-066X.55.1.68.
A. Bandura, "Self-efficacy: Toward a unifying theory of behavioral change," Psychological Review, vol. 84, no. 2, pp. 191-215, 1977, doi: 10.1037/0033-295X.84.2.191.
S. Gibson and M. H. Dembo, "Teacher efficacy: A construct validation," Journal of Educational Psychology, vol. 76, no. 4, pp. 569-582, 1984, doi: 10.1037/0022-0663.76.4.569.
G. Yu, T. Xin, and J. Shen, "Teacher's sense of teaching efficacy: Its structure and influencing factors," Acta Psychologica Sinica, vol. 27, no. 2, pp. 159-166, 1995 (in Chinese). [Online]. Available: https://journal.psych.ac.cn/xlxb/CN/Y1995/V27/I2/159
R. M. Klassen and M. M. Chiu, "The occupational commitment and intention to quit of practicing and pre-service teachers: Influence of self-efficacy, job stress, and teaching context," Contemporary Educational Psychology, vol. 36, no. 2, pp. 114-129, 2011, doi: 10.1016/j.cedpsych.2011.01.002.
M. Tschannen-Moran and A. W. Hoy, "Teacher efficacy: capturing an elusive construct," Teaching and Teacher Education, vol. 17, no. 7, pp. 783-805, 2001, doi: 10.1016/S0742-051X(01)00036-1.
A. J. Bowers, R. Sprott, and S. A. Taff, "Do we know who will drop out? A review of the predictors of dropping out of high school: Precision, sensitivity, and specificity," The High School Journal, vol. 96, no. 2, pp. 77-100, 2013, doi: 10.1353/hsj.2013.0000.
C. Romero and S. Ventura, "Educational data mining and learning analytics: An updated survey," WIREs Data Mining and Knowledge Discovery, vol. 10, no. 3, Art. no. e1355, 2020, doi: 10.1002/widm.1355.
T. Chen and C. Guestrin, "XGBoost: A scalable tree boosting system," in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 785-794, doi: 10.1145/2939672.2939785.
J. H. Friedman, "Greedy function approximation: A gradient boosting machine," The Annals of Statistics, vol. 29, no. 5, pp. 1189-1232, 2001, doi: 10.1214/aos/1013203451.
R. Shwartz-Ziv and A. Armon, "Tabular data: Deep learning is not all you need," Information Fusion, vol. 81, pp. 84-90, 2022, doi: 10.1016/j.inffus.2021.11.011.
S. Tao, H. Zhang, and L. Ding, "Explainable machine learning for sustainable education: Predicting college students' reliance on generative artificial intelligence," Acta Psychologica, vol. 265, Art. no. 106622, 2026, doi: 10.1016/j.actpsy.2026.106622.
G. Słowiński, Y. Kapranov, and B. Iwanowska, "Threshold-like structure and barrier-benefit asymmetry in students' behavioural intention toward e-learning: An explainable machine learning analysis in post-pandemic higher education," Sustainability, vol. 18, no. 10, Art. no. 4633, 2026, doi: 10.3390/su18104633.
E. Christodoulou, J. Ma, G. S. Collins, E. W. Steyerberg, J. Y. Verbakel, and B. Van Calster, "A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models," Journal of Clinical Epidemiology, vol. 110, pp. 12-22, 2019, doi: 10.1016/j.jclinepi.2019.02.004.
S. Varma and R. Simon, "Bias in error estimation when using cross-validation for model selection," BMC Bioinformatics, vol. 7, Art. no. 91, 2006, doi: 10.1186/1471-2105-7-91.
B. Van Calster, D. J. McLernon, M. van Smeden, L. Wynants, and E. W. Steyerberg, "Calibration: the Achilles heel of predictive analytics," BMC Medicine, vol. 17, Art. no. 230, 2019, doi: 10.1186/s12916-019-1466-7.
A. J. Vickers and E. B. Elkin, "Decision curve analysis: A novel method for evaluating prediction models," Medical Decision Making, vol. 26, no. 6, pp. 565-574, 2006, doi: 10.1177/0272989X06295361.
H. Khosravi, S. Buckingham Shum, G. Chen, C. Conati, Y.-S. Tsai, J. Kay, S. Knight, R. Martinez-Maldonado, S. Sadiq, and D. Gašević, "Explainable artificial intelligence in education," Computers and Education: Artificial Intelligence, vol. 3, Art. no. 100074, 2022, doi: 10.1016/j.caeai.2022.100074.
C. Rudin, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead," Nature Machine Intelligence, vol. 1, no. 5, pp. 206-215, 2019, doi: 10.1038/s42256-019-0048-x.
G. S. Collins, K. G. M. Moons, P. Dhiman, R. D. Riley, A. L. Beam, B. Van Calster, et al., "TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods," BMJ, vol. 385, Art. no. e078378, 2024, doi: 10.1136/bmj-2023-078378.
R. S. Baker and A. Hawn, "Algorithmic bias in education," International Journal of Artificial Intelligence in Education, vol. 32, no. 4, pp. 1052-1092, 2022, doi: 10.1007/s40593-021-00285-9.
E. Štrumbelj and I. Kononenko, "Explaining prediction models and individual predictions with feature contributions," Knowledge and Information Systems, vol. 41, no. 3, pp. 647-665, 2014, doi: 10.1007/s10115-013-0679-x.
L. Breiman, "Random forests," Machine Learning, vol. 45, no. 1, pp. 5-32, 2001, doi: 10.1023/A:1010933404324.
T. Saito and M. Rehmsmeier, "The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets," PLOS ONE, vol. 10, no. 3, Art. no. e0118432, 2015, doi: 10.1371/journal.pone.0118432.
C. Nadeau and Y. Bengio, "Inference for the generalization error," Machine Learning, vol. 52, no. 3, pp. 239-281, 2003, doi: 10.1023/A:1024068626366.
K. Aas, M. Jullum, and A. Løland, "Explaining individual predictions when features are dependent: More accurate approximations to Shapley values," Artificial Intelligence, vol. 298, Art. no. 103502, 2021, doi: 10.1016/j.artint.2021.103502.
M. J. Pencina, R. B. D'Agostino Sr, R. B. D'Agostino Jr, and R. S. Vasan, "Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond," Statistics in Medicine, vol. 27, no. 2, pp. 157-172, 2008, doi: 10.1002/sim.2929.
M. J. Pencina, R. B. D'Agostino Sr, and E. W. Steyerberg, "Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers," Statistics in Medicine, vol. 30, no. 1, pp. 11-21, 2011, doi: 10.1002/sim.4085.
Y. Kim, J. Dykema, J. Stevenson, P. Black, and D. P. Moberg, "Straightlining: Overview of measurement, comparison of indicators, and effects in mail-web mixed-mode surveys," Social Science Computer Review, vol. 37, no. 2, pp. 214-233, 2019, doi: 10.1177/0894439317752406.
Y. Lou, R. Caruana, J. Gehrke, and G. Hooker, "Accurate intelligible models with pairwise interactions," in Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2013, pp. 623-631, doi: 10.1145/2487575.2487579.
S. R. Seaman and I. R. White, "Review of inverse probability weighting for dealing with missing data," Statistical Methods in Medical Research, vol. 22, no. 3, pp. 278-295, 2013, doi: 10.1177/0962280210395740.
D. R. Roberts, V. Bahn, S. Ciuti, M. S. Boyce, J. Elith, G. Guillera-Arroita, et al., "Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure," Ecography, vol. 40, no. 8, pp. 913-929, 2017, doi: 10.1111/ecog.02881.
S. N. Wood, "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 73, no. 1, pp. 3-36, 2011, doi: 10.1111/j.1467-9868.2010.00749.x.
F. Pedregosa et al., "Scikit-learn: Machine learning in Python," Journal of Machine Learning Research, vol. 12, pp. 2825-2830, 2011. [Online]. Available: https://jmlr.org/papers/v12/pedregosa11a.html