[论文解读] Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy

Yuang Wei, Wang, Fei, Ph. D. Massachusetts Institute of Technology+3 more|arXiv (Cornell University)|Mar 6, 2026

Student Assessment and Feedback被引用 0

一句话总结

论文介绍 XIA，一套可解释的智能评估平台，为实习教师提供可视化的认知诊断推理以支持自我反思和基于证据的评估，通过21名参与者的前后对照研究进行演示。

ABSTRACT

Assessment literacy (AL) is essential for personalized education, yet difficult to cultivate in pre-service teachers. Conventional teacher preparation programs focus on theoretical knowledge, while digital assessment tools commonly provide opaque scores or parameters. These limitations hinder reflection and transfer, leaving AL underdeveloped. We propose XIA, an eXplainable Intelligent Assessment platform that extends statistics-informed support with visualized cognitive diagnostic reasoning, including contrastive and counterfactual explanations. In a pre-post controlled study with 21 pre-service teachers, we combined quantitative tasks and questionnaires with qualitative interviews. The findings offer preliminary evidence that XIA supported reflection, self-regulation, and assessment awareness, and helped reduce assessment errors. Interviews further showed a shift from score-based judgments toward evidence-based reasoning. This work contributes insights into the design of intelligent assessment tools, showing how explanatory scaffolding can bridge assessment theory and classroom practice and support the cultivation of AL in teacher education.

研究动机与目标

• 出于评估分数不透明和与实践的迁移有限，动机强调提升师范生评估素养（AL）的需要。
• 提出一个可解释的智能评估（XIA）平台，整合可解释分析与认知诊断推理。
• 通过结合定量任务、问卷和定性访谈的前后对照研究来评估 XIA 对评估素养的影响。
• 探讨解释性支架如何影响在评估素养发展中的反思、自我调节与基于证据的推理。

提出的方法

• 引入 XIA，在统计信息支持基础上扩展可视化的认知诊断推理。
• 融入对比性和反事实解释以揭示推理路径。
• 进行包含 21 名实习教师的前后对照研究。
• 采用混合方法设计：以定量任务和问卷为主，辅以定性访谈。
• 分析反思、自我调节、评估意识与错误降低的变化。

实验结果

研究问题

• RQ1 XIA 是否提升实习教师的反思、自我调节和评估意识？
• RQ2 XIA 是否有助于减少实践任务中的评估错误？
• RQ3 访谈是否显示在使用 XIA 时从基于分数的判断转向基于证据的推理？
• RQ4 解释性支架如何影响评估理论与课堂实践之间的桥梁？

主要发现

• 初步证据表明 XIA 支持了反思、自我调节与评估意识。
• XIA 有助于减少任务中的评估错误。
• 访谈显示从依赖分数转向基于证据的推理的转变 。
• 解释性支架有助于将评估理论与课堂实践联系起来。