医学教育管理 ›› 2019, Vol. 5 ›› Issue (6): 557-561,570.doi: 10.3969/j.issn.2096-045X.2019.06.015

• 考试研究 • 上一篇    下一篇

基础医学课程主观试题移动在线考试服务及智能辅助评阅系统的搭建策略与实现

王 晶   余和芬   程 杉   

  1. 首都医科大学基础医学院,北京 100069
  • 收稿日期:2019-10-16 出版日期:2019-12-20 发布日期:2020-01-21
  • 通讯作者: 程杉
  • 基金资助:
    首都医科大学教学建设性项目:计算机辅助评阅系统主观型生物学测试题库的扩建及优化

Construction and deployment of a mobile online examination platform supporting AI-facilitated grading for subjective test questions in basic medical curriculum

Wang Jing, Yu Hefen, Cheng Shan   

  1. School of Basic Medicines, Capital Medical University, Beijing 100069, China
  • Received:2019-10-16 Online:2019-12-20 Published:2020-01-21

摘要: 课程考试是大学教育中对学生学习进程和学习成果进行评价及督促的重要手段。计算机辅助评估(computer-aided evaluation,CAE)系统在越来越多专业课程的教学活动中得到广泛的应用,例如医学院校基础阶段的生物化学、遗传学等生物学相关课程,在降低考试组织和实施成本的同时显著提高了教学工作的效率。然而常规的CAE 平台基本上只是针对多种客观考核试题的形式标准化设计并提供支持,而对主观类试题的标准化评判一直存在困难。在研究中,尝试了使用字符串编辑距离作为文本相似性比较的主要参考指标,将人工智能的数据处理原理应用于对填空题、名词解释、简答题及问答题等主观题型题目的答题文本判别和参考评分中,并针对不同题型探索出相应的评判策略与权重规则。此外,在测试过程中,还实现了全部硬件需求在以智能手机为代表的移动终端的整合,大幅提升了原有在线考试系统的适用性和灵活性,完全适应不同课堂规模下的形成性评价、结业考试等多种场景的考试需求。随着考试服务系统的进一步应用开发和优化,不仅能够提高教师教学工作效率,显著降低劳动负荷与人为错误的发生,而且为师生互动的教育教学改革提供助力。

关键词: 移动在线考试服务, 编辑距离, 主观题

Abstract: Examination is an important means of evaluating and supervising the learning and achievements of students in higher education. Computer-aided evaluation (CAE) system has been widely used in specialized courses teaching, such as biochemistry, genetics and other biology-related courses at the foundation stage of medical colleges and universities. It has significantly improved the efficiency of subject teaching while reducing the cost of examination organization and implementation. However, the conventional CAE platform basically provides support for the standardization of test questions in the form of objective assessment, while it has been difficult to standardize the evaluation of subjective test questions. In this study, we try to use string editing distance as the main reference index for text similarity comparison, and apply the data processing principle of artificial intelligence to text discrimination and reference scoring of subjective questions such as fillingin questions, noun interpretation, short answer questions and question-and-answer questions, and explore the corresponding evaluation strategies and weight rules for different types of questions. In addition, in the process of testing, we have also realized the integration of all hardware requirements of mobile terminals represented by cellphones, which greatly improved the applicability and flexibility of the original online examination system, and fully adapted to the formative evaluation or completion examination needs in different classroom scales and other scenarios. We conclude that the solution for grading subjective test using artificial intelligence can be feasible under well-organized examination with properly arranged answer keys, where string similarity distances can be used as the primary index for calculations and down-dimension of cognition levels should be the strategy for text extraction. The continuous development and optimization of our platform or system of such types will benefit the students’ learning by significantly reduce both the workload and operational errors of teaching staffs. 

Key words: mobile online examination platform, editing distance, subjective questions