复杂结构语言试卷信度的多元概化理论分析——以CET-6数据为例
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Evaluating the Reliability Coefficient of a Complex Language Test with Multivariate Generalizability Theory
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    通过对170名大学生在一套旧式大学英语六级考试客观题上的反应数据的分析,演示了如何用多元概化理论这一工具计算复杂结构语言试卷测试结果的信度系数。结果显示,对于这组学生,总分信度系数达0921与达0907,但各部分的差异很大,词汇和语法部分的信度系数最高,为0802与0782,听力部分的信度系数次之,为0769与0744,阅读理解部分的最低,为0551与0782,听力部分的信度系数次之,为0769与0744,阅读理解部分的最低,为0551与0503。进一步的分析揭示,在这套试卷的70道客观题中,与各自部分不融洽的题目有23个,其中听力部分6道,阅读部分10道,词汇语法部分7道。如果这些不融洽题目上的成绩不记入总成绩,总分和各部分成绩的信度系数都大幅度提高,其中总分信度系数提高到0937,听力部分提高到0831,阅读部分提高到0773,词汇语法部分提高到0859。在分析的基础上,对语言测试工作者提出了5条积极的建议。

    Abstract:

    By analyzing the response data set of 170 tertiary level students on the old version CET6 test form, we demonstrated how multivariate generalizability theory can be employed in the evaluation of reliability coefficient for a language test form with a complex structure. The result shows that for the given group of students and the population it represents, the objective section of the test as whole has a generalizability coefficient of 0.921 and an independence index of 0.907, but the three sections vary greatly in terms of reliability coefficient, with Listening Comprehension having an of 0.769 and a of 0.744, Reading Comprehension an of 0.551 and a of 0.503, and Vocabulary and Straucture an of 0.802 and a of 0.782. Further probe reveals that of the 70 items, 23 are inconsistent with their relevant sections, 6 being inconsistent with Listening Comprehension, 10 with Reading Comprehension, and 7 with Vocabulary and Structure. If the response to the inconsistent items does not count, both the overall reliability coefficient and the reliability coefficient for each section significantly improve. The coefficient for the total score rises to 0.937, and that for Listening to 0.831, for Reading 0.773 and for Vocabulary and Structure 0.859. On the basis of the analysis, 5 suggestions have been proposed for language testers in China.

    参考文献
    相似文献
    引证文献
引用本文

汪顺玉,席仲恩.复杂结构语言试卷信度的多元概化理论分析——以CET-6数据为例[J].重庆大学学报社会科学版,2008,14(6):130-135.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期:
  • 出版日期: