Exploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study

doi:10.1007/978-981-10-4089-4_10

科研成果详情

题名	Exploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study
作者	Zhu，Yu 1; Fung，Shui Lung 2; Tse，Shek Kam 3; Hsieh，Chi Yi 4
出版日期	2017
来源专著	Chinese Language Learning Sciences
页码	203-223
摘要	Subjective rating is a widely adopted practice in human assessment and measurement. Without a careful control of severity among raters in grading, both the validity and reliability of a subjective assessment will be subject to skepticism. Among many variables which may potentially impact raters’ severity, raters’ personality in recent years has caused concerns for many researchers. However, so far there is no study investigating such a potential relationship in the context of testing and assessing Chinese as a second language. To explore the relationship between raters’ personality traits and rating severity in writing assessment of Chinese as a foreign language, master’s degree students who majored in teaching of Chinese as a foreign language (n = 28) were asked to rate a writing test of the New HSK, a large-scale standardized test of Chinese proficiency promoted by the Chinese government. Valid data for FACETS analysis were the 28 raters’ independent ratings of 77 examinees’ 154 essays (2 topics) from the test. Each rater also completed NEO-PI-R, a fairly reliable personality inventory. Demographic variables such as age, gender, educational background, and rating experience, which may affect raters’ severity in essay grading, were strictly controlled. The results of this pilot study showed individual differences in raters’ severity and significant associations between raters’ personality traits and their rating behavior in terms of severity. Findings of this study are expected to enrich our understanding of subjective rating behaviors of human assessment, especially in the field of testing and assessing Chinese as a second language.
语种	英语English
关键词	Chinese as a second language Personality traits Writing assessment
DOI	10.1007/978-981-10-4089-4_10
URL	查看来源
Scopus入藏号	2-s2.0-85103891336
引用统计	被引频次[WOS]：0 [WOS记录] [WOS相关记录]
文献类型	著作章节
条目标识符	https://repository.uic.edu.cn/handle/39GCC9TT/6374
专题	北师香港浸会大学
通讯作者	Zhu，Yu
作者单位	1.Xiamen University,Xiamen,China 2.Beijing Normal University-Hong Kong Baptist University United International College,Zhuhai,China 3.The University of Hong Kong,Hong Kong 4.National Kaohsiung Normal University,Kaohsiung,Taiwan
推荐引用方式 GB/T 7714	Zhu，Yu,Fung，Shui Lung,Tse，Shek Kamet al. Exploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study, 2017: 203-223.