What index of reliability would be BEST use to compare two evaluators' assessments of a group of job applicants?
A) KR-20
B) coefficient alpha
C) the Kappa statistic
D) the Spearman-Brown correction

Question

Quizplus · Accepted Answer

The Kappa statistic is the best choice to compare two evaluators' assessments of a group of job applicants because it is a measure of inter-rater reliability that takes into account chance agreement between the raters. It is widely used in social science research to assess the reliability of categorical data, such as assessing the agreement between two evaluators rating job applicants as "qualified" or "unqualified". The KR-20 and coefficient alpha are measures of internal consistency reliability and are not appropriate for comparing two raters' assessments. The Spearman-Brown correction is used to estimate the reliability of a test when the length is changed, and therefore is not relevant in this context.

What Index of Reliability Would Be BEST Use to Compare