Which BEST conveys the meaning of an inter-scorer reliability estimate of .90?
A) Ninety percent of the scores obtained are reliable.
B) Ninety percent of the variance in the scores assigned by the scorers was attributed to true differences and 10% to error.
C) Ten percent of the variance in the scores assigned by the scorers was attributed to true differences and 90% to error.
D) Ten percent of the test's items are in need of revision according to the majority of the test's users.

Question

Quizplus · Accepted Answer

An inter-scorer reliability estimate of .90 means that 90% of the variance in the scores assigned by the scorers was attributed to true differences and 10% to error. This indicates a high degree of agreement between the scorers and suggests that the measure is reliable. Option A is incorrect because it implies that only 90% of the scores obtained are reliable, which is not an accurate interpretation. Option C is incorrect because it implies that only 10% of the variance in the scores assigned by the scorers was attributed to true differences, which is not accurate. Option D is also incorrect, as it is unrelated to the concept of inter-scorer reliability.

Which BEST Conveys the Meaning of an Inter-Scorer Reliability Estimate