If observers disagree 20 times out of 80, then the interrater reliability is
A)0.25.
B)0.75.
C)4.0.
D)not able to be determined.

Question

If observers disagree 20 times out of 80, then the interrater reliability is​
A)0.25.​
B)0.75.
C)4.0.
D)not able to be determined.

Quizplus · Accepted Answer

Interrater reliability is calculated by dividing the number of agreements by the total number of observations. In this case, there were 60 agreements (80-20) and 80 total observations. Therefore, the interrater reliability is 60/80, which simplifies to 0.75. Choice B (0.75) is the correct answer.

If Observers Disagree 20 Times Out of 80, Then the Interrater