Calculating the percentage of agreement between two observers ____.
A)tends to overestimate the true level of agreement
B)tends to underestimate the true level of agreement
C)is simply an inaccurate method for measuring inter-rater reliability
D)produces an accurate measure of inter-rater reliability without any need for correction

Question

Calculating the percentage of agreement between two observers ____.​
A)​tends to overestimate the true level of agreement
B)​tends to underestimate the true level of agreement
C)is simply an inaccurate method for measuring inter-rater reliability
D)produces an accurate measure of inter-rater reliability without any need for correction

Quizplus · Accepted Answer

Percentage agreement can overestimate the true level of agreement because it does not account for the agreement occurring by chance.

Calculating the Percentage of Agreement Between Two Observers ____