Deck 4: Validity and Reliability

Question 1

A correlation of -1.00 indicates a

A) a perfect positive relationship
B) a weak negative relationship
C) no relationship
D) a perfect negative relationship

Answer 1

A

Question 2

Estimating the reliability of performance assessments typically involves calculating the

A) percentage of tasks performed satisfactorily
B) correlation between current performance and future performance
C) percentage of the number of agreements between raters
D) correlation between alternative assessment instruments

Answer 2

B

Question 3

The split-half method provides a measure of

A) equivalence
B) internal consistency
C) stability
D) stability and equivalence

Answer 3

C

Question 4

A test is considered to be reliable if

A) it can be used to determine good vs. poor students
B) it increases the objectivity of instruction
C) it measures the outcomes it is supposed to measure
D) the scores of the same test administered at different times are close to equal

Question 5

A good synonym for reliability is

A) compatibility
B) consistency
C) identification
D) precision

Question 6

The Spearman-Brown formula is used with the

A) equivalent forms method
B) Kuder-Richardson method
C) split-half method
D) test-retest method

Question 7

If you want to substitute a short test for a longer version of the same test, you should test the criterion-related validity of the test by conducting a

A) predictive study
B) criterion study
C) construct study
D) concurrent study

Question 8

External influences such as disruptions during testing that may lower the scores of the students are referred to as

A) systematic errors
B) standard errors
C) random errors
D) reliability errors

Question 9

To determine whether similar results would be obtained if we used a different version time, you would perform which method?

A) Test-retest method
B) Internal consistency method
C) Equivalent forms method
D) Test-retest with equivalent forms method

Question 10

Removing "clues to the answer" from test items is most likely to improve the test's

A) objectivity
B) readability
C) reliability
D) validity

Question 11

Which type of reliability procedure would provide a measure of internal consistency?

A) Equivalent forms with a one-month interval
B) Equivalent forms with no time interval
C) Spearman-brown method
D) Test-retest method

Question 12

Procedures to determine the reliability of criterion-referenced tests answer how consistently the test

A) classifies students who mastered content
B) ranks the students
C) predicts future performance
D) correlates with similar versions of the test

Question 13

The following method requires administering the same test to the same group after a time interval.

A) Test-retest method
B) Interval with a equivalent form method
C) Equivalent forms method
D) Internal consistency method

Question 14

The appropriateness and meaningfulness of the inferences we make from assessment results refers to a test's

A) reliability
B) validity
C) objectivity
D) difficulty

Question 15

To obtain evidence of validity based on content considerations, you would examine the

A) expectancy table
B) size of the correlation coefficient
C) type of criterion used
D) table of specifications

Question 16

Interpreting a student's chances of success in college based on the Scholastic Aptitude Test SAT) requires a

A) predictive study
B) criterion study
C) construct study
D) concurrent study

Question 17

Whether a high score on the Weschler Adult Intelligence Scale WAIS) indicates high intelligence is a question relating to the instrument's

A) content-related validity
B) construct-related validity
C) criterion-related validity
D) consequence of using