Deck 5: Measurement, Reliability, and Validity

Question 1

Which is considered the least precise level of measurement?

A) ordinal
B) nominal
C) ratio
D) interval

Answer 1

B

Question 2

A measure of how stable a test is over time is an example of which of the following?

A) inter-rater reliability
B) test-retest reliability
C) parallel forms reliability
D) internal consistency

Answer 2

B

Question 3

What would the inter-rater reliability be for a 50-item measure in which the number of agreements between Rater 1 and Rater 2 was 45?

A) 0.45
B) 80%
C) 0.90
D) 95%

Answer 3

C

Question 4

Inter-rater reliability measures consistency_________________.

A) over time
B) from form to form
C) across different tests
D) from rater to rater

Question 5

Which is considered the most precise level of measurement?

A) ordinal
B) nominal
C) ratio
D) interval

Question 6

If the measures associated with a test are said to be consistent, you might conclude the measure is _______________________.

A) standard
B) valid
C) reliable
D) concurrent

Question 7

If the reason for the difference between the true and observed score is a characteristic of the person taking the test, the resulting decrease in reliability will be attributed to ____________.

A) method error
B) trait error
C) random error
D) nonsystematic error

Question 8

Which coefficient reflects the occurrence of perfect reliability?

A) + 1.00
B) + .50
C) +.100
D) + 2.00

Question 9

_________________ describes a measure used to compare two different tests with the same group of participants to see how closely correlated the two sets of scores are with each other.

A) inter-rater reliability
B) test-retest reliability
C) parallel-forms reliability
D) internal consistency

Question 10

Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is
Calculated. This is an example of which type of reliability?

A) parallel reliability
B) test-retest reliability
C) inter-rater reliability
D) none of the above

Question 11

Which variable would be considered to be measured at the ordinal level?

A) religious affiliation
B) SAT score
C) temperature
D) racing results

Question 12

When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?

A) method and error scores
B) means and standard deviations
C) test-retest and inter-rater scores
D) true and error scores

Question 13

Which of the following variables is an example of the nominal level of measurement?

A) rank in graduating class
B) gender
C) age of students
D) amount of money earned

Question 14

Which of the following is NOT an example of reliability?

A) consistency
B) performing the same in the future as in the past
C) the test doing what it is supposed to do
D) measuring the same thing more than once with the same outcome

Question 15

What are the two components of error scores?

A) method error and consistent error
B) standard error and method error
C) trait error and standard error
D) trait error and method error

Question 16

The ratio level of measurement would include which of the following?

A) political affiliation
B) amount of books owned
C) order of finishing test
D) GRE score

Question 17

Which of the following would be considered a continuous variable?

A) the number answered correctly on a history test
B) grade level in school
C) gender
D) length

Question 18

A score that you would actually record is an) _______________.

A) observed score
B) true score
C) error score
D) false score

Question 19

The interval level of measurement would include which of the following?

A) number of words spelled incorrectly
B) hair color
C) IQ score
D) height

Question 20

Which level of measurement conveys the most information?

A) nominal
B) ordinal
C) interval
D) ratio

Question 21

Why is the ratio level of measurement considered the most precise?

Question 22

What levels of measurement define most variables in behavioral and social science research?

A) interval and ratio
B) nominal and ordinal
C) nominal and ratio
D) nominal and interval

Question 23

Why are repeated scores on most variables always different from one another?

Question 24

What is the name of the individual credited with devising levels of measurement in which different measurement outcomes can be classified?

A) Binet
B) Stevens
C) Cattell
D) Wechsler

Question 25

What are the two types of criterion validity?

A) content and construct validity
B) content and parallel validity
C) predictive and parallel validity
D) concurrent and predictive validity

Question 26

Name four ways to increase reliability.

Question 27

Dr. Brown finds that results from different methods used to assess the same trait are highly correlated and results from different methods used to assess different traits are not
Significantly correlated. These results demonstrate which two types of validity respectively?

A) predictive and concurrent
B) concurrent and predictive
C) discriminant and convergent
D) convergent and discriminant

Question 28

Dr. Baylor is concerned that the items on his test really do adequately represent the universe of items from which he chose. Dr. Baylor's concern is one of ________________________.

A) content validity
B) predictive validity
C) concurrent validity
D) construct validity

Question 29

Which of the following statements is false?

A) Validity refers to the results of a test not the test itself.
B) Validity progresses from low to high degrees rather than all or none.
C) A test can lack validity and still be a reliable measure.
D) A test can lack reliability and still be a valid measure.

Question 30

What is the difference between continuous and discrete variables?

Question 31

Which of the following is concerned with monitoring estimates of present performance and predictions of future performance?

A) content validity
B) criterion validity
C) construct validity
D) internal validity

Question 32

Which is the least frequently established form of reliability?

A) inter-rater
B) internal consistency
C) test-retest
D) parallel

Question 33

A measure of how well a test estimates a criterion is a concern of _________________.

A) concurrent validity
B) predictive reliability
C) internal consistency
D) content validity

Question 34

What is the difference between reliability and validity?

Question 35

What is one way to obtain a criterion validity estimate?

A) ask an expert for his or her opinion
B) assess the underlying construct on which the test is based and correlate these scores with the test scores
C) select a criterion and correlate scores on the test with scores on the criterion
D) obtain a Pearson Product Moment correlation coefficient for two different forms of the test given at different times

Question 36

Which of the following is an example of method error?

A) subject fatigue
B) bias in grading
C) lack of motivation
D) test-taking anxiety

Question 37

Which one of the following is NOT an important criterion for increasing reliability?

A) eliminate unclear test items
B) standardize the environmental conditions in which the test is given
C) moderate the ease and difficulty of the test
D) use subjective scoring procedures