Deck 7: Reliability Validity

Question 1

Which technique can be used by investigators to determine internal consistency?

A) Split-half technique
B) Pilot testing
C) Cronbach's alpha
D) Test-retest

Answer 1

A

Question 2

Which of the following is NOT considered a disadvantage when using internal consistency to establish reliability?

A) Expensive
B) Time-consuming
C) Need to create a large pool of items
D) Difficult to recruit the same respondents who then respond twice

Answer 2

D

Question 3

When data trends are slowly moving in one direction, the trend is called:

A) drift.
B) environment.
C) observation.
D) validity.

Answer 3

A

Question 4

When researchers choose to collect similar data using more than one method to increase reliability and validity, they are using:

A) statistical consultation.
B) a pilot test.
C) data collection training.
D) triangulated data collection.

Question 5

A simple way to calculate sample size is to use _________ observations per independent variable.

A) 3
B) 5
C) 10
D) 2

Question 6

When respondents perform well on pretests and poorly on posttests, or vice versa, merely by chance, so that their results cancel each other out when scores are averaged, the outcome is called:

A) regression.
B) inter-observational reliability.
C) drift.
D) maturation.

Question 7

Which threat to internal validity measures changes in respondent performance, such as fatigue, which cannot be credited to the treatment or intervention?

A) Instrumentation
B) Regression
C) Testing
D) Maturation

Question 8

Internal validity focuses on the rigor of the study, while external validity concentrates on generalizability.

Question 9

Face validity is based on theory, instead of how the test appears.

Question 10

The Hawthorne effect only applies to threats related to internal validity.

Question 11

Researchers have control over how many random errors will occur.

Question 12

Dependent variables are manipulated, whereas independent variables remain fixed.

Question 13

Subject attrition refers to new participants enrolled during the course of a study.

Question 14

In qualitative and quantitative research, reliability refers to _____________.

Question 15

____________ occurs when the results of a survey or instrument are consistent over time.

Question 16

The ________________ group within the study receives the treatment, while a similar group called the _____________ group receives no treatment.

Question 17

A simple way to calculate sample size is to use _________ observations per independent variable:

Question 18

Outside forces have a greater impact on the outcome in studies with ____________ samples of participating individuals.

Question 19

Match the following types of validity with their corresponding definition.
-Measures the appearance of the test: Does the test look reasonable and does the survey make logical sense?

A) Face validity
B) Criterion-related validity
C) Construct validity
D) Content validity

Question 20

Match the following types of validity with their corresponding definition.
-Measures one topic in two different ways

A) Face validity
B) Criterion-related validity
C) Construct validity
D) Content validity

Question 21

Match the following types of validity with their corresponding definition.
-Measures a concept that is not actually observable; established by exploring relationships with similar measures, and comparing scores among defined groups

A) Face validity
B) Criterion-related validity
C) Construct validity
D) Content validity

Question 22

Match the following types of validity with their corresponding definition.
-How well the test measures the specific items that it is intended to measure

A) Face validity
B) Criterion-related validity
C) Construct validity
D) Content validity

Question 23

The text discusses nine threats to internal validity. List at least three of these threats.

Question 24

List the three areas to investigate when searching for systematic errors.

Question 25

List the two forms of reliability discussed throughout the text.