Question 1

Cronbach's coefficient alpha is preferred to the Kuder-Richardson 21 when
A) the items are all of the same level of difficulty.
B) the items are scored right or wrong (dichotomously).
C) the responses may receive a varying number of points.
D) a and c

Accepted Answer

Cronbach's coefficient alpha is preferred when the responses to items may receive a varying number of points, indicating it is used for tests with items that are not merely scored as right or wrong but can have a range of scores, unlike the Kuder-Richardson 21 formula which is specifically designed for dichotomous choices.

Question 2

High score reliability for a test indicates that
A) the test has validity.
B) random errors of measurement are not a serious problem.
C) the test is measuring what it is supposed to be measuring.
D) the proportion of error variance to true variance is very high.

Accepted Answer

High score reliability indicates that random errors of measurement are not a serious problem, meaning that the measurement is consistent and repeatable. It does not necessarily indicate that the test has validity, is measuring what it is supposed to, or that the proportion of error variance to true variance is high.

Question 3

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is
A) getting the cooperation of the subjects.
B) obtaining the two forms of the test.
C) finding a suitable criterion.
D) establishing the appropriate time interval.
E) the statistics involved in calculating the coefficient.

Accepted Answer

The major disadvantage of the coefficient of stability and equivalence is obtaining the two forms of the test. This can be time-consuming and expensive, especially in cases where the test needs to be administered multiple times. The other options listed (A, C, D, and E) are potential challenges in establishing reliability, but they are not specific disadvantages of the coefficient of stability and equivalence.

Question 4

A test has a reliability coefficient of .75.This coefficient indicates that
A) 56 percent of the variance in scores is true variance.
B) 75 percent of the variance in scores is true variance.
C) 25 percent of the variance in scores is true variance.
D) 75 percent of the test items are valid.

Accepted Answer

The reliability coefficient of .75 indicates that 75 percent of the variance in scores is due to true variance, meaning that the test is consistent and reliable in measuring the construct it intends to measure. Option A is incorrect because it implies that only 56 percent of the variance is true variance, which is lower than the actual reliability coefficient. Option C is also incorrect as it implies that only 25 percent of the variance is due to true variance, which is much lower than the actual reliability coefficient. Option D is not related to the concept of reliability coefficient and is therefore incorrect.

Question 5

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher compares the science test results with the results of a standardized test in science.
A) evidence based on content
B) evidence based on relationship to other variables
C) evidence based on construct-relevant variance

Accepted Answer

The teacher is comparing the science test results with the results of a standardized test in science which involves gathering evidence based on the relationship to other variables.

Question 6

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher correlates students' scores on the test with the final semester grade received in the course.
A) evidence based on content
B) evidence based on relationship to other variables
C) evidence based on construct-relevant variance

Accepted Answer

The teacher is gathering evidence based on the relationship between the scores on the test and the final semester grade, which is evidence based on relationship to other variables.

Question 7

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher tries to determine if the numerical reasoning test is really measuring numerical reasoning skills rather than ability to read the test items.
A) evidence based on content
B) evidence based on relationship to other variables
C) evidence based on construct-relevant variance

Accepted Answer

The teacher is trying to gather evidence based on construct-relevant variance, which is focused on whether a test is measuring what it is intended to measure.

Question 8

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is
A) Kuder-Richardson formula 20.
B) Kuder-Richardson formula 21.
C) Cronbach's coefficient alpha.
D) biserial correlation coefficient.
E) phi coefficient.

Accepted Answer

Cronbach's coefficient alpha is the most appropriate estimate of score reliability for a scale that measures attitudes using a Likert-type response format. It measures the internal consistency of a scale by indicating the degree to which items are interrelated and contribute to a single factor. Kuder-Richardson formulas and biserial and phi coefficients are appropriate for other types of scales.

Question 9

If the score reliability of a test decreases, the standard error of measurement will
A) decrease.
B) increase.
C) stay the same.
D) decrease only if the standard deviation decreases.

Accepted Answer

The standard error of measurement (SEM) is directly proportional to the standard deviation of the test scores and inversely proportional to the square root of the reliability coefficient. Therefore, if the reliability coefficient decreases, the SEM will increase.

Question 10

A personality test has been carefully prepared to measure a single trait.Which of the following coefficients would probably be lowest in size?
A) Kuder-Richardson
B) Split-half coefficient
C) Coefficient of stability
D) Coefficient of stability and equivalence

Accepted Answer

The answer of A personality test has been carefully prepared...

Question 11

The coefficient of correlation between a scholastic aptitude test and GPA was found to be 1.05.This coefficient indicates that
A) the scholastic aptitude test has good reliability.
B) the scholastic aptitude test has high validity.
C) the scholastic aptitude test is useful as a predictor of school achievement.
D) there is an error in the computation.
E) None of these are true.

Accepted Answer

The coefficient of correlation cannot exceed 1, so a value of 1.05 is not possible and indicates an error in computation or a misinterpretation of the results. None of the other choices would be accurate based on this value.

Question 12

A researcher is constructing a test for use in a study.In order to insure the highest reliability, the researcher should
A) increase the number of items on the test.
B) plan to increase item homogeneity.
C) try out the test on a heterogeneous group.
D) All of these are true.

Accepted Answer

In order to insure the highest reliability, the researcher should increase the number of items on the test to ensure greater content validity and to increase the internal consistency of the test. A larger number of items also allows for greater reliability through the use of statistical tests. Planning to increase item homogeneity is also important, as items on the test should measure the same overall construct or concept. Finally, trying out the test on a heterogeneous group can also help with establishing reliability, as it allows for a greater range of responses and can help identify any potential biases or errors in the test.

Question 13

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher examines an achievement test to see how well it covers the content and objectives covered in the course.
A) evidence based on content
B) evidence based on relationship to other variables
C) evidence based on construct-relevant variance

Accepted Answer

The teacher is examining the achievement test based on how well it covers the content and objectives covered in the course, which is evidence based on content.

Question 14

The scores made by a group of students on a classroom chemistry test are correlated with their scores on a standardized chemistry test.The coefficient of correlation between the two sets of scores would be called a
A) coefficient alpha.
B) validity coefficient.
C) coefficient of equivalence.
D) coefficient of stability and equivalence.
E) coefficient of internal consistency.

Accepted Answer

The coefficient of correlation between the two sets of scores is called the validity coefficient. This coefficient measures the extent to which the classroom test is a valid measure of the content domain covered by the standardized test.

Question 15

Four groups of sixth grade students took the same test in reading.The reliability coefficient will be highest for
A) students with similar intelligence test scores and a similar background in reading.
B) students with similar intelligence test scores but varying in their background in reading.
C) students with varying intelligence test scores, all of whom have a similar background in reading.
D) students with varying intelligence test scores and a varying background in reading.

Accepted Answer

The answer of Four groups of sixth grade students took...

Question 16

Reliability is to random error as validity is to
A) standard error.
B) systematic error.
C) internal error.
D) error of measurement.
E) None of these are true.

Accepted Answer

Reliability is the degree to which a measurement tool produces consistent results. Random error refers to the chance variability that may occur in the measurement process. Validity, on the other hand, refers to the extent to which a measurement tool accurately measures what it is intended to measure. Systematic error is the type of error that results from consistent, predictable factors that affect the validity of a measurement tool, and is therefore the best choice for the analogy.

Question 17

The greatest difficulty for one doing research on teacher effectiveness is most likely to be
A) formulating the research question.
B) obtaining subjects to participate in the study.
C) operationally defining teacher effectiveness.
D) developing statistical procedures for analyzing the data.

Accepted Answer

Operational definition of teacher effectiveness is a complex and multifaceted concept, which can vary based on the context and perspective of the researcher. It requires considerable deliberation and consensus building among experts to arrive at an operational definition that captures the essential aspects of the construct, yet remains measurable and useful for the specific research purpose. The other options may pose some challenges but are relatively straightforward to overcome with appropriate planning and resources.

Question 18

Miss Smith compares the items on the Powers Chemistry Test to the content and objectives in her chemistry course.Miss Smith is most concerned with
A) validity evidence based on relationship to other variables.
B) validity evidence based on content.
C) validity evidence based on internal structure.
D) stability reliability.
E) equivalent forms reliability.

Accepted Answer

Miss Smith is concerned with the fit between the content and objectives of her chemistry course and the items on the Powers Chemistry Test. This is related to content validity evidence, which assesses whether the items on a test are relevant and representative of the content domain being tested.

Question 19

Form A of a standardized reading test is administered and then Form B of the same test is administered one month later.The coefficient of correlation between the two test scores for a group of students would be known as a
A) coefficient alpha.
B) coefficient of stability.
C) coefficient of equivalence.
D) coefficient of internal consistency.
E) coefficient of stability and equivalence.

Accepted Answer

The coefficient of correlation between two different forms of a test administered at different times measures both stability (over time) and equivalence (between forms).

Question 20

A test has a standard deviation of 4 and a reliability of .91.What is the standard error of measurement?
A) 1.20
B) 1.82
C) 3.64
D) 3.82

Accepted Answer

The standard error of measurement is the standard deviation of the error scores. The error scores are the differences between the observed scores and the true scores. The reliability of a test is the proportion of variance in the observed scores that is due to true variance. The standard error of measurement is calculated by multiplying the standard deviation by the square root of 1 minus the reliability. In this case, the standard error of measurement is 4 * sqrt(1 - .91) = 1.20.

Quiz 9: Validity and Reliability

Cronbach's coefficient alpha is preferred to the Kuder-Richardson 21 when

High score reliability for a test indicates that

The major disadvantage of the coefficient of stability and equivalence as a measure of reliability is

A test has a reliability coefficient of .75.This coefficient indicates that

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher compares the science test results with the results of a standardized test in science.

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher correlates students' scores on the test with the final semester grade received in the course.

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher tries to determine if the numerical reasoning test is really measuring numerical reasoning skills rather than ability to read the test items.

A researcher has constructed an attitude scale in which each item is scored from 1 to 5 depending on the extent of agreement or disagreement.The estimate of score reliability that would be recommended for this scale is

If the score reliability of a test decreases, the standard error of measurement will

A personality test has been carefully prepared to measure a single trait.Which of the following coefficients would probably be lowest in size?

The coefficient of correlation between a scholastic aptitude test and GPA was found to be 1.05.This coefficient indicates that

A researcher is constructing a test for use in a study.In order to insure the highest reliability, the researcher should

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher examines an achievement test to see how well it covers the content and objectives covered in the course.

The scores made by a group of students on a classroom chemistry test are correlated with their scores on a standardized chemistry test.The coefficient of correlation between the two sets of scores would be called a

Four groups of sixth grade students took the same test in reading.The reliability coefficient will be highest for

Reliability is to random error as validity is to

The greatest difficulty for one doing research on teacher effectiveness is most likely to be

Miss Smith compares the items on the Powers Chemistry Test to the content and objectives in her chemistry course.Miss Smith is most concerned with

Form A of a standardized reading test is administered and then Form B of the same test is administered one month later.The coefficient of correlation between the two test scores for a group of students would be known as a

A test has a standard deviation of 4 and a reliability of .91.What is the standard error of measurement?