Question 1

Comparing SAT scores earned in high school with the first semester college GPA of that same student is a process related to establishing the ________ validity of the SAT.
A) content
B) concurrent criterion-related
C) predictive criterion-related
D) construct

Accepted Answer

Comparing SAT scores with first semester college GPA is an example of predictive criterion-related validity as it predicts the college performance of the student. Content validity refers to whether a test is measuring the intended content or domain. Concurrent criterion-related validity refers to the relationship between test scores and a criterion measure that is assessed at the same time. Construct validity refers to whether a test is measuring the intended theoretical construct.

Question 2

A test developer compares a student's performance on a newly developed math achievement test to the same student's performance on a well established math achievement test for the purpose of exploring the ________ validity of the new test.
A) content
B) concurrent criterion-related
C) predictive criterion-related
D) construct

Accepted Answer

Concurrent criterion-related validity is the extent to which scores on a new test are related to scores on an established test that measures the same construct. Therefore, comparing a student's performance on the new math achievement test to the same student's performance on a well-established math achievement test is an example of concurrent criterion-related validity.

Question 3

Relating to Lawshe's Content Validity Ratio (CVR),if half of the panelists rated a given item on an employment test as representing an essential skill required on the job,the item's CVR would
A) be negative.
B) be zero.
C) be positive.
D) depend on how many panelists there are.

Accepted Answer

The answer of Relating to Lawshe's Content Validity Ratio (CVR),if...

Question 4

Which BEST describes the concept of validity as applied to tests?
A) It refers to how well a test measures what the test authors intend it to measure
B) It refers to whether the same results could have occurred by chance less than five times in a hundred.
C) It refers to how well a specific sample performs on an administration of a test.
D) It refers to whether or not a test is administered under standardized conditions.

Accepted Answer

Validity in testing means whether the test measures what it is intended to measure. It involves ensuring that the test items accurately measure the construct or behavior it intends to measure.

Question 5

Which is TRUE regarding the concept of test fairness?
A) Fairness is relatively easy to determine compared with bias.
B) Fairness is usually determined statistically.
C) Fairness often involves moral/ethical issues.
D) All of these

Accepted Answer

Fairness often involves moral and ethical issues, and cannot be determined solely through statistical measures or simple comparisons. It requires careful consideration of the context, purpose of the test, potential impacts, and perspectives of different stakeholders. It also involves issues of access, accommodations, representation, and cultural sensitivity. While bias is a key factor that affects fairness, fairness goes beyond bias to consider the broader societal and organizational factors that shape test development, implementation, and interpretation.

Question 6

The results of a predictive validity study of a test will likely be affected most by
A) the characteristics of the sample tested, such as attrition and self-selection.
B) the number of items on the test, with longer tests demonstrating higher predictive validity.
C) the correlation coefficient chosen to measure the validity.
D) the administration time required for the test compared with that of the criterion test chosen.

Accepted Answer

The characteristics of the sample, such as attrition and self-selection, could affect the results of the predictive validity study because they could create bias or inaccuracies in the sample. For example, if the sample is not representative of the population or if there is significant attrition, then the results may not accurately reflect the true predictive validity of the test. Therefore, controlling for these factors would be important in order to obtain more accurate results. The other answer choices do not directly address factors that could affect the results of a predictive validity study.

Question 7

Which of the following is the best definition of hit rate?
A) the proportion of people the test correctly identifies as possessing a particular trait, behavior, characteristic, or attribute
B) the proportion of people in the general population who possess the particular trait, behavior, characteristic, or attribute
C) the proportion of people the test incorrectly identifies as possessing a particular trait, behavior, characteristic, or attribute
D) the degree of validity of a particular test

Accepted Answer

Hit rate refers to the proportion of people correctly identified as having a particular trait or characteristic based on a particular test or assessment. It is a measure of the sensitivity of the test, i.e., how accurately the test identifies the presence of the trait in question. Option B refers to prevalence rate, C refers to false positive rate or type I error, and D refers to validity, which is a broader concept encompassing various aspects of a test's accuracy and reliability.

Question 8

"Unequal levels of difficulty between two groups" characterizes the definition of a biased test that would MOST probably be a quote from
A) any random member of the general public.
B) a court
C) a psychometrician.
D) Kourtney and Kim Kardashian.

Accepted Answer

The answer of "Unequal levels of difficulty between two groups"...

Question 9

If a newly developed test designed to measure happiness correlates with other tests of happiness but not with tests of sadness,this is referred to as __________________ and _________________ evidence of validity,respectively.
A) convergent; discriminant
B) discriminant; convergent
C) homogeneous; concurrent
D) concurrent; homogeneous

Accepted Answer

Convergent evidence of validity refers to the degree to which a new test correlates with other measures of the same construct, in this case, a test of happiness. Discriminant evidence of validity refers to the degree to which a new test does not correlate with measures of a different construct, in this case, a test of sadness. Therefore, choice A (convergent and discriminant) is the best answer.

Question 10

Which is an example of convergent evidence for the construct validity of a test measuring fear of cats?
A) a high correlation between the test and an existing validated test measuring fear of cats
B) a high correlation with an existing validated test measuring more-generalized fear
C) a low correlation between the test and a test to measure fear of dogs
D) Both a and b

Accepted Answer

Both a high correlation with an existing validated test measuring fear of cats and a high correlation with an existing validated test measuring more-generalized fear would provide convergent evidence for the construct validity of a test measuring fear of cats. By contrast, a low correlation with a test to measure fear of dogs would provide discriminant evidence. Therefore, choice D is the best option.

Question 11

If new predictors explain something about a predicted score that was not already explained by existing predictors,the new predictor might be praised for its
A) test-retest reliability.
B) incremental validity.
C) construct validity.
D) face validity.

Accepted Answer

Incremental validity refers to the ability of a new predictor to add something to the prediction of a score beyond what is already accounted for by existing predictors. Therefore, if new predictors explain something about a predicted score that was not already explained by existing predictors, they may be praised for their incremental validity. Test-retest reliability refers to the consistency of a measure over time, construct validity refers to how well a measure aligns with theoretical concepts, and face validity refers to how well a measure appears to measure what it is intended to measure. While these are important aspects of a measure, they are not directly related to the ability of a new predictor to add incremental value to an existing prediction.

Question 12

In psychological testing and assessment,bias refers to
A) random variation in test performance attributable to covert prejudice on the part of the test developer.
B) systematic variation in test performance that is unrelated to the construct that the test is intended to be measured.
C) a test or testing practice that systematically favors the performance of one group of testtakers over another.
D) All of these

Accepted Answer

The answer of In psychological testing and assessment,bias refers to
A)...

Question 13

Which of the following is the BEST way to minimize test bias?
A) create separate norm groups for different groups so that any potential bias is reduced.
B) have a panel of experts review the test items at various stages during the test's development.
C) pre-screen examiners to be used in the test administration for any signs of bias or prejudice.
D) employ the multitrait-multimethod matrix to screen items for bias.

Accepted Answer

Having a panel of experts review the test items at various stages during the test's development is the best way to minimize test bias as it ensures that potential bias is identified and addressed before the test is administered. Creating separate norm groups or pre-screening examiners may only address bias after it has occurred, while employing the multitrait-multimethod matrix may not fully detect or eliminate all biases.

Question 14

The primary purpose of the correlation matrix in the multitrait-multimethod matrix technique is
A) to break down variables into a smaller number of factors.
B) to create a large number of factors from a basic set of variables.
C) to determine how well a variable correlates with itself.
D) None of these

Accepted Answer

The answer of The primary purpose of the correlation matrix...

Question 15

A psychologist wants to determine the criterion-related validity of an intelligence test by determining how well it predicts a student's placement in a special class.If the psychologist used the intelligence test for both diagnosis and special class placement,that criterion would be said to be
A) irrelevant.
B) contaminated.
C) invalid.
D) negatively skewed

Accepted Answer

If the psychologist used the intelligence test for both diagnosis and special class placement, the criterion would be contaminated because the test results would be influenced by the diagnosis decision, making it difficult to accurately determine the predictive validity of the test.

Question 16

A new test designed to gauge competence to stand trial is found to lack face validity.Which is the MOST likely consequence of this fact?
A) Judges will urge assessors to use this test.
B) Lawyers will urge assessors not to use this test.
C) impression management will be less of a factor in the test results.
D) whether defendants are competent will be less of a factor in the test results.

Accepted Answer

The answer of A new test designed to gauge competence...

Question 17

Which of the following is NOT included in the traditional "trinitarian" conceptualization of validity?
A) face validity
B) content validity
C) construct validity
D) criterion-related validity

Accepted Answer

The traditional "trinitarian" conceptualization of validity includes content validity, construct validity, and criterion-related validity. Face validity, on the other hand, refers to how well a measure appears to measure what it is intended to measure at face value, and is not typically included as a component of traditional validity.

Question 18

Which is TRUE regarding the adjustment of test scores as a function of group membership?
A) It is illegal for purposes of making hiring or promotion decisions according to the Civil Rights Act of 1991.
B) It is viewed as helping guarantee the proportional representation of various minority groups in the workplace.
C) It is viewed as allowing the preferential treatment of certain groups.
D) All of these

Accepted Answer

Adjusting test scores based on group membership is controversial and touches on all the points mentioned: it is illegal for hiring or promotion decisions as per the Civil Rights Act of 1991, it is seen by some as a way to ensure proportional representation of minority groups, and it is also viewed as enabling preferential treatment for certain groups.

Question 19

In studies that indicate that Attention Deficit Disorder occurs in approximately 2% of the population,2% represents the __________ for the disorder.
A) hit rate
B) base rate
C) miss rate
D) sample

Accepted Answer

The base rate represents the prevalence or proportion of a particular condition or characteristic within a population. In this case, the 2% figure represents the base rate for Attention Deficit Disorder in the population.

Question 20

In contrast to a trinitarian view of validity,a unitary view of validity takes into account
A) two of the three elements of the trinitarian view.
B) none of the elements of the trinitarian view but a new model based on consequences of test use.
C) all three elements of the trinitarian view plus additional factors such as cultural values.
D) None of these

Accepted Answer

A unitary view of validity includes all three elements of the trinitarian view (content, criterion, and construct validity), but also adds additional factors such as cultural values and social context. Therefore, choice C is the correct option. Choices A and B are incorrect because they either exclude or only partially consider the elements of the trinitarian view. Choice D is incorrect because it offers no explanation or alternative approach to validity.

Quiz 6: Validity

Comparing SAT scores earned in high school with the first semester college GPA of that same student is a process related to establishing the ________ validity of the SAT.

A test developer compares a student's performance on a newly developed math achievement test to the same student's performance on a well established math achievement test for the purpose of exploring the ________ validity of the new test.

Relating to Lawshe's Content Validity Ratio (CVR) ,if half of the panelists rated a given item on an employment test as representing an essential skill required on the job,the item's CVR would

Which BEST describes the concept of validity as applied to tests?

Which is TRUE regarding the concept of test fairness?

The results of a predictive validity study of a test will likely be affected most by

Which of the following is the best definition of hit rate?

"Unequal levels of difficulty between two groups" characterizes the definition of a biased test that would MOST probably be a quote from

If a newly developed test designed to measure happiness correlates with other tests of happiness but not with tests of sadness,this is referred to as __ and _ evidence of validity,respectively.

Which is an example of convergent evidence for the construct validity of a test measuring fear of cats?

If new predictors explain something about a predicted score that was not already explained by existing predictors,the new predictor might be praised for its

In psychological testing and assessment,bias refers to

Which of the following is the BEST way to minimize test bias?

The primary purpose of the correlation matrix in the multitrait-multimethod matrix technique is

A psychologist wants to determine the criterion-related validity of an intelligence test by determining how well it predicts a student's placement in a special class.If the psychologist used the intelligence test for both diagnosis and special class placement,that criterion would be said to be

A new test designed to gauge competence to stand trial is found to lack face validity.Which is the MOST likely consequence of this fact?

Which of the following is NOT included in the traditional "trinitarian" conceptualization of validity?

Which is TRUE regarding the adjustment of test scores as a function of group membership?

In studies that indicate that Attention Deficit Disorder occurs in approximately 2% of the population,2% represents the __________ for the disorder.

In contrast to a trinitarian view of validity,a unitary view of validity takes into account