Question 1

What are concrete attributes?
A) attributes that can be clearly described in terms of observable and measurable behaviors
B) attributes that are difficult to describe in terms of behaviors as people may disagree on what these behaviors represent
C) attributes that specifically describe the characteristics of an individual's personality
D) attributes for which the psychological test gives a raw score for each test taker

Accepted Answer

Concrete attributes are those that can be objectively observed and measured through behaviors, actions, or tangible characteristics. These attributes can be quantified using various methods such as rating scales, behavior checklists, or direct observation. Examples of concrete attributes include height, weight, eye color, and intelligence quotient (IQ).

Question 2

Which of the following are attributes that are difficult to describe in terms of behaviors because people disagree on what these behaviors represent?
A) abstract
B) absolute
C) concrete
D) comparative

Accepted Answer

Abstract attributes are difficult to describe in terms of behaviors because people may have different interpretations or meanings for them, making it difficult to observe and measure specific behaviors that represent the attribute. Absolute, concrete, and comparative attributes are more straightforward and observable in terms of behaviors.

Question 3

Defining the testing universe is an important step for ensuring a test has evidence of validity based on its ______.
A) content
B) reliability
C) relations with variables
D) constructs

Accepted Answer

Defining the testing universe is important for ensuring the content validity of a test, which means that the test measures what it is supposed to measure. Content validity is one type of evidence of validity. Reliability, relations with variables, and constructs are other types of evidence of validity but are not directly related to defining the testing universe.

Question 4

Which one of the following statements best describes a practical test?
A) the driving portion of a driving test
B) the math portion of the SAT
C) tests such as temperature or weight measurement
D) a job interview

Accepted Answer

A practical test refers to a test where the skills being tested are demonstrated in practice, such as the driving portion of a driving test where the ability to drive is directly assessed.

Question 5

Which of the following would provide evidence of a test's validity based on content?
A) the extent to which test questions are representative of the knowledge domain measured
B) the extent to which a person's test scores can predict his or her current and future behavior
C) the extent to which the test taker recognizes the purpose of each test question
D) a numerical analysis of the test's construct dimensions

Accepted Answer

Content validity refers to the extent to which a test measures the intended content domain. Therefore, evidence of content validity would be the extent to which test questions are representative of the knowledge domain being measured.

Question 6

When test developers choose the type of test they wish to create, such as essay or multiple choice, they are choosing the ______.
A) testing universe
B) test specifications
C) test format
D) content areas

Accepted Answer

Choosing the type of test, such as essay or multiple choice, refers to the format of the test. The testing universe refers to the population or group being tested, the test specifications refer to the specific requirements or criteria for the test, and the content areas refer to the specific topics or subjects covered on the test.

Question 7

When test scores used to select employees are systematically related to a score on a job performance appraisal instrument, the test is demonstrating evidence of validity based on its ______.
A) content
B) relationship with another construct
C) reliability
D) relationship with a criterion

Accepted Answer

Validity refers to the accuracy of a test in measuring what it is intended to measure. When a test score is systematically related to a score on a job performance appraisal instrument, it demonstrates evidence of validity based on its relationship with a criterion - in this case, job performance. Content validity refers to the extent to which a test measures the content or knowledge it is supposed to measure. Reliability refers to the consistency of a test's results over time and across different raters or testing conditions. While the test may also have evidence of reliability and/or content validity, the given information specifically pertains to validity based on its relationship with a criterion. Therefore, the best choice is D.

Question 8

Which one of the following types of evidence of validity can be gathered without using correlations?
A) evidence based on relations with a construct
B) evidence based on test content
C) predictive evidence of validity
D) concurrent evidence of validity

Accepted Answer

Evidence based on test content can be gathered without using correlations, as it refers to the extent to which a test measures the content it is supposed to measure based on expert judgment and analysis of the test questions. The other types of evidence of validity (relations with a construct, predictive evidence, and concurrent evidence) all require correlations with other measures or criteria.

Question 9

What do we call a documented plan containing details about a test's content?
A) testing universe
B) content area
C) test specifications
D) test format

Accepted Answer

A documented plan containing details about a test's content is known as test specifications. Option A, testing universe, is not a commonly used term in testing. Option B, content area, refers to a specific subject area being assessed within the test, but does not encompass the entire plan. Option D, test format, refers to the design or structure of the test (e.g. multiple-choice, essay).

Question 10

If a test includes questions that are a representative sample of the material covered in a training course, the test demonstrates evidence of ______.
A) reliability
B) validity based on a relation with other variables
C) face validity
D) validity based on content

Accepted Answer

A test that includes questions that are a representative sample of the material covered in a training course demonstrates evidence of validity based on content. This means that the test is measuring what it intends to measure (i.e. the knowledge and understanding of the material covered in the training course). Reliability refers to the consistency of the test results over time, while validity based on a relation with other variables considers whether the test results are related to other variables of interest. Face validity refers to whether the test appears to measure what it intends to measure, regardless of whether it actually does.

Question 11

When we ask, "Are the inferences being made from a set of test scores appropriate?" we are referring to ______.
A) internal consistency
B) face validity
C) reliability
D) validity

Accepted Answer

The question is referring to the appropriateness of the inferences being made from test scores, which is a matter of validity. Internal consistency and reliability relate to the consistency of scores within a test, while face validity relates to the extent that a test appears to measure what it is intended to measure.

Question 12

______ is/are difficult to describe because people disagree on what behaviors represent, whereas ______ is/are clearly described in observable and measurable behaviors.
A) Concrete attributes; abstract attributes
B) Abstract attributes; concrete attributes
C) Concurrent validity; construct validity
D) Construct validity; concurrent validity

Accepted Answer

Abstract attributes are difficult to describe because people may have different interpretations of them, while concrete attributes are clearly observable and measurable. The options involving validity are not relevant to describing attributes.

Question 13

Which one of the following research studies could yield information about evidence of validity based on the content of a test?
A) a study that involves performing a series of systematic steps during test development
B) a study that involves correlating test scores with a previously identified performance measure
C) a study that involves correlating test scores with another previously identified test
D) a study where test takers provide their opinion on how well test questions relate to the test topic

Accepted Answer

Content validity is assessed by analyzing how well a test measures the content that it is intended to measure. A study that involves performing a series of systematic steps during test development, such as expert review and pilot testing, can provide evidence of content validity. The other options are not specifically designed to assess content validity.

Question 14

When you ask experts to rate the extent to which individual questions are essential to measure the testing universe, you are gathering evidence of validity based on ______.
A) relations with other variables
B) internal structure
C) test content
D) response processes

Accepted Answer

When asking experts to rate questions as essential, this is a form of content validity evidence, as it is assessing the extent to which the test content (i.e. individual questions) adequately measure the testing universe. Relations with other variables (A), internal structure (B), and response processes (D) are other forms of validity evidence, but they are not directly being assessed in this scenario.

Question 15

Evidence of construct validity is most appropriate when a test measures an abstract construct such as ______.
A) mathematical computation
B) English grammar
C) marital satisfaction
D) an IRS tax code

Accepted Answer

A test measuring an abstract construct, such as marital satisfaction, requires evidence of construct validity since it cannot be directly observed or measured. Options (A) and (B) are more concrete and objective constructs that can be measured through other forms of validity. Option (D) refers to a specific set of rules and regulations, not an abstract construct, making evidence of construct validity irrelevant.

Question 16

Which of the following are considered "traditional" terms that are no longer used in the most recent version of the Standards for Educational and Psychological Testing?
A) reliability and precision
B) internal consistency and test-retest reliability
C) test developer and test publisher
D) content- and criterion-related validity

Accepted Answer

The most recent version of the Standards for Educational and Psychological Testing has moved away from using terms like "content- and criterion-related validity" in favor of a more unified concept of validity.

Question 17

Which one of the following statements about validity is FALSE?
A) Evidence of validity based on a test's relations with other variables involves correlating test scores to a measure of performance or another test.
B) Evidence of validity based on content involves examining the questions on the test to see whether they represent the domain being measured.
C) Evidence of validity based on content involves correlating test scores to a criterion.
D) Evidence of validity based on a test's relations with a criterion can be gathered via the concurrent and predictive methods.

Accepted Answer

Evidence of validity based on content involves examining the questions on the test to see whether they represent the domain being measured. Correlating test scores to a criterion is actually evidence of validity based on criterion-related validity.

Question 18

The predictive and concurrent methods provide two types of evidence for ______.
A) validity based on relations with a construct
B) face validity
C) validity based on relations with a criterion
D) validity based on content

Accepted Answer

The predictive and concurrent methods are both used to establish validity based on relations with a criterion, meaning they both test whether a particular measure (such as a test or assessment) is related to a particular criterion (such as job performance or academic achievement). Option A is incorrect because it refers to construct validity, which is established through other means such as convergent and discriminant validity. Option B is incorrect because it refers to face validity, which is a subjective measure of whether a test appears to measure what it is intended to measure. Option D is incorrect because it refers to content validity, which is established by examining the degree to which a test measures the specific content area it is intended to measure.

Question 19

What is the appropriate strategy for gathering validity evidence of a test?
A) gathering every different source of evidence of validity
B) gathering one source of evidence of validity
C) gathering concrete and abstract attributes
D) it depends on the purpose of the test

Accepted Answer

The appropriate strategy for gathering validity evidence of a test depends on the purpose of the test. Different types of evidence should be collected based on the specific intended use of the test. For example, if the test is intended to measure a certain construct, then evidence should be gathered to support its construct validity. If the test is intended to make predictions, then evidence should be gathered to support its predictive validity. Therefore, the most appropriate answer is D, since it acknowledges the importance of tailoring the validation process to the purpose of the test.

Question 20

Evidence of validity based on content is most appropriate for what types of tests?
A) achievement tests that measure concrete attributes
B) personality tests that measure absolute attributes
C) concrete tests that measure aptitude and achievement
D) comparative tests that measure personality characteristics

Accepted Answer

Content validity pertains to whether a test measures what it is intended to measure. Achievement tests that measure concrete attributes such as knowledge and skills can be easily evaluated for content validity by assessing whether the test items are relevant and appropriate for the targeted domain. Personality tests that measure absolute attributes, on the other hand, involve more abstract constructs that cannot be directly observed or validated through content analysis.

Quiz 6: How Do We Gather Evidence of Validity Based on the Content of a Test

What are concrete attributes?

Which of the following are attributes that are difficult to describe in terms of behaviors because people disagree on what these behaviors represent?

Defining the testing universe is an important step for ensuring a test has evidence of validity based on its ______.

Which one of the following statements best describes a practical test?

Which of the following would provide evidence of a test's validity based on content?

When test developers choose the type of test they wish to create, such as essay or multiple choice, they are choosing the ______.

When test scores used to select employees are systematically related to a score on a job performance appraisal instrument, the test is demonstrating evidence of validity based on its ______.

Which one of the following types of evidence of validity can be gathered without using correlations?

What do we call a documented plan containing details about a test's content?

If a test includes questions that are a representative sample of the material covered in a training course, the test demonstrates evidence of ______.

When we ask, "Are the inferences being made from a set of test scores appropriate?" we are referring to ______.

is/are difficult to describe because people disagree on what behaviors represent, whereas is/are clearly described in observable and measurable behaviors.

Which one of the following research studies could yield information about evidence of validity based on the content of a test?

When you ask experts to rate the extent to which individual questions are essential to measure the testing universe, you are gathering evidence of validity based on ______.

Evidence of construct validity is most appropriate when a test measures an abstract construct such as ______.

Which of the following are considered "traditional" terms that are no longer used in the most recent version of the Standards for Educational and Psychological Testing?

Which one of the following statements about validity is FALSE?

The predictive and concurrent methods provide two types of evidence for ______.

What is the appropriate strategy for gathering validity evidence of a test?

Evidence of validity based on content is most appropriate for what types of tests?