Question 1

Evidence of construct validity is provided when convergent validity correlations are ______.
A) higher than discriminant validity correlations
B) lower than discriminant validity correlations
C) the same as are discriminant validity correlations
D) similar as are discriminant validity correlations

Accepted Answer

Convergent validity correlations should be higher than discriminant validity correlations to provide evidence of construct validity. This is because convergent validity is the degree to which two measures of the same construct are positively related, while discriminant validity is the degree to which two measures of different constructs are not related. If the convergent validity correlations are higher than the discriminant validity correlations, it suggests that the measures are more strongly related when measuring the same construct, providing evidence of construct validity.

Question 2

Explain and give examples for the three steps of construct explication.

Accepted Answer

The answer of Explain and give examples for the three...

Question 3

What is a factor?
A) the correlations between subscales on a test
B) a concept that may explain why group questions on a test are correlated
C) an environmental force that changes the interpretation of test scores
D) evidence that a test has construct validity

Accepted Answer

A factor is a concept that may explain why group questions on a test are correlated. Factors refer to underlying dimensions or constructs that influence test scores or behaviours. Factors can be identified through statistical analyses such as factor analysis.

Question 4

Which of the following is a statistical procedure whose purpose is to identify the underlying constructs that contribute to an overall test score?
A) analysis of variance
B) multitrait-multimethod design
C) factor analysis
D) multiple regression

Accepted Answer

Factor analysis is a statistical procedure that is specifically designed to identify the underlying constructs that contribute to an overall test score. The other options, such as analysis of variance and multiple regression, are statistical procedures that are used to examine associations between variables, but they are not specifically tailored to identify underlying constructs. The multitrait-multimethod design is a research design rather than a statistical procedure and is used to evaluate the construct validity of a measurement instrument.

Question 5

What was Cronbach's (1989) advice about construct validation?
A) Validation is a risky process likely to bring the young researcher to ruin.
B) Construct validity is vastly more important than any of the other validities.
C) Validation is a lengthy, even endless process.
D) The test user who spurns validation cannot make valid decisions.

Accepted Answer

Cronbach's advice was that construct validation is a lengthy process that may be endless. He did not mention that validation is risky or that construct validity is vastly more important than other validities. However, he did emphasize the importance of validation for making valid decisions.

Question 6

A multitrait-multimethod correlation matrix is shown below. What is the correlation of Test of Trait 1/Multiple Choice and Test of Trait 2/Multiple Choice and what is its type? 
A) .75; monotrait-monomethod
B) .75; heterotrait-monomethod
C) .89; heterotrait-heteromethod
D) .89; montrait-heteromethod

Accepted Answer

The answer of A multitrait-multimethod correlation matrix is shown below....

Question 7

Explain the process of establishing evidence of validity based on a test's relationship with constructs, including the various factors that can provide evidence of that validity.

Accepted Answer

The answer of Explain the process of establishing evidence of...

Question 8

Which one of the following does NOT provide evidence of construct validity?
A) standard error of measurement
B) evidence of validity based on relations with external criteria
C) evidence of validity based on content
D) factor analysis

Accepted Answer

Standard error of measurement pertains to the reliability of a test, not its construct validity. Choices B, C, and D all provide evidence of construct validity. Evidence of validity based on relations with external criteria is known as criterion-related validity, evidence of validity based on content is known as content validity, and factor analysis is used to confirm the underlying constructs being measured by a test.

Question 9

When researchers conduct a factor analysis procedure to see whether the factors they proposed in a test really exist in the test?
A) exploratory factor analysis
B) confirmatory factor analysis
C) discriminant factor analysis
D) construct factor analysis

Accepted Answer

Confirmatory factor analysis is used to confirm whether the factors proposed in a test actually exist in the test. Exploratory factor analysis is used to explore the underlying factors within a set of data. Discriminant factor analysis is used to determine whether two or more factors are distinct from each other. Construct factor analysis is not a recognized term in the field of psychology.

Question 10

What is a confirmatory factor analysis?
A) a process that provides information on test bias and discrimination
B) a process that researchers use to determine what factors underlie a construct
C) a process of conducting a goodness-of-fit test
D) a process that researchers use to demonstrate that the constructs that theory suggests their test should contain actually exist

Accepted Answer

Confirmatory factor analysis is a statistical method used to test whether the measured variables in a study actually represent the underlying theoretical construct(s) postulated by a particular theory or measurement model. Hence, it is a process that researchers use to demonstrate that the constructs that theory suggests their test should contain actually exist.

Question 11

Discuss the roles of confirmatory and exploratory factor analysis in establishing construct validity. Give an example of a study using each type of factor analysis.

Accepted Answer

The answer of Discuss the roles of confirmatory and exploratory...

Question 12

Explain how Campbell and Fiske's Multitrait-Multimethod Matrix (MTMM) provides evidence of construct validity. Give examples and draw a MTMM matrix.

Accepted Answer

The answer of Explain how Campbell and Fiske's Multitrait-Multimethod Matrix...

Question 13

Discuss the concept of a construct and give examples of theoretical constructs.

Accepted Answer

The answer of Discuss the concept of a construct and...

Question 14

A multitrait-multimethod correlation matrix is shown below. What is the correlation of Test of Trait 2/Essay with Test of Trait 3 /Interview and what is its type? 
A) .08; heterotrait-heteromethod
B) .08; heterotrait-monomethod
C) .40; heterotrait-monomethod
D) .40; heterotrait-heteromethod

Accepted Answer

The answer of A multitrait-multimethod correlation matrix is shown below....

Question 15

Which one of the following provides an observable and measurable behavior for the theoretical construct of success as an actor?
A) When the actor feels an emotion, the audience feels the same emotion in the same strength and depth.
B) when the actor believes she has the underlying talent and the ability to express that talent
C) when the actor experiences high levels of stage fright
D) when the actor brings in revenue at the box office under all conditions

Accepted Answer

Revenue generated at the box office is an observable and measurable behavior that can be used to determine the success of an actor. It is not based on subjective feelings or beliefs, and can be easily quantified and compared across different actors and productions. The other options do not provide a clear or objective way to measure success as an actor.

Question 16

Discuss the types of psychometric data that can provide evidence of construct validity. Define and give an example of each.

Accepted Answer

The answer of Discuss the types of psychometric data that...

Question 17

When test scores from a new test correlate with test scores from other tests that measure related constructs, they provide ______.
A) concurrent evidence of validity
B) convergent evidence of validity
C) evidence of validity based on test content
D) predictive evidence of validity

Accepted Answer

Convergent evidence of validity is when test scores from a new test correlate with test scores from other tests that measure related constructs. This provides evidence that the new test is measuring what it is supposed to measure, and therefore, increases the validity of the test.

Question 18

Which one of the following processes requires researchers to first specify a hypothesis?
A) multitrait-multimethod study
B) content validity study
C) exploratory factor analysis
D) confirmatory factor analysis

Accepted Answer

Confirmatory factor analysis requires researchers to first specify a hypothesis about the underlying factor structure of a set of variables, which is then tested against the data. Multitrait-multimethod studies and content validity studies also involve defining what constructs are being measured, but do not necessarily require a specific hypothesis to be tested. Exploratory factor analysis involves exploring patterns of covariance among variables without a pre-defined hypothesis.

Question 19

The statistical procedure that researchers use to identify underlying components that may exist in test without first proposing a formal model?
A) a goodness-of-fit test
B) construct explication
C) exploratory factor analysis
D) confirmatory factor analysis

Accepted Answer

Exploratory factor analysis is a statistical technique used to identify underlying components or factors that may exist in a set of data without first proposing a formal model. It is exploratory in nature, meaning that it is used to generate hypotheses about the underlying structure of a dataset that can be later tested using confirmatory factor analysis. Goodness-of-fit tests are used to evaluate how well a model fits the data, while construct explication involves the process of defining and clarifying the meaning of a construct being measured.

Question 20

When an underlying theory explains the relation between a predictor and a criterion, there is evidence of ______.
A) construct validity
B) criterion-related validity
C) predictive validity
D) concurrent validity

Accepted Answer

Construct validity is demonstrated when a test is shown to measure the theoretical construct it claims to measure, which includes explaining the relation between a predictor and a criterion.

Quiz 8: How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs

Evidence of construct validity is provided when convergent validity correlations are ______.

Explain and give examples for the three steps of construct explication.

What is a factor?

Which of the following is a statistical procedure whose purpose is to identify the underlying constructs that contribute to an overall test score?

What was Cronbach's (1989) advice about construct validation?

A multitrait-multimethod correlation matrix is shown below. What is the correlation of Test of Trait 1/Multiple Choice and Test of Trait 2/Multiple Choice and what is its type?

Explain the process of establishing evidence of validity based on a test's relationship with constructs, including the various factors that can provide evidence of that validity.

Which one of the following does NOT provide evidence of construct validity?

When researchers conduct a factor analysis procedure to see whether the factors they proposed in a test really exist in the test?

What is a confirmatory factor analysis?

Discuss the roles of confirmatory and exploratory factor analysis in establishing construct validity. Give an example of a study using each type of factor analysis.

Explain how Campbell and Fiske's Multitrait-Multimethod Matrix (MTMM) provides evidence of construct validity. Give examples and draw a MTMM matrix.

Discuss the concept of a construct and give examples of theoretical constructs.

A multitrait-multimethod correlation matrix is shown below. What is the correlation of Test of Trait 2/Essay with Test of Trait 3 /Interview and what is its type?

Which one of the following provides an observable and measurable behavior for the theoretical construct of success as an actor?

Discuss the types of psychometric data that can provide evidence of construct validity. Define and give an example of each.

When test scores from a new test correlate with test scores from other tests that measure related constructs, they provide ______.

Which one of the following processes requires researchers to first specify a hypothesis?

The statistical procedure that researchers use to identify underlying components that may exist in test without first proposing a formal model?

When an underlying theory explains the relation between a predictor and a criterion, there is evidence of ______.