Question 1

A researcher wants to understand what helps some students from disadvantaged backgrounds to excel throughout their school years while others do not. This researcher is planning to examine what?

Accepted Answer

The researcher is interested in examining "traits," which are enduring characteristics or qualities that might help some students excel despite their disadvantaged backgrounds.

Question 2

In order to improve counseling services, a researcher wants to understand what affects high school students' beliefs and feelings immediately after they have received low or high test scores. This researcher is planning to examine what?

Accepted Answer

The researcher is interested in the immediate beliefs and feelings of students, which are temporary and situational, thus they are examining "states."

Question 3

A research team is developing a test of school readiness. They believe that there are four dimensions of school readiness. They completed a factor analysis on their data. If the test was developed well, how many factors should have been evident in the factor analysis?

Accepted Answer

If the test was developed well and the researchers believe there are four dimensions of school readiness, the factor analysis should reveal four distinct factors corresponding to these dimensions.

Question 4

Clyde's personality is being assessed in a laboratory setting. He is asked to interact with new people and his behavior is rated. This is an example of a(n):

Accepted Answer

A performance measure involves observing and rating an individual's behavior in a controlled setting, such as interacting with new people in a laboratory.

Question 5

If a research project was designed to determine if a questionnaire given to newly married couples can determine the likelihood that they will eventually divorce, this would be an example of what type of evidence?

Accepted Answer

Predictive evidence is used to determine if a test or measure can accurately forecast future outcomes, such as the likelihood of divorce in this case.

Question 6

The difference between true scores and observed scores on tests is called

Accepted Answer

The difference between true scores and observed scores is referred to as "error" in the context of measurement and testing.

Question 7

Consistency of scores on a test over time is known as:

Accepted Answer

Test-retest reliability refers to the consistency of scores on a test over time.

Question 8

If a researcher collects data using an instrument from a group of participants who vary greatly from the instrument's norming group, what does this mean?

Accepted Answer

The validity of the study is questionable because the instrument may not accurately measure the intended variables in a group that differs significantly from the norming group.

Question 9

When constructing an instrument to measure attitudes toward exercise, a researcher had a panel of experts examine the items generated to make sure the items adequately represented the domain of interest. This would be an example of:

Accepted Answer

The process described is an example of content-related evidence validity, where experts evaluate whether the items of an instrument adequately cover the domain of interest.

Question 10

Anna is participating in research project. She is asked to look at ambiguous drawings and tell the researcher what she sees in the drawings. This is an example of a(n):

Accepted Answer

Projective measures involve presenting ambiguous stimuli to individuals and interpreting their responses to uncover underlying thoughts, feelings, or personality traits.

Question 11

Which of the following is a form of internal consistency reliability?

Accepted Answer

Split-half reliability is a form of internal consistency reliability, where a test is divided into two halves, and the scores on both halves are compared to assess the consistency of results across the test.

Question 12

A test developer was looking at the reliability and validity of the test she developed. She found that the coefficient alpha was -.88 and that the convergent validity coefficient was -.92. What can she say about the reliability and validity of her test?

Accepted Answer

A negative coefficient alpha indicates a problem with reliability, as reliability coefficients should be positive. Similarly, a negative convergent validity coefficient suggests issues with validity, as validity coefficients should also be positive.

Question 13

Validity evidencebased on the relationship between testscores and criterion scores obtained at the same time is known as:

Accepted Answer

Concurrent evidence refers to the validity evidence obtained when test scores and criterion scores are collected at the same time, demonstrating the relationship between the two.

Question 14

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained ata later time is known as:

Accepted Answer

Predictive evidence refers to the validity evidence gathered when test scores are used to predict future performance on a criterion measure.

Question 15

The relatively permanent patterns that characterize and can be used to classify individuals is called:

Accepted Answer

Personality is the relatively permanent patterns that characterize and can be used to classify individuals.

Question 16

For one of your tests in this class, the instructor is going to give you a calculus test. Which of the following outcomes of the use of this test in your class focused on educational research?

Accepted Answer

If the class is focused on educational research, a calculus test may consistently measure calculus skills (reliable) but not measure educational research skills (not valid).

Question 17

It is not a good idea to assess test-retest reliability by two tests that are given a few days apart because:

Accepted Answer

When tests are given a few days apart, participants may remember their previous answers, artificially inflating the correlation and not accurately reflecting true test-retest reliability.

Question 18

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance is which of the following?

Accepted Answer

Criterion-related evidence refers to the extent to which test scores can predict or correlate with performance on a criterion measure, such as future performance or another test.

Question 19

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct is known as:

Accepted Answer

Convergent evidence refers to the validity evidence obtained when test scores correlate well with other measures of the same construct, indicating that the test is measuring what it is intended to measure.

Question 20

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs is known as:

Accepted Answer

Discriminant evidence refers to the degree to which a test does not correlate with other tests that measure different constructs, indicating that the test is measuring a distinct concept.

Quiz 7: Standardized Measurement and Assessment

A researcher wants to understand what helps some students from disadvantaged backgrounds to excel throughout their school years while others do not. This researcher is planning to examine what?

In order to improve counseling services, a researcher wants to understand what affects high school students' beliefs and feelings immediately after they have received low or high test scores. This researcher is planning to examine what?

A research team is developing a test of school readiness. They believe that there are four dimensions of school readiness. They completed a factor analysis on their data. If the test was developed well, how many factors should have been evident in the factor analysis?

Clyde's personality is being assessed in a laboratory setting. He is asked to interact with new people and his behavior is rated. This is an example of a(n) :

If a research project was designed to determine if a questionnaire given to newly married couples can determine the likelihood that they will eventually divorce, this would be an example of what type of evidence?

The difference between true scores and observed scores on tests is called

Consistency of scores on a test over time is known as:

If a researcher collects data using an instrument from a group of participants who vary greatly from the instrument's norming group, what does this mean?

When constructing an instrument to measure attitudes toward exercise, a researcher had a panel of experts examine the items generated to make sure the items adequately represented the domain of interest. This would be an example of:

Anna is participating in research project. She is asked to look at ambiguous drawings and tell the researcher what she sees in the drawings. This is an example of a(n) :

Which of the following is a form of internal consistency reliability?

A test developer was looking at the reliability and validity of the test she developed. She found that the coefficient alpha was -.88 and that the convergent validity coefficient was -.92. What can she say about the reliability and validity of her test?

Validity evidencebased on the relationship between testscores and criterion scores obtained at the same time is known as:

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained ata later time is known as:

The relatively permanent patterns that characterize and can be used to classify individuals is called:

For one of your tests in this class, the instructor is going to give you a calculus test. Which of the following outcomes of the use of this test in your class focused on educational research?

It is not a good idea to assess test-retest reliability by two tests that are given a few days apart because:

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance is which of the following?

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct is known as:

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs is known as:

Quiz 7: Standardized Measurement and Assessment

A researcher wants to understand what helps some students from disadvantaged backgrounds to excel throughout their school years while others do not. This researcher is planning to examine what?

In order to improve counseling services, a researcher wants to understand what affects high school students' beliefs and feelings immediately after they have received low or high test scores. This researcher is planning to examine what?

A research team is developing a test of school readiness. They believe that there are four dimensions of school readiness. They completed a factor analysis on their data. If the test was developed well, how many factors should have been evident in the factor analysis?

Clyde's personality is being assessed in a laboratory setting. He is asked to interact with new people and his behavior is rated. This is an example of a(n) :

If a research project was designed to determine if a questionnaire given to newly married couples can determine the likelihood that they will eventually divorce, this would be an example of what type of evidence?

The difference between true scores and observed scores on tests is called

Consistency of scores on a test over time is known as:

If a researcher collects data using an instrument from a group of participants who vary greatly from the instrument's norming group, what does this mean?

When constructing an instrument to measure attitudes toward exercise, a researcher had a panel of experts examine the items generated to make sure the items adequately represented the domain of interest. This would be an example of:

Anna is participating in research project. She is asked to look at ambiguous drawings and tell the researcher what she sees in the drawings. This is an example of a(n) :

Which of the following is a form of internal consistency reliability?

A test developer was looking at the reliability and validity of the test she developed. She found that the coefficient alpha was -.88 and that the convergent validity coefficient was -.92. What can she say about the reliability and validity of her test?

Validity evidence based on the relationship between test scores and criterion scores obtained at the same time is known as:

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained at a later time is known as:

The relatively permanent patterns that characterize and can be used to classify individuals is called:

For one of your tests in this class, the instructor is going to give you a calculus test. Which of the following outcomes of the use of this test in your class focused on educational research?

It is not a good idea to assess test-retest reliability by two tests that are given a few days apart because:

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance is which of the following?

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct is known as:

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs is known as:

Validity evidencebased on the relationship between testscores and criterion scores obtained at the same time is known as:

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained ata later time is known as: