Question 1

Factors affecting the generalizability of findings from a particular test include
A) the wording of items on the test.
B) the norm group used in the development of a test.
C) the degree to which the test administration conformed to the directions provided in the test manual.
D) All of these

Accepted Answer

All of these factors can affect the generalizability of findings from a particular test. The wording of items can impact how well the test measures the construct it is intended to measure, while the norm group used in the development of the test can affect how well the test results apply to different populations. Additionally, the degree to which the test administration conforms to the directions provided in the test manual can also impact the validity and reliability of the results.

Question 2

A test designed to provide information about whether or not an aviator has mastered the ability to fly solo is an example of a test that is
A) norm-referenced.
B) criterion-referenced.
C) trait-referenced.
D) All of these

Accepted Answer

A test designed to determine whether an aviator has learned how to fly solo is criterion-referenced because it assesses the pilot's ability to meet a specific criterion or standard. It is not norm-referenced since the pilot is being assessed on whether they can meet a particular standard rather than being compared to those who took the test in the past. It is also not trait-referenced since the test does not evaluate a specific trait or characteristic of the aviator.

Question 3

Any influence on psychological test scores from factors other than what the test is intended to measure is referred to by measurement specialists as
A) spurious artifact.
B) error.
C) bias.
D) construct-irrelevant stimuli.

Accepted Answer

Measurement specialists refer to any influence on test scores from factors other than what the test is intended to measure as "error." This includes any extraneous variables that can affect the accuracy of the test results.

Question 4

When "putting tests to the test" and researching the validity of a particular instrument for a particular purpose,test users
A) will typically consult multiple issues of popular magazines.
B) may need to research which combination of tests best suits a particular purpose.
C) can be satisfied they are using the right instrument if the validity coefficient found is satisfactorily high.
D) All of these

Accepted Answer

Test users may need to research which combination of tests best suits a particular purpose, as there may not be a single instrument that is perfectly valid for all purposes. Simply finding a satisfactorily high validity coefficient is not necessarily sufficient to ensure the validity of the instrument for the specific purpose it is being used for. Consulting popular magazines is unlikely to provide the necessary information for this type of research.

Question 5

When "putting a test to the test" and attempting to evaluate the suitability of a particular tool of measurement for a particular purpose,a test user would be well advised to consult
A) published sources such as test manuals and test reviews.
B) unpublished sources such as colleagues who have experience with it.
C) the test publisher through an e-mail or phone call.
D) All of these.

Accepted Answer

Consulting published sources such as test manuals and test reviews can provide valuable insights into the strengths and weaknesses of a particular tool of measurement. Unpublished sources such as colleagues who have experience with the tool can also provide useful information. Finally, contacting the test publisher through email or phone call can provide clarity on any questions or concerns the test user may have. Therefore, all of these options are recommended for evaluating the suitability of a test for a particular purpose.

Question 6

Test reliability refers to
A) how accurately a test measures what it purports to measure.
B) how consistently a test measures what it purports to measure.
C) the "depth" of measurement of a particular construct.
D) the "bandwidth" of measurement of a particular construct.

Accepted Answer

Test reliability refers to the degree of consistency with which a test measures what it purports to measure. It is not about accuracy or the depth/bandwidth of measurement, but about the consistency of the measurement over time or across raters/scorers.

Question 7

A test that yields information about a testtaker's relative standing in a group is referred to as
A) criterion-referenced.
B) norm-referenced.
C) standard-referenced.
D) None of these

Accepted Answer

Norm-referenced tests compare an individual's performance to the performance of a group, resulting in a ranking or ordering of test takers. A criterion-referenced test measures a test taker's performance against a predetermined standard, and a standard-referenced test measures a test taker's performance against a specific set of standards. None of the answer choices fit the description of a test that yields information about a test taker's relative standing in a group except for norm-referenced.

Question 8

If a controversy exists over the definition of the trait being measured by a psychological test,questions will MOST likely be raised relative to
A) the reliability of the test.
B) the validity of the test.
C) the standardization of the test.
D) All of these

Accepted Answer

If there is a controversy over the definition of the trait being measured, it is likely that the validity of the test will be questioned, as the test may not actually be measuring what it claims to measure. The reliability and standardization of the test, while still important, may be less affected by such a controversy.

Question 9

The term norms refers to the
A) average score of all test-takers within a standardization sample.
B) the typical performance of the norm group.
C) scores with which the results of subsequent measurement can be compared.
D) transformed scores used to create and improve test items.

Accepted Answer

Norms are scores against which subsequent scores can be compared. They reflect the distribution of scores from a sample of individuals who have already taken the test or measurement. Norms can be used to identify how well an individual's score compares to others who have taken the same test.

Question 10

When "putting a test to the test" and researching published guidelines from professional associations regarding the use of a particular test for a particular objective,a test user is MOST likely to find that the guidelines recommend
A) "bending the rules" of test administration as specified in the test manual.
B) interpreting the test using the norms developed for a different test.
C) the use of additional measurement tools along with the test.
D) testing all assessors on their proficiency with the instrument.

Accepted Answer

When researching published guidelines from professional associations, a test user is most likely to find that the guidelines recommend the use of additional measurement tools along with the test to obtain a more comprehensive evaluation. This is because tests have limitations and should not be the sole basis for making decisions. The guidelines are also likely to stress the importance of following the rules of test administration as specified in the test manual, using the norms developed for that particular test, and ensuring that assessors are proficient in using the instrument. However, none of these options are as likely to be emphasized as much as the recommendation to use additional measurement tools along with the test.

Question 11

An assumption inherent in classical test theory (CTT)is that
A) each test-taker has a true score that would have been obtained if not for measurement error.
B) testtakers can be ranked according to the level of the trait or ability that they exhibit in much the same way that rankings can be made by height.
C) measurement can be perfectly accurate if the measuring tool is well-constructed.
D) All of these

Accepted Answer

The assumption inherent in classical test theory (CTT) is that each test-taker has a true score that would have been obtained if not for measurement error. CTT assumes that measurement error affects the observed score, but the true score remains constant. The other options are incorrect because CTT does not assume that test-takers can be ranked in the same way as physical attributes and that measurement can be perfectly accurate.

Question 12

A norm group is a group of testtakers
A) for whom a particular test is deemed inappropriate.
B) taking a particular test for the very first time.
C) that is typically described in the test manual.
D) Only taking a particular test for the very first time and that is typically described in the test manual.

Accepted Answer

A norm group is a group of individuals who take a test under standardized conditions and whose scores serve as a "benchmark" against which other individuals' scores can be compared. Norm groups are typically described in the test manual, and they usually consist of individuals who are similar to the individuals for whom the test is intended (e.g., same age, gender, educational background, etc.). Therefore, choice C is the best option.

Question 13

When "putting a test to the test" and researching the reliability of a particular instrument such as the Bricklin Perceptual Scales,test users will
A) consult the test's manual and test reviews.
B) discover controversy as to how suitable a measure of reliability is.
C) learn of the need for multiple sources of data.
D) All of these

Accepted Answer

When "putting a test to the test" and researching the reliability of a particular instrument such as the Bricklin Perceptual Scales, one should consult the test's manual and test reviews, as well as acknowledge the controversy surrounding the reliability measure and the need for multiple sources of data. Therefore, all three options are necessary when researching the reliability of a particular instrument.

Question 14

One scale at the deli counter of a local supermarket consistently measures everything that is placed on it exactly one ounce more than its actual weight.An assessment professional would describe this scale as
A) valid.
B) reliable.
C) unreliable.
D) not properly normed.

Accepted Answer

The scale is reliable because it consistently gives the same error (measuring one ounce more) for every measurement, indicating consistency in its readings, albeit incorrect. Reliability refers to the consistency of a measure, not its accuracy.

Question 15

When "putting a test to the test" and debating whether or not a particular instrument should be used for a particular objective,relevant questions to be asked include
A) What is the objective in using this test?
B) Who is this test designed for use with?
C) How is what the test measures defined?
D) All of these

Accepted Answer

All of these questions are relevant when evaluating whether or not a particular instrument should be used for a particular objective. Knowing the objective helps to determine if the test is appropriate, knowing the intended population helps to determine if the test is valid and reliable for that group, and understanding how the test measures what it purports to measure helps to evaluate its overall effectiveness.

Question 16

An applicant for a job with the U.S.Postal Service scores in the bottom 5% of all applicants on a test that measures the ability to sort mail.This is an example of
A) norm-referenced testing.
B) criterion-referenced testing.
C) stress-tolerance testing.
D) an individual who may one day "go postal."

Accepted Answer

Norm-referenced testing compares an individual's performance to a norm group, allowing for ranking or grading of individuals. In this case, the applicant's score is compared to the scores of all other applicants, and being in the bottom 5% suggests lower performance compared to the norm group. Criterion-referenced testing, on the other hand, measures an individual's performance against a set standard or criterion, which is not applicable here as there is no fixed standard for sorting mail. Stress-tolerance testing is not relevant to this situation, and the last option is a stereotype and not a valid conclusion to draw from the given information.

Question 17

When "putting a test to the test" and researching the suitability of a particular test for a particular objective,test users will typically research
A) the reliability of the test.
B) the validity of the test.
C) the utility of the test.
D) All of these

Accepted Answer

When researching the suitability of a particular test for a particular objective, it is important to consider all three factors: the reliability, validity, and utility of the test. Reliability refers to the consistency of the results obtained from the test, while validity refers to the extent to which the test measures what it is intended to measure. The utility of the test refers to its usefulness and practicality in achieving the intended objective. Therefore, all of these factors should be considered when putting a test to the test.

Question 18

Based on a careful reading of the "What's a good test?" discussion in Chapter 4's Everyday Psychometrics feature,the BEST conclusion one could reasonably draw is
A) "you get what you pay for."
B) "sometimes things are neither fish nor fowl."
C) "simple questions do not necessarily have simple answers."
D) "it's an ill wind that blows nobody good."

Accepted Answer

Throughout the "What's a good test?" discussion, it is emphasized that the answer to the question of what makes a good test is not a simple one. The article discusses the various factors that can affect the quality of a test, including its reliability, validity, and fairness. Additionally, the discussion emphasizes that different types of tests may require different criteria for evaluating their quality. Therefore, the best conclusion one could reasonably draw is that "simple questions do not necessarily have simple answers."

Question 19

According to Chapter 4 of your text,which of the following statements is NOT true?
A) Some issues of test fairness are more political than psychometric in nature.
B) Using certain psychological tests with people of some cultural backgrounds can be controversial.
C) The same test can be fair for use with one population of testtakers, and not fair for use with another population of testtakers.
D) Most major test developers have been relatively insensitive to issues of test fairness.

Accepted Answer

The statement that most major test developers have been relatively insensitive to issues of test fairness is not true according to Chapter 4. In fact, the chapter discusses how major test developers have become increasingly aware of and responsive to issues of fairness in testing.

Question 20

Test validity refers to how
A) "true" the score is in terms of true score theory.
B) rigorous the process of norming the test was.
C) "deep" the depth of trait measurement is.
D) well a test measures what it purports to measure.

Accepted Answer

Test validity refers to how well a test measures what it purports to measure. It is not related to true score theory, norming, or depth of trait measurement.

Quiz 4: Of Tests and Testing

Factors affecting the generalizability of findings from a particular test include

A test designed to provide information about whether or not an aviator has mastered the ability to fly solo is an example of a test that is

Any influence on psychological test scores from factors other than what the test is intended to measure is referred to by measurement specialists as

When "putting tests to the test" and researching the validity of a particular instrument for a particular purpose,test users

When "putting a test to the test" and attempting to evaluate the suitability of a particular tool of measurement for a particular purpose,a test user would be well advised to consult

Test reliability refers to

A test that yields information about a testtaker's relative standing in a group is referred to as

If a controversy exists over the definition of the trait being measured by a psychological test,questions will MOST likely be raised relative to

The term norms refers to the

When "putting a test to the test" and researching published guidelines from professional associations regarding the use of a particular test for a particular objective,a test user is MOST likely to find that the guidelines recommend

An assumption inherent in classical test theory (CTT) is that

A norm group is a group of testtakers

When "putting a test to the test" and researching the reliability of a particular instrument such as the Bricklin Perceptual Scales,test users will

One scale at the deli counter of a local supermarket consistently measures everything that is placed on it exactly one ounce more than its actual weight.An assessment professional would describe this scale as

When "putting a test to the test" and debating whether or not a particular instrument should be used for a particular objective,relevant questions to be asked include

An applicant for a job with the U.S.Postal Service scores in the bottom 5% of all applicants on a test that measures the ability to sort mail.This is an example of

When "putting a test to the test" and researching the suitability of a particular test for a particular objective,test users will typically research

Based on a careful reading of the "What's a good test?" discussion in Chapter 4's Everyday Psychometrics feature,the BEST conclusion one could reasonably draw is

According to Chapter 4 of your text,which of the following statements is NOT true?

Test validity refers to how