Question 1

"It's a method of setting cut scores that relies heavily on judgments made by experts." Which of the following is BEST described by this statement?

Accepted Answer

The statement refers to the Angoff method, which involves experts making judgments about the difficulty of test items and the performance expected of minimally competent candidates in order to set cut scores. The other options listed do not involve expert judgment to the same extent.

Question 2

Using the Angoff method as applied to personnel selection,____________ are used to estimate the proportion of minimally competent people for the position of interest.

Accepted Answer

The Angoff method is a widely used method in personnel selection to estimate the difficulty level of a test and set the cut score. In this method, a panel of experts is asked to estimate the proportion of minimally competent individuals who would pass the test. Therefore, known experts (choice C) are the best choice for this question. Focus groups (choice A) and disinterested bystanders (choice D) are not appropriate for this task, as they may not have the necessary expertise to evaluate the job requirements and the test content. Known groups (choice B) are not relevant to this question, as they refer to a method of validating a test score using an external criterion.

Question 3

__________ are used by organizations in order to assess the savings associated with different decisions.

Accepted Answer

Utility analyses are used to assess the value or worth of different alternatives or decisions by quantifying their expected outcomes and associated costs. This approach can help organizations compare the expected savings or benefits of different decisions and choose the most cost-effective option. Focus groups are used to gather qualitative data and opinions from a selected group of individuals, while discriminant analyses are statistical techniques used to classify observations into different groups or categories. Taylor-Naylor-Fayva tables are not a commonly recognized concept in organizational decision-making.

Question 4

"An empirical standard used to divide a group of data into two or more distinct categories" is a formal description of a

Accepted Answer

A cut score is a threshold point used to divide a group of data into two or more categories. This is commonly used in educational assessments, where a cut score is used to differentiate students who pass or fail a test. It can also be used in other fields, such as pre-employment tests, to determine whether a candidate is qualified for a job.

Question 5

Which of the following is included in the calculation of a miss rate?

Accepted Answer

False positives are included in the calculation of a miss rate, as they represent instances where a test incorrectly identifies a condition as present.

Question 6

If criterion-related validity is .40,and the base rate is .60,the false positive rate is likely to be highest if the selection ratio is:

Accepted Answer

The false positive rate is likely to be highest when the selection ratio is high (in this case, .95), because a higher selection ratio means a larger proportion of applicants are selected, increasing the chance of selecting individuals who do not actually meet the criteria (false positives), especially when the criterion-related validity is not very high (.40) and the base rate is moderate (.60).

Question 7

Grethela scores very high on a graduate school admission test and is admitted to graduate school,largely on the basis of that test score.But Grethela subsequently flunks out.In retrospect,Grethela's score on the admission test is BEST viewed as a

Accepted Answer

A false positive is a type of error in which a test result is given as positive when the true result is negative. In this case, Grethela's high score on the admission test was not an accurate predictor of her success in graduate school, making the admission decision a false positive.

Question 8

In the context of utility,the hit rate is equivalent to

Accepted Answer

The hit rate represents the number of correct classifications divided by the total number of classifications, providing a measure of the accuracy of the utility prediction or decision-making process. This metric is used, for example, in evaluating the validity or usefulness of a personnel selection test, where the goal is to maximize the number of successful hires (i.e., hit) and minimize the number of unsuccessful hires (i.e., miss).

Question 9

A test's ____________ rate is equal to the proportion of people a test accurately identifies as possessing or not possessing a particular trait,behavior,characteristic,or attribute.

Accepted Answer

The hit rate of a test is the proportion of people correctly identified as having or not having a particular trait, behavior, characteristic, or attribute. This reflects the accuracy of the test in identifying the condition being tested for. The other options (A) miss, (B) base, and (D) success are not directly related to the accuracy of the test in identifying the condition being tested for.

Question 10

If scores on a test are attributed with great utility,then it's MOST probably the case that the scores are

Accepted Answer

Utility refers to how useful or beneficial the scores are. A score can only be considered useful if it is both reliable (consistent) and valid (measuring what it is supposed to measure). Therefore, if scores on a test are attributed with great utility, it suggests that the test is both reliable and valid.

Question 11

Which of the following is synonymous with the term "utility" as used in Chapter 7 of your text?

Accepted Answer

In Chapter 7 of the text, "utility" is defined as the usefulness or practicality of an ethical decision or action. Therefore, choice C, usefulness, is synonymous with utility. Consistency, truthfulness, and accuracy are related to ethical principles in different ways, but they do not directly correspond to the concept of utility as defined in this chapter.

Question 12

Which term BEST describes the ratio of the benefits of testing compared to the costs of testing?

Accepted Answer

The term "return on investment" (ROI) best describes the ratio of benefits to costs of testing. ROI is a financial metric used to calculate the return or profit earned as a percentage of the investment made. Similarly, the ratio of benefits to costs of testing can be calculated using ROI to determine whether the investment in testing is worth the effort.

Question 13

A method of utility analysis method that can yield utility information in either monetary or non-monetary terms is the:

Accepted Answer

The Brogden-Cronbach-Gleser formula is a method of utility analysis that can provide utility information in both monetary and non-monetary terms, allowing for a comprehensive evaluation of the utility of a selection procedure.

Question 14

Mahalia applies for a job at a company called "The Denver Recreational Marijuana Factory" (DRMF).DRMF routinely administers a drug test to prospective employees to screen-out drug users.Despite the fact that Mahalia smokes marijuana almost daily,the company's test report indicates that she is drug-free.Mahalia is hired.In this case,the BEST conclusion is that

Accepted Answer

A false negative was reported, meaning that Mahalia's drug use was not detected by the drug test. It is possible that she either stopped using marijuana for a period of time before the test or used a product to mask the presence of THC in her system. It is also possible that the drug test was not sensitive enough to detect the levels of THC in her system. However, it is not necessarily the case that the DRMF drug testing is only for appearances or that the personnel director needs to be drug tested.

Question 15

Costs associated with psychological or other testing typically include all of the following EXCEPT

Accepted Answer

The costs associated with psychological or other testing typically include administrator time, use of test facility, and the test administrator's time. However, return on investment is not a direct cost associated with testing, but rather a measure of the benefits that may result from the testing.

Question 16

When minimum levels of several competencies are required,which of the following selection strategies is BEST?

Accepted Answer

Multiple hurdle with fixed cut scores is the best option when minimum levels of several competencies are required. This strategy uses a series of cut-off scores at each stage of the selection process, with only those who meet the minimum requirement advancing to the next stage. This allows for a more focused evaluation of each competency and ensures that only candidates who meet all minimum requirements are considered for the position.

Question 17

In the context of utility considerations,a direct relationship exists between a cut score and the

Accepted Answer

A cut score is directly related to the selection ratio, as the selection ratio determines the proportion of candidates who will be selected based on the test scores. The higher the selection ratio, the more candidates will be selected, and therefore the lower the cut score needed to select them. Conversely, the lower the selection ratio, the fewer candidates will be selected, and therefore the higher the cut score needed to select them. The base rate does not have a direct relationship with the cut score, although it can affect the sensitivity and specificity of the test. The utility of the test being evaluated is affected by several factors, including the cut score, base rate, and selection ratio, but it is not directly related to the cut score alone.

Question 18

_________ refers to a family of techniques that provides information about the costs and benefits of testing.

Accepted Answer

Utility analysis is a family of techniques that measures the costs and benefits of a test or testing program. It involves analyzing the costs and potential benefits of testing, such as increased productivity or reduced turnover. The results of this analysis can be used to make informed decisions about testing programs and to determine whether the benefits outweigh the costs. The other options listed (item response theory, compensatory models of selection, and conjoint analysis) are all different techniques or approaches that are not directly related to the costs and benefits of testing.

Question 19

"Multiple predictors may be used so that applicants must meet or exceed the cut score for each predictor before moving to the next round of the selection process." This BEST describes which of the following processes?

Accepted Answer

Multiple hurdle selection involves using multiple predictors, and applicants must meet or exceed the minimum cut score for each predictor before moving on to the next stage of the selection process.

Question 20

What follows are the selection ratios from four different undergraduate programs.Which of these reflects the most selective program?

Accepted Answer

A selection ratio of 0.03 indicates that only 3% of applicants are admitted, making it the most selective program compared to the higher ratios in the other options.

Quiz 7: Utility