Question 1

Nonexperimental designs ______.
A) offer very little in scientific value
B) compensate for their inability to establish external validity by establishing internal validity
C) are being used more frequently in evaluation research
D) are the second-best designs, after true experimental designs

Accepted Answer

The answer of Nonexperimental designs ______.
A) offer very little in...

Question 2

Braga et al.'s (1999) evaluation of the effectiveness of problem-oriented policing to decrease the incidence of violent street crime revealed which of the following?
A) Experimental designs are unethical to use in police work.
B) Problem-oriented policing can successfully control and prevent crime.
C) There was no relationship between problem-oriented policing and crime rates.
D) Problem-oriented policing led to an increase in crime.

Accepted Answer

Braga et al.'s (1999) study found that problem-oriented policing strategies can be effective in controlling and preventing crime, particularly violent street crime. This approach involves identifying specific problems and developing tailored strategies to address them.

Question 3

Braga et al.'s (1999) evaluation of the effectiveness of problem-oriented policing lacked which feature of experimental design?
A) mechanism
B) nonspuriousness
C) association
D) time order

Accepted Answer

Braga et al.'s (1999) evaluation did not specifically address the mechanism through which problem-oriented policing produced its effects.

Question 4

Which of the following is an accurate statement of Taylor and Woods' evaluation of conducted energy devices (CEDs)?
A) CEDs were found to reduce both officer and citizen injuries.
B) CEDs were found to reduce officer injuries.
C) CEDs were found to reduce citizen injuries.
D) CEDs were found to increase citizen injuries.

Accepted Answer

Taylor and Woods' evaluation found that Conducted Energy Devices (CEDs) were effective in reducing both officer and citizen injuries, indicating a dual benefit in terms of safety.

Question 5

In which type of research design is the experimental group studied only once after the treatment has been delivered?
A) experimental
B) quasi-experimental
C) non-experimental
D) semi-experimental

Accepted Answer

In a non-experimental research design, the experimental group is studied only once after the treatment has been delivered. This is because the researcher does not have control over the assignment of participants to the experimental and control groups.

Question 6

Which of the following is NOT a part of the simple systems model of evaluation research?
A) inputs
B) outputs
C) outcomes
D) shareholders

Accepted Answer

The simple systems model of evaluation research includes inputs, outputs, and outcomes as key components, but not shareholders. Shareholders are not a direct part of this model, which focuses on the resources used (inputs), what is produced (outputs), and the effects of the outputs (outcomes).

Question 7

All the following are instances when qualitative methods would be preferable for evaluation research EXCEPT ______.
A) when there is an interest in comparing outcomes between experimental and control groups
B) when learning how different individuals react to a treatment is important
C) when the researcher wants to understand how social programs actually operate
D) when the study is investigating program process

Accepted Answer

Qualitative methods are typically used for understanding the how and why of a phenomenon, exploring processes, and gathering in-depth insights, rather than for comparing outcomes between groups, which is more suited to quantitative methods.

Question 8

Most published evaluation studies are which type?
A) impact
B) need
C) process
D) evaluability

Accepted Answer

Impact evaluations are the most commonly published type of evaluation studies because they assess the outcomes or effects of a program, which is often of high interest to funders, policymakers, and the public.

Question 9

Goal-free evaluation is an extreme form of which type of approach?
A) social sciences
B) stakeholder
C) integrative
D) experimental

Accepted Answer

Goal-free evaluation is an extreme form of the stakeholder approach, which emphasizes the perspectives and interests of all stakeholders involved in a program or policy.

Question 10

Before proposing or conducting his study, a researcher examines the projected costs of his study on inmate rehabilitation and compares them against expected program effectiveness. He is conducting a prestudy ______.
A) efficiency analysis
B) cost-benefit analysis
C) cost-effectiveness analysis
D) micromanagement analysis

Accepted Answer

The answer of Before proposing or conducting his study, a...

Question 11

All the following are accurate statements about evaluability assessment EXCEPT which of the following?
A) Qualitative methods are commonly used.
B) Evaluability assessment makes a preliminary determination of whether the program can be assessed.
C) Evaluability assessment is used to determine if the program is cost-effective.
D) Alienated staff may be distrustful of assessment.

Accepted Answer

Evaluability assessment is primarily focused on determining whether a program's objectives and outcomes can be effectively evaluated, rather than directly assessing its cost-effectiveness. Cost-effectiveness is a separate aspect that might be evaluated after determining a program is evaluable.

Question 12

Which of the following programs would be appropriate for evaluation research?
A) welfare programs
B) criminal justice programs
C) employment programs
D) all of these

Accepted Answer

Evaluation research is designed to assess the effectiveness of programs, policies, or interventions. Welfare programs, criminal justice programs, and employment programs are all areas where evaluation research can be applied to determine their impact and effectiveness, making all of these appropriate subjects for such research.

Question 13

In what era did scientific methods emerge as it relates to examining the workings of government with the goal of improving society?
A) 1700s
B) 1850s
C) 1900s
D) 1950s

Accepted Answer

The answer of In what era did scientific methods emerge...

Question 14

Which of the following constituents are considered as practitioners?
A) government officials
B) corporations
C) non-profit agencies
D) all of these

Accepted Answer

All of the listed entities—government officials, corporations, and non-profit agencies—can be considered practitioners in their respective fields.

Question 15

What are clients, customers, or students referred to in evaluation research?
A) inputs
B) outcomes
C) outputs
D) none of these

Accepted Answer

The answer of What are clients, customers, or students referred...

Question 16

Which of the following could be considered as possible outcomes in evaluation research?
A) improved test scores
B) higher rates of job retention
C) fewer criminal offenses
D) all of these

Accepted Answer

All of the options listed (improved test scores, higher rates of job retention, and fewer criminal offenses) can be considered as possible outcomes in evaluation research. Evaluation research aims to assess the effectiveness of programs, policies, or interventions, and these outcomes are relevant indicators of success in various contexts.

Question 17

What are clients served, case managers trained, or food parcels received referred to in evaluation research?
A) inputs
B) outcomes
C) outputs
D) none of these

Accepted Answer

Outputs in evaluation research refer to the direct products or services resulting from program activities, such as clients served, case managers trained, or food parcels received.

Question 18

What type of assessment is appropriate to determine if a new program should be implemented?
A) risk assessment
B) needs assessment
C) evaluability assessment
D) none of these

Accepted Answer

A needs assessment is used to determine if there is a need for a new program and if it should be implemented.

Question 19

What type of assessment is appropriate to determine if a change should be made in program operations?
A) risk assessment
B) needs assessment
C) evaluability assessment
D) none of these

Accepted Answer

An evaluability assessment is used to determine if a program is ready for evaluation and if changes should be made in program operations to improve effectiveness.

Question 20

What type of assessment is appropriate to determine if a study to identify the effects of a particular program may or may not be possible within the available time and resources?
A) risk assessment
B) needs assessment
C) evaluability assessment
D) none of these

Accepted Answer

Evaluability assessment is used to determine whether a program or project can be evaluated effectively within the available time and resources, making it the appropriate choice for this scenario.

Quiz 12: Evaluation and Policy Analysis

Nonexperimental designs ______.

Braga et al.'s (1999) evaluation of the effectiveness of problem-oriented policing to decrease the incidence of violent street crime revealed which of the following?

Braga et al.'s (1999) evaluation of the effectiveness of problem-oriented policing lacked which feature of experimental design?

Which of the following is an accurate statement of Taylor and Woods' evaluation of conducted energy devices (CEDs) ?

In which type of research design is the experimental group studied only once after the treatment has been delivered?

Which of the following is NOT a part of the simple systems model of evaluation research?

All the following are instances when qualitative methods would be preferable for evaluation research EXCEPT ______.

Most published evaluation studies are which type?

Goal-free evaluation is an extreme form of which type of approach?

Before proposing or conducting his study, a researcher examines the projected costs of his study on inmate rehabilitation and compares them against expected program effectiveness. He is conducting a prestudy ______.

All the following are accurate statements about evaluability assessment EXCEPT which of the following?

Which of the following programs would be appropriate for evaluation research?

In what era did scientific methods emerge as it relates to examining the workings of government with the goal of improving society?

Which of the following constituents are considered as practitioners?

What are clients, customers, or students referred to in evaluation research?

Which of the following could be considered as possible outcomes in evaluation research?

What are clients served, case managers trained, or food parcels received referred to in evaluation research?

What type of assessment is appropriate to determine if a new program should be implemented?

What type of assessment is appropriate to determine if a change should be made in program operations?

What type of assessment is appropriate to determine if a study to identify the effects of a particular program may or may not be possible within the available time and resources?