Question 1

When individuals in one group of a nonequivalent control group design experience natural changes at a faster rate than individuals in the other group,there is danger of a threat to internal validity called

Accepted Answer

When individuals in one group of a nonequivalent control group design experience natural changes at a faster rate than individuals in the other group, it can lead to a threat to internal validity called the additive effects of selection and maturation. This occurs when there are differences in the maturation rates and/or developmental stages between the two groups, which can affect the outcomes being measured.

Question 2

When two groups in a nonequivalent control group design do not differ on the pretest,the researcher can conclude that

Accepted Answer

The fact that two groups do not differ on the pretest suggests they are equivalent at that point in time on the specific dependent variable measured. It does not guarantee equivalence on all possible variables or future growth rates.

Question 3

After implementing a program to improve admitting procedures in a hospital emergency room,a researcher seeks to determine whether the program is being implemented as proposed.Which research method will best serve this purpose?

Accepted Answer

The observational method involves observing and recording the behavior of individuals in a natural setting. Thus, it would be the best method to use to determine if the program is being implemented as proposed in the hospital emergency room, as the researcher could observe the behaviors and procedures of the hospital staff during admissions. The survey method is not appropriate for this purpose, as it involves asking individuals about their attitudes or behaviors, but does not necessarily provide direct observation. Experimental and quasi-experimental designs involve interventions and comparisons between groups, which are not necessary in this case where the focus is on observation of current behaviors.

Question 4

The effect of a treatment in a simple interrupted time-series design is best indicated by

Accepted Answer

In a simple interrupted time-series design, the effect of a treatment is best indicated by a clear discontinuity (abrupt increase or decrease) in the dependent variable at the point the treatment is administered. This suggests that the treatment had an immediate impact on the outcome being measured. It is important to establish a stable baseline trend before the treatment and to have multiple data points after the treatment to ensure that the observed change is not due to other factors. A gradual change (D) may also indicate an effect, but it is less clear and may be confounded by other factors. Increasing (A) or decreasing (B) trends may indicate overall changes in the outcome but do not necessarily reflect the effect of the treatment specifically.

Question 5

A psychologist tests the effect of an incentive program (i.e.,positive reinforcement for desired behavior)in a residential treatment facility for delinquent youth.He randomly assigns one building of the large facility to receive the treatment.Residents in a second building serve as a control group.During the course of the one-month study,an event happens in the treatment group that forces full lockdown of the building for one week.The threat to internal validity the psychologist must consider is

Accepted Answer

The answer of A psychologist tests the effect of an...

Question 6

A study using a simple interrupted time-series design examined people's responses to the September 11,2001 terrorist attacks using a questionnaire measure of religion and faith.Archival data were available for the population four months before and after the attacks.The researchers observed that people's religious feelings and faith increased in the months following the attacks.One threat to internal validity that should be considered in this study is

Accepted Answer

Seasonal variation could potentially explain changes in religious feelings and faith, as people's attitudes and behaviors can fluctuate with the seasons, independent of the event being studied. This variation could confound the results, making it a threat to the study's internal validity.

Question 7

Researchers analyzed records of hospitalization for heart disease in two Ohio cities,Bowling Green and Kent.A city ordinance enacted in Bowling Green banned smoking in public areas.Results indicated that hospitalization rates for the two cities were similar before the smoking ban,but hospitalization rates decreased in Bowling Green compared to Kent following the smoking ban.A potential threat to internal validity that will need to be ruled out is

Accepted Answer

This potential threat to internal validity refers to the possibility that the smoking ban may have influenced doctors in Bowling Green to be more vigilant in detecting and treating symptoms of heart disease, leading to an apparent decrease in hospitalization rates. This could create a spurious relationship between the smoking ban and the reduced hospitalization rates, and therefore needs to be ruled out as a potential confound. The other potential threats (amount of information about heart disease presented in national media and changes in state sales tax on cigarettes) are not directly related to the smoking ban and are therefore not as likely to affect the results.

Question 8

The relationship between basic research and applied research can best be described as

Accepted Answer

Basic research and applied research have a reciprocal (or circular) relationship, where basic research provides the theoretical foundation and understanding for applied research, and findings from applied research can inform future basic research questions. This relationship is not independent, hierarchical, or top-down.

Question 9

Even when pretest scores are the same,on average,for treatment and comparison groups in a nonequivalent control group design,the two groups may not be equivalent because

Accepted Answer

Equivalence on a single pretest measure does not guarantee equivalence on other relevant characteristics. Other factors such as demographic characteristics, prior experiences, and motivation may affect the groups differently, even if their pretest scores are the same. Therefore, it is important to consider other sources of potential bias and use methods such as randomization or matching to increase the likelihood of equivalence between groups.

Question 10

Program evaluation is a hybrid discipline whose professional activity

Accepted Answer

Program evaluation focuses primarily on providing feedback to providers of human service activities. This feedback helps improve the delivery of services and achieve better outcomes for clients. While program evaluation may utilize experimental methods and draw on research from various disciplines, its primary focus is on practical applications and real-world results.

Question 11

Program evaluation represents perhaps the extreme case of

Accepted Answer

Program evaluation involves the systematic collection and analysis of data to inform decision making about the effectiveness and value of a program or intervention. It is a form of applied research that focuses on evaluating the impact and outcomes of specific programs or policies, and involves the use of a variety of research methods and designs to gather and analyze data. While theory development and experimental control may be part of the evaluation process, they are not the primary focus, and program evaluation is generally less concerned with basic research than with practical questions about program effectiveness and impact.

Question 12

A clinical psychologist examined the effect of a treatment designed to reduce the amount of cigarette smoking in the day room of an inpatient psychiatric facility.His treatment consisted of a several components to maximize its potential effectiveness (e.g.,increasing the number of available activities; giving patients responsibility for care of the unit's plants,fish,etc.; the opportunity to exchange cigarettes for positive reinforcers).At the end of three months,his data indicated that cigarette smoking had declined significantly.Based on this,he is able to conclude that

Accepted Answer

The psychologist can conclude that the treatment as a whole was effective in reducing smoking, but cannot determine from this data whether any single component was effective on its own or if all components are necessary for the effect.

Question 13

The major threat to internal validity in the simple interrupted time series design is

Accepted Answer

The major threat to internal validity in the simple interrupted time series design is history, which refers to any event or occurrence that takes place during the study period other than the intervention itself that may affect the outcome being measured. Other threats to internal validity, such as maturation and selection, are less likely to be an issue in this design because the comparison is made within the same group over time. The additive effect of selection and history may also affect internal validity, but it is not the major threat in this design.

Question 14

If the residents,staff,and facilities of a nursing home where a quasi-experiment was done are likely to be different from those in other nursing homes,the ______________ of the findings may be questioned.

Accepted Answer

External validity refers to the generalizability of research findings to other settings or populations. If the residents, staff, and facilities of a nursing home in a quasi-experiment are different from those in other nursing homes, then the external validity of the findings may be questioned because it may not be possible to generalize the results to other nursing homes or populations. Internal validity, on the other hand, refers to the degree to which the study's design and methods minimize the risk of biased results. Statistical significance refers to the probability that the results are due to chance, and novelty refers to the originality or uniqueness of the findings.

Question 15

Social policy research (such as the research done by Ellen Langer on mindfulness and the effects of living in a nursing home)serves the purpose(s)of

Accepted Answer

Social policy research serves the dual purpose of advancing scientific theory and knowledge and informing policy decisions. Ellen Langer's research on mindfulness and the effects of living in a nursing home, for example, not only contributes to our understanding of the impact of mindfulness but also has implications for policy decisions related to the care of elderly individuals in nursing homes.

Question 16

Which of the following is not one of the four questions addressed in program evaluation?

Accepted Answer

The four questions addressed in program evaluation are assessment of needs, evaluation of process, evaluation of outcome, and cost efficiency. Decision making efficiency is not typically considered one of the main questions addressed in program evaluation.

Question 17

A human services agency was interested in finding out whether establishing a food distribution center in their community would provide a service the community would use.Which of the following types of assessments in program evaluation would this agency find useful for this question?

Accepted Answer

An assessment of needs would be the most useful type of assessment for the agency to determine if a food distribution center would be useful to the community. This type of assessment would involve analyzing the community's current food resources and identifying any gaps or areas of need. It would also involve gathering information from community members themselves to determine their preferences and needs regarding food access. Evaluating the process, outcome or efficiency of a food distribution center would come later in the program evaluation once it had already been established.

Question 18

Among the following research designs,which allows researchers to rule out the most threats to internal validity?

Accepted Answer

The time series design with nonequivalent control group allows researchers to rule out the most threats to internal validity because it includes multiple measurements over time, a control group for comparison, and the ability to track any changes in both the treatment group and control group. This design also addresses selection biases and other confounding variables that can affect the results of the study.

Question 19

Strong evidence of a treatment effect in a time series with nonequivalent control group design is indicated by

Accepted Answer

Discontinuity in the treatment group but not in the comparison group indicates a strong treatment effect. This is because the treatment group was exposed to the treatment, which caused a discontinuity or change in the time series data. However, the comparison group did not receive the treatment and did not experience a discontinuity, indicating that the treatment is likely responsible for the observed changes in the treatment group. Discontinuity in both groups could indicate other confounding factors contributing to the observed changes in the time series, and no discontinuity in either group would indicate no treatment effect.

Question 20

A researcher was asked to evaluate the outcome of a program implemented to enhance recycling in a community.Which method will the researcher likely select to answer the question of whether the program was effective?

Accepted Answer

The most appropriate design to evaluate the effectiveness of a program is the time series with nonequivalent control group design. This design compares the outcomes of the program before and after its implementation and also compares the outcomes of the program with a group that did not receive the program. This allows the researcher to isolate the effects of the program from other factors that could have influenced the outcome.

Quiz 10: Quasi-Experimental Designs and Program Evaluation