Question 1

Taking a Broader Perspective: The Problem of External Validity Harris and Rosenthal (1985) combined the results of several studies of the Rosenthal effect and found that it was strong and consistent in experiments testing the effects of teacher expectancies.Which technique did they use?
A)meta-analysis
B)multivariate analysis
C)power analysis
D)regression analysis

Accepted Answer

Harris and Rosenthal used meta-analysis to combine and analyze the results of several studies of the Rosenthal effect.

Question 2

Taking a Broader Perspective: The Problem of External Validity Researchers pool data and base their conclusions on group averages in
A)aggregation over measures.
B)aggregation over stimuli.
C)aggregation over subjects.
D)aggregation over trials.

Accepted Answer

Aggregation over subjects is the most applicable option in this case. This is because researchers pool data from different individuals or subjects, and base their conclusions on group averages. Aggregation over measures refers to combining data from different measures, while aggregation over stimuli involves pooling data from different stimuli. Aggregation over trials involves combining data from different trials or repeated measurements. Hence, the most appropriate option is C, aggregation over subjects.

Question 3

Taking a Broader Perspective: The Problem of External Validity We can increase the external validity of our data and broaden the scope of experimental findings by grouping together and averaging data.Epstein (1980) called this process
A)aggregation.
B)field experimentation.
C)multivariate analysis.
D)unobtrusive measurement.

Accepted Answer

Epstein (1980) called the process of increasing external validity by grouping together and averaging data as aggregation. Field experimentation refers to conducting experiments in natural settings, multivariate analysis is a statistical technique, and unobtrusive measurement refers to collecting data without interfering with the subjects or their environment.

Question 4

Taking a Broader Perspective: The Problem of External Validity Moira studies helpfulness during holidays and other times of the year to control the effects of seasonal factors.This procedure represents
A)aggregation over measures.
B)aggregation over occasions.
C)aggregation over stimuli.
D)aggregation over subjects.

Accepted Answer

Aggregation over occasions refers to taking into account multiple instances or occasions over time when making conclusions about a phenomenon. By studying helpfulness during holidays and other times of the year, Moira is taking a broader perspective and controlling for the effects of seasonal factors, which improves the external validity of her findings beyond just the specific time or occasion being studied. Aggregation over measures refers to combining different measures within a study, aggregation over stimuli refers to combining different stimuli or situations within a study, and aggregation over subjects refers to combining data from different participants within a study.

Question 5

Taking a Broader Perspective: The Problem of External Validity Researchers use induction in all these examples except
A)constructing theories from a series of experiments.
B)developing general principles from specific findings.
C)formulating research hypotheses.
D)predicting specific findings from a research hypothesis.

Accepted Answer

Induction involves moving from specific observations to broader generalizations and theories. Predicting specific findings from a research hypothesis (D) is an example of deduction, not induction, because it involves applying general principles to predict specific outcomes.

Question 6

Taking a Broader Perspective: The Problem of External Validity Which reasoning process do researchers require to extend experimental findings to broader principles and implications?
A)aggregation
B)deduction
C)induction
D)intuition

Accepted Answer

Researchers require the process of induction to extend experimental findings to broader principles and implications. Induction involves using specific observations or data to come up with general conclusions. It is the opposite of deduction, where general principles are used to come up with specific conclusions. Aggregation involves combining data from multiple sources or individuals, but does not necessarily involve extending findings to broader principles. Intuition is not a formal reasoning process and is not consistently reliable.

Question 7

Taking a Broader Perspective: The Problem of External Validity We must be cautious when drawing conclusions about concepts like "learning" from experimental results because
A)different operational definitions may lead to diverse outcomes.
B)experimenters can only study variables they can directly observe.
C)experimenters cannot operationally define concepts like learning.
D)statistically significant results may be due to Type 2 error.

Accepted Answer

Different operational definitions of "learning" may lead to different outcomes, which can limit the external validity of experimental results. This means that the conclusions drawn from the experiment may not apply to real-world situations or other populations. Therefore, it is important to consider external validity when interpreting experimental results.

Question 8

Taking a Broader Perspective: The Problem of External Validity All of these factors affect the degree to which we can generalize from the results of an experiment except
A)how we measured the dependent variable.
B)how we selected subjects.
C)subject demographics.
D)the significance level we chose to evaluate our findings.

Accepted Answer

The significance level we chose to evaluate our findings does not affect the degree to which we can generalize from the results of an experiment. Factors such as how we measured the dependent variable, how we selected subjects, and subject demographics all have an impact on external validity.

Question 9

Taking a Broader Perspective: The Problem of External Validity Jeffrey administers a depression inventory and social activity journal to offset the errors that could result from using a single incomplete assessment instrument.This strategy is called
A)aggregation over measures.
B)aggregation over situations.
C)aggregation over stimuli.
D)aggregation over trials.

Accepted Answer

Aggregation over measures involves using multiple assessment tools to gain a more comprehensive understanding of a phenomenon, in this case, depression and social activity, to offset the limitations of using just one instrument.

Question 10

Taking a Broader Perspective: The Problem of External Validity We might increase the external validity of an experiment on color matching that only uses 20 out of 7500 different colors by using
A)aggregation over measures.
B)aggregation over situations.
C)aggregation over stimuli.
D)aggregation over trials.

Accepted Answer

Aggregation over stimuli would involve using a larger and more diverse set of colors in the experiment, which would increase the generalizability and external validity of the results to real-world color matching situations. Aggregation over measures, situations, or trials would not address the issue of limited stimuli in the experiment.

Question 11

Taking a Broader Perspective: The Problem of External Validity A researcher studying the use of condoms to prevent sexually transmitted disease (STD) combines data from heterosexual and homosexual couples to increase the study's external validity.This pooling of data illustrates
A)aggregation over measures.
B)aggregation over situations.
C)aggregation over subjects.
D)aggregation over trials.

Accepted Answer

Aggregation over subjects refers to combining data from different groups of participants to enhance the generalizability of the findings. In this case, by including both heterosexual and homosexual couples, the researcher is aggregating over different subject groups to increase the external validity of the study.

Question 12

Taking a Broader Perspective: The Problem of External Validity A researcher studying public displays of affection by dating couples observes this behavior in shopping malls, airports, and supermarkets.This illustrates the technique of
A)aggregation over measures.
B)aggregation over situations.
C)aggregation over subjects.
D)aggregation over trials.

Accepted Answer

Aggregation over situations refers to observing behavior across different contexts or settings, which is what the researcher is doing by observing public displays of affection in shopping malls, airports, and supermarkets. The other choices (aggregation over measures, subjects, and trials) do not fit the scenario described in the question.

Question 13

Taking a Broader Perspective: The Problem of External Validity External validity means the extent to which experimental findings can be extended to different
A)procedures.
B)situations.
C)subjects.
D)all of these

Accepted Answer

External validity refers to the extent to which experimental findings can be extended to different procedures, situations, and subjects. Therefore, the best choice is D, all of these.

Question 14

Taking a Broader Perspective: The Problem of External Validity Which of these is a concept as opposed to a specific operational definition?
A)learning
B)percentage of correct responses
C)response latency
D)total number of errors

Accepted Answer

Learning is a broader concept that can be operationalized in different ways, whereas the other choices are specific operational definitions of a particular behavior or outcome.

Question 15

Taking a Broader Perspective: The Problem of External Validity Researchers can determine whether experimental findings extend to different groups of subjects by using ____ across several studies.
A)aggregation over situations
B)aggregation over subjects
C)block randomization
D)within-subject designs

Accepted Answer

Aggregation over subjects involves combining data from different groups of subjects across several studies to determine if experimental findings are consistent and can be generalized. This method helps in assessing the external validity of the findings by showing whether they apply to a broader population beyond the specific subjects in the initial experiments.

Question 16

Taking a Broader Perspective: The Problem of External Validity Karen performed a large N experiment and based her conclusions on group averages.Which aggregation technique did she use?
A)aggregation over measures
B)aggregation over stimuli
C)aggregation over subjects
D)aggregation over trials

Accepted Answer

Aggregation over subjects refers to calculating group averages based on individual participants' responses. This is the most likely aggregation technique used in Karen's experiment, as she based her conclusions on group averages. Aggregation over measures refers to combining data from multiple measures of the same construct, aggregation over stimuli refers to combining data from multiple presentations of the same stimulus, and aggregation over trials refers to combining data from multiple trials of the same task. While it's possible that Karen used one or more of these aggregation techniques in her experiment, none of them are explicitly mentioned in the question stem.

Question 17

Taking a Broader Perspective: The Problem of External Validity ____ describes the consistency of an effect across past studies and estimates average effect sizes.
A)Meta-analysis
B)Multivariate analysis
C)Power analysis
D)Regression analysis

Accepted Answer

Meta-analysis is a statistical technique that combines the results of multiple studies to establish the consistency of an effect across past studies and estimate the average effect size. This is important in addressing the problem of external validity, which refers to the generalizability of research findings to other populations and settings beyond the ones studied. By synthesizing the results of multiple studies, meta-analysis can provide a more comprehensive and accurate picture of the magnitude and robustness of an effect, which can enhance the external validity of research findings.

Question 18

Taking a Broader Perspective: The Problem of External Validity Manufacturers often test new products like shampoo on laboratory animals and then generalize their results to humans because
A)human testing may be unethical due to the risk of injury.
B)it is easier to replicate animal studies than human studies.
C)it is often difficult to obtain human volunteers to test personal care products.
D)laboratory animals and humans often show identical allergic reactions.

Accepted Answer

Human testing may be unethical due to the risk of injury, which is why manufacturers often start with laboratory animals to test new products like shampoo before considering human trials. This approach helps in assessing safety without directly exposing humans to potential harm.

Question 19

Taking a Broader Perspective: The Problem of External Validity When we evaluate research results for their consistency with prior studies, the extent to which they extend our knowledge, or their implications for broader theoretical issues, we are addressing their
A)external validity.
B)internal validity.
C)research significance.
D)statistical conclusion validity.

Accepted Answer

The answer of Taking a Broader Perspective: The Problem of...

Question 20

Taking a Broader Perspective: The Problem of External Validity Researchers use aggregation over ____ to compensate for errors that may result from using an inadequate assessment instrument.
A)measures
B)situations
C)stimuli
D)trials

Accepted Answer

Aggregation over measures refers to combining multiple measures or assessments to increase the reliability of the data and compensate for any errors that may have arisen from using an inadequate assessment instrument.

Quiz 15: Drawing Conclusions: the Search for the Elusive Bottom Line

Taking a Broader Perspective: The Problem of External Validity Harris and Rosenthal (1985) combined the results of several studies of the Rosenthal effect and found that it was strong and consistent in experiments testing the effects of teacher expectancies.Which technique did they use?

Taking a Broader Perspective: The Problem of External Validity Researchers pool data and base their conclusions on group averages in

Taking a Broader Perspective: The Problem of External Validity We can increase the external validity of our data and broaden the scope of experimental findings by grouping together and averaging data.Epstein (1980) called this process

Taking a Broader Perspective: The Problem of External Validity Moira studies helpfulness during holidays and other times of the year to control the effects of seasonal factors.This procedure represents

Taking a Broader Perspective: The Problem of External Validity Researchers use induction in all these examples except

Taking a Broader Perspective: The Problem of External Validity Which reasoning process do researchers require to extend experimental findings to broader principles and implications?

Taking a Broader Perspective: The Problem of External Validity We must be cautious when drawing conclusions about concepts like "learning" from experimental results because

Taking a Broader Perspective: The Problem of External Validity All of these factors affect the degree to which we can generalize from the results of an experiment except

Taking a Broader Perspective: The Problem of External Validity Jeffrey administers a depression inventory and social activity journal to offset the errors that could result from using a single incomplete assessment instrument.This strategy is called

Taking a Broader Perspective: The Problem of External Validity We might increase the external validity of an experiment on color matching that only uses 20 out of 7500 different colors by using

Taking a Broader Perspective: The Problem of External Validity A researcher studying the use of condoms to prevent sexually transmitted disease (STD) combines data from heterosexual and homosexual couples to increase the study's external validity.This pooling of data illustrates

Taking a Broader Perspective: The Problem of External Validity A researcher studying public displays of affection by dating couples observes this behavior in shopping malls, airports, and supermarkets.This illustrates the technique of

Taking a Broader Perspective: The Problem of External Validity External validity means the extent to which experimental findings can be extended to different

Taking a Broader Perspective: The Problem of External Validity Which of these is a concept as opposed to a specific operational definition?

Taking a Broader Perspective: The Problem of External Validity Researchers can determine whether experimental findings extend to different groups of subjects by using ____ across several studies.

Taking a Broader Perspective: The Problem of External Validity Karen performed a large N experiment and based her conclusions on group averages.Which aggregation technique did she use?

Taking a Broader Perspective: The Problem of External Validity ____ describes the consistency of an effect across past studies and estimates average effect sizes.

Taking a Broader Perspective: The Problem of External Validity Manufacturers often test new products like shampoo on laboratory animals and then generalize their results to humans because

Taking a Broader Perspective: The Problem of External Validity When we evaluate research results for their consistency with prior studies, the extent to which they extend our knowledge, or their implications for broader theoretical issues, we are addressing their

Taking a Broader Perspective: The Problem of External Validity Researchers use aggregation over ____ to compensate for errors that may result from using an inadequate assessment instrument.