Deck 21: Interpreting and Reporting Results of Quantitative Research

Question 1

While conducting quantitative research, one should

A) note interesting variables and build them into the study so that the results reflect the entire situation.
B) pay attention to the influence the independent variables have on the dependent variable and change the dependent variable if it is not sensitive enough.
C) stick to the original plan regardless of any problems that arise.
D) None of these is true.

Answer 1

C

Question 2

Achieving statistically significant results means that the results

A) are applicable to situations similar to that of the study.
B) are what was predicted by the hypothesis of the study.
C) are unlikely to be due to chance alone.
D) All of these are true.

Answer 2

C

Question 3

Product researchers studied the relationship between their cola and a composite happiness scale.The null hypothesis was retained.They should state that

A) drinking their cola does not cause depression.
B) their cola has no relationship to the happiness of its drinkers.
C) there is not enough evidence to suggest a relationship between drinking their cola and happiness.
D) their design was not powerful enough to find a significant relationship.

Answer 3

C

Question 4

A researcher's theory that teaching the alphabet using music shortens the time to learn letters was not found to be statistically significant.The researcher should

A) redo the study using a much larger number of subjects.
B) completely rethink and rework the theory.
C) state that the results of the study were not conclusive.
D) All of these are true.

Question 5

If an unhypothesized relationship is found while conducting quantitative research, it should

A) not be reported.
B) be reported as a side note to the findings of the original hypothesis.
C) be substituted for the original hypothesis if it is statistically significant enough.
D) None of these are true.

Question 6

According to the text, once a quantitative experiment is put into motion

A) it must be run exactly as planned.
B) subjects should be shifted from one group to another whenever necessary to establish group equivalence.
C) independent variables that seem to be having little or no effect should be eliminated.
D) the research hypothesis should be reexamined.

Question 7

A hands-on approach to training aviation mechanics has been shown to be more effective and less costly than the previous simulation training.The results are unlikely to be a function of chance.This study might be said to have

A) practical significance.
B) statistical significance.
C) both practical and statistical significance.
D) None of these is true.

Question 8

When the results of a study are opposite of what was hypothesized, one should

A) question the reliability and validity of the instruments used to measure the dependent variable.
B) report the flaws in the methodology and design that caused the opposite results.
C) report the opposite results.
D) All of these are true.

Question 9

A researcher finds no relationship between building paper-mache volcanoes and knowledge about volcanoes.The researcher should state that

A) there is no relationship between building paper-mache volcanoes and knowledge about volcanoes.
B) the evidence is not sufficient to say there is a relationship between building paper mache volcanoes and knowledge about volcanoes.
C) there is probably a relationship between building paper-mache volcanoes and knowledge about volcanoes, but it can't be demonstrated at this time.
D) Any of these are true.

Question 10

If researchers find negative results, they should

A) redesign the study to correct for any errors.
B) report the negative outcome.
C) rethink the literature review with the unexpected outcome in mind.
D) All of these are true.

Question 11

Some researchers did not find the hypothesized relationship between children's diet and success in school.However, they discovered that mother's occupation was very important to children's success.What would you recommend to these researchers?

A) The researchers' report should mention only the lack of relationship between diet and success.
B) The researchers' report should focus on the relationship between mother's occupation and children's success.
C) The researchers' report should focus on the lack of relationship between diet and success but mention the relationship between mother's occupation and children's success.
D) The researchers should redesign the study so that relationship between both hypotheses are clearly defined and understood.

Question 12

Groups A and B were found to be significantly different on a test of spelling.Group A had been taught a new method of spelling, and Group B was the control group.Although random selection was not possible, subjects were randomly assigned to the two groups.Based on the significance of the study the research concludes that the new method will help children read quicker.The researcher

A) made an interpretation not based on the data.
B) needs to consider the limitation of sampling procedures.
C) needs to describe the characteristics of the two groups.
D) All of these are true.

Question 13

A researcher's theory that teaching the alphabet backwards shortens the time to learn letters was not found to be statistically significant.It could be that

A) this method of teaching letters is not helpful.
B) the method of teaching letters is helpful but there were problems with the design of the study.
C) the method of teaching letters is helpful but the design lacked the power to reject the false null hypothesis.
D) All of these are true.
E) None of these is true.

Question 14

The preparation for data interpretation begins

A) after the data have been collected.
B) after the statistical analysis.
C) before the data are collected.
D) during the data collection phase.

Question 15

The null hypothesis might be retained because:

A) the null hypothesis is true.
B) the alternative hypothesis is false.
C) the design was not powerful enough.
D) Any of these are true.

Question 16

Power is in part a function of

A) the homogeneity of the subjects on the independent variables.
B) how the hypothesis was stated.
C) sample size.
D) All of these are true.

Question 17

A group of researchers retained their null hypothesis.They might be able to conclude that there is no relationship among the variables of study if

A) they studied a complete population.
B) they sampled an extremely large number of subjects.
C) Both of these.
D) None of these is true.

Question 18

It is the responsibility of the researcher to

A) assume that the study is of utmost significance to the field and report the results to as many journals as possible.
B) project the interpretation of results beyond that of the study's limitations so that the reader understands the practical implications of the conclusions.
C) itemize all the reasons why the unexpected results might have occurred.
D) report any validity threats that might account for achieving the expected results.
E) All of these are true.

Question 19

A researcher found a statistically significant one point difference in mean ACT scores between students who studied on their own and those who attended a professional test-taking seminar.The researcher can conclude that

A) the means for the groups are statistically different from each other.
B) the professional training seminar produces considerably better ACT scores.
C) professional training is necessary for better ACT scores.
D) None of these is true.

Question 20

In interpreting expected results, researchers should

A) not make interpretations that go beyond the information.
B) address the limitations of the study.
C) report any internal validity problems that could account for the results.
D) All of these are true.
E) None of these is true.

Question 21

An investigator should reconsider his hypothesis when the results are contrary to what was expected.He can do this by

A) rewriting the hypothesis section in the body of the report.
B) stating in the conclusion that the original theory is wrong.
C) alerting the reader to internal validity problems in the study.
D) offering tentative explanations for the observed results in the discussion section of the study.
E) rewriting the related literature section of the report.

Question 22

If the results of a study do not agree with the hypothesis, the researcher should

A) repeat the study before reporting results.
B) report the results as legitimate findings.
C) reword the hypothesis to reflect the results.
D) abandon that particular hypothesis.

Question 23

An investigator found no significant correlation between the grades that teachers earned in education courses and the principals' ratings of those teachers.The investigator should conclude

A) principals are unable to recognize good teaching.
B) education courses have no influence on teacher performance.
C) grades in education courses are unrelated to teacher success.
D) grades in education courses are related to teacher success, but the present measuring instruments are inadequate for showing this relationship.
E) None of these is true.

Question 24

Which of the following would be the most appropriate research title?

A) An exploration of the successful interview for graduating college seniors
B) The relation of self-image and job experience to job interview success for graduating college seniors
C) The relation between successful job interviews and the interviewee's self-image and job experience
D) All of these are appropriate research titles.

Question 25

As compared with journal articles, papers prepared for presentation at professional meetings are

A) longer with more details of related research and study.
B) less likely to be geared to a particular audience.
C) more formal.
D) less formal.
E) b and c

Question 26

A null hypothesis could be retained because

A) it is false.
B) internal validity threats interfered.
C) the instruments used were too sensitive.
D) statistical power was too strong.

Question 27

Researchers found no significant relationship between color combinations in a classroom and the time on task of the students.The researchers can conclude that

A) there is no relation between the color of a classroom and students' performance.
B) they did not find the appropriate color combination for the study.
C) their measurement of time on task may have some reliability problems.
D) Any of these are true.
E) None of these is true.

Question 28

The purpose of the discussion section of a research paper is to

A) relate the findings of the study to theory and research in the area.
B) point out the implications of the results.
C) state how the findings may be applied in practice.
D) All of these are true.

Question 29

When writing a quantitative research report it is recommended that it be written

A) in a narrative, informal manner.
B) in a convincing and argumentative style.
C) in a creative and innovative format.
D) according to the prescribed format.

Question 30

The results section of a research report is different from the conclusion section of the report because the results section

A) suggests which conclusions are statistically significant, while the conclusion section reports the outcome of the original hypotheses.
B) reports the outcomes of the data analysis, while the conclusion section suggests inferences based on the results.
C) reports the significance of the conclusions, and the conclusions are predicted outcomes of the original hypotheses.
D) None of these is true-the results and conclusion sections are the same.

Question 31

Which of the following indicates the usual order of the sections in the text of a thesis or dissertation?

A) Introduction, methods, results, discussion, conclusions
B) Discussion, introduction, methods, results, conclusions
C) Introduction, results, method, conclusions, discussion
D) Introduction, discussion, methods, results, conclusions

Question 32

By reading this section of a research report, a reader should be able to judge the population external validity of that study.

A) statement of the problem
B) hypothesis
C) sampling
D) review of literature

Question 33

In a study examining the relationship between guided imagery and successful resolution of test anxiety, researchers found a significant difference on an anxiety scale between high school-aged groups who received and did not receive a guided imagery treatment.The researchers should title their report

A) "Relieving Test Anxiety Through Guided Imagery."
B) "Guided Imagery and Test Anxiety in High School."
C) "The Relationship of Guided Imagery and High School Test Anxiety."
D) Any of these is true.

Question 34

Which of the following would be the most acceptable title for a research report on the effect of alcohol use on achievement in college?

A) "A Study of the Difference Between the Grade-point Average of Alcohol Users and Abstainers in a Large Midwestern University"
B) "Alcohol and Students"
C) "The Abuse of Alcohol by Today's Students"
D) "Alcohol, the Curse of Today's Student!"
E) "Relationship Between Alcohol Consumption and Academic Achievement in College"

Question 35

When the results of a study are statistically significant, this means that the results

A) were what was predicted by the null hypothesis.
B) were surprising and did not correspond to theory.
C) have practical implications.
D) are necessarily meaningful and useful.
E) are unlikely to be due to mere chance.

Question 36

In the research paper, the discussion section serves as a way to

A) explain any shortcoming of the research methods.
B) suggest the practical implications of the findings.
C) tie the findings to the literature review.
D) All of these are true.
E) None of these is true.

Question 37

The most important criterion for judging the adequacy of the procedures section of a research report is to ask whether or not the reader could adequately

A) critique the effectiveness of the procedures.
B) predict the outcomes of the results section.
C) perform the procedures exactly as the researcher performed them.
D) All of these are true.

Question 38

After an experiment was in progress, a researcher learned that the experimental group had a more experienced teacher than did the control group.Should the researcher mention this fact in the research report?

A) Yes, any factor which might affect the internal validity of the experiment should be reported.
B) No, it is not necessary for the reader to know all the details about problems which arise during the course of a study.

Question 39

Research presentations at professional conventions

A) should be comprehensive since audience members probably don't have an adequate background.
B) are typically at least an hour long.
C) may focus on research in progress.
D) None of these is true.

Question 40

Which of the following is not necessary in the title of a research report?

A) Dependent variable
B) Independent variable
C) Operational definitions
D) Population of interest

Question 41

Which of the statements below is written in the correct format to appear in a journal article?

A) "The posttest results for the two groups are presented in the following table and the interaction is shown in the graph below."
B) "I examined the differences in responses to the attitude statements found between the two groups."
C) "During the spring semester, teachers were sent a letter explaining the nature of the study, a survey form, and a stamped return envelope."
D) "Group A will be shown a series of films designed to change their attitudes toward inclusion."

Question 42

Which statement(s) would most likely be found in the conclusion section of a research article?

A) In-service education is an effective way of changing teachers' attitudes toward the issue.
B) The group taught by Method A had a significantly higher mean score on the posttest than did the group taught by Method B.
C) Method A appears to be a more effective method of teaching math than Method B.
D) a and b
E) a and c

Question 43

A retained null hypothesis might legitimately be interpreted as a lack of relationship between variables when

A) one has studied a small population and all members have been included.
B) the researcher can show that the study is free of any internal validity problems.
C) the study had sufficient power to reject the null hypothesis with a relatively small effect size.
D) All of these are true.

Question 44

Editors expect research reports in a particular format or style because the format

A) is a convenience to the journal's readers.
B) is required by the U.S.Department of Research Standards.
C) looks more scholarly and convincing.
D) saves space and eases publication.

Question 45

A researcher used a well-known standardized test in a research study.A description of this test in the research report should

A) be fairly brief.
B) be highly detailed.
C) provide all available data on validity and reliability.
D) provide findings of other studies that used the same test.

Question 46

The framework for stating the conclusions of an experimental study is provided by the

A) statement of the problem.
B) related literature.
C) hypothesis.
D) statistical results.

Question 47

A quantitative researcher who finds positive results with respect to the hypothesis of the study can report that the results____ the hypothesis.

A) prove
B) verify
C) confirm
D) support

Question 48

A reconsideration of the theoretical basis of a quantitative research study belongs in the

A) introduction.
B) methods.
C) discussion.
D) appendix.

Question 49

Which of the following is not a good suggestion for submitting an article to a journal?

A) Include a cover letter.
B) Make the introduction, related literature, and methods sections relatively brief.
C) Determine which style manual the journal specifies.
D) Submit the article to a journal in your specific field of interest.
E) To increase chances of acceptance, submit the article to several journals simultaneously.

Question 50

After identifying a journal to which the manuscript will be submitted, a researcher should

A) contact the editor of the journal.
B) examine recent issues of the journal.
C) inquire about date of publication.
D) write a letter to the editor.

Question 51

The summary and conclusions section of the report should include

A) any relevant information that has not been presented earlier.
B) tables too long for the data section of the report.
C) the first clear statement of the research problem.
D) None of these is true.

Question 52

The first step in preparing a journal article for publication is to

A) decide on the style manual to use.
B) determine the journal most likely to publish it.
C) decide on the title for the article.
D) identify the procedure for submission of manuscripts.
E) write the cover letter that accompanies the manuscript.

Question 53

The following statement would likely be included in which section of a quantitative research article: Subjects included 72 seventh graders (38 girls and 34 boys) enrolled in a rural middle school.

A) Introduction
B) Methods
C) Results
D) Discussion

Question 54

The ____ section in a journal article occupies a larger proportion of the article than it would in a dissertation.

A) introduction
B) related literature
C) procedures
D) results
E) implications

Question 55

Which of the following is not a good suggestion for submitting an article to a journal?

A) Include a cover letter, reply envelope, and stamps with the manuscript.
B) Follow the format style suggested by the journal.
C) Make the article as brief and concise as possible.
D) Send the article to as many journals as possible to increase chances of publication.
E) Submit the article to a journal in your specific field of interest.

Question 56

In terms of comprehensiveness from lowest to highest, which of the following is correct?

A) Dissertation, journal article, paper presentation
B) Journal article, dissertation, paper presentation
C) Paper presentation, dissertation, journal article
D) Paper presentation, journal article, dissertation

Question 57

In an introductory science class, 80 student volunteers were randomly assigned, in equal number, to take a class for a letter grade or for a simple pass/fail grade.At the end of the semester, the mean achievement score for the letter grade group was 86.2 and for the pass/fail group 79.8.The calculated t = 4.60, p<.001.The results should appear in a published report as follows:

A) Introductory science students have significantly higher achievement scores when awarded letter grades rather than a simple pass/fail grade.
B) There is no significant difference in the achievement scores of introductory science students when awarded letter grades or a simple pass/fail grade.
C) Students are more motivated to achieve when given letter grades rather than simple pass/fail grades.
D) Instructors should use letter grades rather than pass/fail grades for introductory science courses.
E) a and d

Question 58

Which of the following would be included in the appendix of a dissertation?

A) sampling procedure used to select subjects
B) copies of data-gathering instruments used in the study
C) item analysis for a test used in the study
D) b and c
E) a, b, and c

Question 59

A graduate student developed the achievement test used in her study.It is most important that the description of the test presented in the methods section of the dissertation include

A) item analysis data.
B) evidence of validity and reliability.
C) instructions for administration of the test.
D) findings of other studies using a similar measure.
E) All of these are true.

Question 60

The following statement would likely be included in which section of a quantitative research article: Consistent with much research on the influence of using word processors on students' writing quality, this research did not generate a clear-cut answer on the question.It did clarify some relevant questions, however, and needed additional methods of investigation.

A) Introduction
B) Methods
C) Results
D) Discussion

Question 61

The largest proportion of a journal article is devoted to

A) problem and hypothesis.
B) literature review.
C) methodology.
D) results and discussion.

Question 62

In developing a title for a research report, the researcher should

A) avoid emotion laden words
B) include operational definitions of the variables
C) use such terms as "a comparison of" or "an investigation into" at the beginning
D) All of these are true.

Question 63

Which of the following is primarily a question of professional ethics?

A) Are the conclusions justified by the evidence in the study?
B) Are the relationships to be investigated logically implied by the hypothesis?
C) Could the difference between groups have been a function of chance?
D) Is the population involved in the study precisely described?
E) Is evidence that does not agree with the hypothesis omitted?

Question 64

The following statement would likely be included in which section of a quantitative research article: The subjects were randomly assigned to one of the two treatments groups and a pretest was administered.

A) Introduction
B) Methods
C) Results
D) Discussion

Question 65

Exhibit 19-1.A researcher wished to determine if there was a difference in the college aptitude examination scores of traditional and nontraditional undergraduate students.The researcher selected p = .05 as the level for rejecting the null hypothesis.The researcher obtained a mean score of 52 for nontraditional students and a mean score of 40 for the traditional students.Statistical analysis indicated that the difference in means was significant at the .05 level.
Refer to Exhibit 19-1.The null hypothesis for this study would be

A) retained.
B) rejected.
C) ignored.
D) verified.

Question 66

The following statement would likely be included in which section of a quantitative research article: The purpose of this study was to investigate the effects of using word processing on writing quality of seventh graders.

A) Introduction
B) Methods
C) Results
D) Discussion

Question 67

Which of the following questions is primarily a question of deductive reasoning?

A) Are the conclusions justified by the evidence in the study?
B) Are the relationships to be investigated logically implied by the hypothesis?
C) Could the difference between groups have been a function of chance?
D) Is the population involved in the study precisely described?
E) Is evidence that does not agree with the hypothesis omitted?

Question 68

Which of the following is primarily a question of statistics?

A) Are the conclusions justified by the evidence in the study?
B) Are the relationships to be investigated logically implied by the hypothesis?
C) Could the difference between groups have been a function of chance?
D) Is the population involved in the study precisely described?
E) Is evidence that does not agree with the hypothesis omitted?

Question 69

Exhibit 19-1.A researcher wished to determine if there was a difference in the college aptitude examination scores of traditional and nontraditional undergraduate students.The researcher selected p = .05 as the level for rejecting the null hypothesis.The researcher obtained a mean score of 52 for nontraditional students and a mean score of 40 for the traditional students.Statistical analysis indicated that the difference in means was significant at the .05 level.
Refer to Exhibit 19-1.How would the statistical significance be interpreted?

A) Traditional and nontraditional students are drawn from the same population in terms of college aptitude.
B) There are 5 chances in 100 that the two groups were drawn from different populations in terms of their college aptitude.
C) There are 5 chances in 100 that the two groups were drawn from the same population in terms of their college aptitude.
D) For every nontraditional student, there are 5 chances in 100 that she/he will score higher than a traditional student.

Question 70

A retained null hypothesis means that

A) there is no relationship between the variables
B) there is no evidence for either the truth or falsity of the hypothesis
C) the researcher's hypothesis is proven to be incorrect
D) the null hypothesis is certainly true

Question 71

The following statement would likely be included in which section of a quantitative research article: The ANOVA revealed a significant difference among groups, F(2,70) = 5.92, p < .001.

A) Introduction
B) Methods
C) Results
D) Discussion

Question 72

Indicate which of the following is true related to presentation of a research study.

A) It may be assumed that the readers will arrive at the same conclusions as the writer.
B) Using the hypothesis as the framework around which to organize the presentation and analysis of data is a useful strategy.
C) Personal anecdotes, humorous asides, etc., should be used whenever possible to enliven a research report.
D) It should be assumed by researchers that readers will deduce the implications of the results themselves.

Question 73

The results of an experimental study were statistically significant (p<.01).The researcher rejected the null hypothesis and accepted the alternative.In reality, there was no difference between the groups.The researcher

A) made a Type I error.
B) made a Type II error.
C) made a correct decision .
D) rejected a false null hypothesis.

Question 74

Exhibit 19-1.A researcher wished to determine if there was a difference in the college aptitude examination scores of traditional and nontraditional undergraduate students.The researcher selected p = .05 as the level for rejecting the null hypothesis.The researcher obtained a mean score of 52 for nontraditional students and a mean score of 40 for the traditional students.Statistical analysis indicated that the difference in means was significant at the .05 level.
Refer to Exhibit 19-1.What result would be reported?

A) Nontraditional students are better college students.
B) Nontraditional students have higher motivation, and this increases their college skills.
C) Traditional college students are not as experienced, so they have a lower score.
D) Nontraditional college students had a significantly higher score on the college aptitude examination than did traditional college students.

Question 75

MATCHING
The following is a list of some of the components that are covered in a research report.Match the questions below with the component it is directed toward.
a.Statement of the problem
b.Related literature
c.Subjects
d.Methods
e.Analysis
f.Results
g.Discussion
h.Conclusions
Are there sufficient controls for internal and external validity?

Question 76

When the results of a study conflict with previous research or with well-established theory, the researcher should

A) go back and rewrite the hypothesis section of the report
B) focus on the shortcomings of the study that could have caused such a result
C) include a reconsideration of the original theory in the discussion section
D) note that the previous research and theories are probably wrong

Question 77

Indicate which of the following is true related to presentation of a research study.

A) Because the readers of a journal represent a wide range of interests and knowledge, journal articles typically have longer introductions and literature reviews than theses.
B) Colleagues at presentations are generally not up-to-date on all topics, so presentations are generally more comprehensive than journal articles.
C) In a journal article, the results and conclusion section typically constitute a smaller proportion of the article than in a thesis.
D) A paper read at a professional convention is typically briefer and less formal than a journal article.

Question 78

Exhibit 19-1.A researcher wished to determine if there was a difference in the college aptitude examination scores of traditional and nontraditional undergraduate students.The researcher selected p = .05 as the level for rejecting the null hypothesis.The researcher obtained a mean score of 52 for nontraditional students and a mean score of 40 for the traditional students.Statistical analysis indicated that the difference in means was significant at the .05 level.
Refer to Exhibit 19-1.The null hypothesis for this study would be

A) nontraditional college students will score higher on a college aptitude test than will traditional college students.
B) traditional college students will score higher on a college aptitude test than will nontraditional college students.
C) the age of students will have a significant effect on their performance on a college aptitude test.
D) there is no significant difference in the performance of traditional and nontraditional college students on a college aptitude examination.

Question 79

The mean score for the experimental group was 87.5 and 70.6 for the control group.The t test was 4.5, p < .01.One would expect to find this type of data in the __________ section of a report.

A) discussion
B) results
C) methods
D) conclusions.

Question 80

An investigator compared the effectiveness of two methods of instruction (A and B) on the math achievement of boys and girls.The mean test scores are presented below.What interpretation of these results would be justified? Method
$\begin{array}{cc}&&&\text { Method }\\&&\mathrm{A} && \mathrm{B} \\\text { Gender }&\text { Boys }&40 && 30 \\&\text { Girls }&20 & &30\end{array}$

A)There was a main effect for method of instruction.
B)There was a main effect for gender.
C)There was an interaction between gender and method of instruction.
D)b and c
E)All of the above are true.