Deck 13: Statistical Significance for 2 2 Tables

Question 1

The __________ hypothesis is usually written to express the fact that 'nothing is happening.'

Answer 1

null

Question 2

Which of the following statements is true about chi-square tests?

A)A large chi-square test statistic results in a large p-value.
B)A large p-value means that there is a good chance that the relationship is statistically significant.
C)If the two variables are not related in the population, then less than 5% of the samples you could ever take would give you a test statistic of 3.84 or larger.
D)All of the above.

Answer 2

If the two variables are not related in the population, then less than 5% of the samples you could ever take would give you a test statistic of 3.84 or larger.

Question 3

For Questions , use the following narrative
Narrative: Aspirin and polyps
A well-designed experiment by the Ohio State University Medical Center studied whether or not taking an aspirin a day would affect colon cancer patients' chances of getting subsequent colon polyps.In the study, 635 patients with colon cancer participated; 317 of them were randomly assigned to the aspirin group, and the other 318 patients were assigned to a placebo (non-aspirin) group.The results showed that 17% of the patients in the aspirin group developed subsequent polyps, compared to 27% of the patients in the non-aspirin group.The results are summarized in the table below.

{Aspirin and polyps narrative} Is there a statistically significant relationship between taking aspirin and developing subsequent polyps in colon cancer patients? If so, what is the relationship? Justify your answer.

Answer 3

The chi-square statistic is 9.25 > 3.84 (p-value < .05), the relationship is statistically significant.since the aspirin group experienced fewer polyps (17% compared to 27%), it appears that aspirin reduces the chances of developing subsequent polyps in colon cancer patients.

Question 4

The first two basic steps for conducting a hypothesis test are to:
1) determine the null and alternative hypotheses
2) collect the data and summarize it with a 'test statistic.'
What is the third step in the process that allows you to then make a decision?

Question 5

Suppose a researcher wanted to find out which of two chemicals works best to kill poison ivy.He conducted a controlled experiment involving 200 poison ivy plants, randomly assigned half of them to each treatment (chemical #1 or chemical #2).Five days after applying the chemicals, he recorded the data below.Is there a statistically significant relationship between type of chemical used and the results when applied to poison ivy? Conduct a hypothesis test to find out.

Question 6

Another name for the alternative hypothesis is the __________ hypothesis.

Question 7

Suppose you observe a relationship between two categorical variables in a sample based on 22,000 people.If this observed relationship were based on a sample of 600 people rather than 22,000, how would this affect the believability of the results (if at all)? Explain your answer.

Question 8

Suppose you find a statistically significant relationship between two categorical variables (with no other supporting evidence available).When can such results correctly lead you conclude a cause and effect relationship?

A)Never.
B)Only when the data were from a randomized experiment.
C)Only when the data were from a random sample.
D)Always; a statistically significant relationship wouldn't be significant unless there is a cause and effect relationship.

Question 9

Which of the following statements is not true about the chi-square statistic for a 2 x 2 contingency table?

A)If it is greater than 3.84, reject the null hypothesis and accept the alternative hypothesis.
B)If it is greater than 3.84, the relationship in the table is considered to be statistically significant.
C)95% of the tables for sample data from populations in which there is no relationship will have a chi-square statistic of 3.84 or greater.
D)All of the above are true.

Question 10

When researchers look for a relationship between two categorical variables for individuals in the __________, they measure those categorical variables on individuals in the __________.

Question 11

Suppose you wanted to test to see if there is a relationship between gender and driving an SUV.You take a random sample of 200 vehicles and their owners and use Minitab to analyze your data.Your computer output is below, but unfortunately the last line of the output (which would have contained the p-value) didn't print.What can you conclude? (Assume the study was conducted properly otherwise.) Expected counts are printed below observed counts
SUV Non-SUV TOTAL
Male 45 67 112
49)84 62.16
Female 44 44 88
39)16 48.84
Total 89 111 200
Chi-Sq = .47 + .38 + .60 + .48 = 1.92

A)The relationship between gender and driving an SUV is not statistically significant.
B)There is a statistically significant relationship.Women are more likely to drive SUVs than men.
C)There is a statistically significant relationship.More men are likely to drive SUVs than women.
D)Not enough information to tell.

Question 12

Which of these does not apply to a 'statistically significant' relationship between two categorical variables?

A)The relationship between the two variables is very important from a practical standpoint.
B)The relationship observed in the sample was unlikely to have occurred unless there really is a relationship in the population.
C)The notion that this relationship could have happened by chance is deemed to be implausible.
D)All of the above apply to a 'statistically significant' relationship.

Question 13

For Questions , use the following narrative
Narrative: Aspirin and polyps
A well-designed experiment by the Ohio State University Medical Center studied whether or not taking an aspirin a day would affect colon cancer patients' chances of getting subsequent colon polyps.In the study, 635 patients with colon cancer participated; 317 of them were randomly assigned to the aspirin group, and the other 318 patients were assigned to a placebo (non-aspirin) group.The results showed that 17% of the patients in the aspirin group developed subsequent polyps, compared to 27% of the patients in the non-aspirin group.The results are summarized in the table below.

{Aspiring and polyps narrative} Write the expected counts in each of the four cells of the table in parentheses next to each of the observed counts.

Question 14

Which of the following differences in percentages for the two categories of an explanatory variable would be considered to be statistically significant?

A)50% - 49 % = 1%
B)50% - 45% = 5%
C)50% - 40% = 10%
D)Not enough information to tell.

Question 15

Your mother-in-law says that rubbing a carpet stain with toothpaste before applying stain remover helps take the stain out.You are skeptical.You asked an impartial neighbor to set up a randomized experiment to find out whether there is a relationship between the stain removing method and the outcome.She went home to collect and analyze the data, then called you and said "In a chi-square test, I would choose the alternative hypothesis," and then hung up.What do you conclude?

A)The toothpaste didn't make a difference.
B)The toothpaste did help after all.
C)The toothpaste had a significant effect but you don't know in which way yet.
D)The toothpaste made things worse.

Question 16

Suppose you want to investigate whether there is a relationship between the gender of college students and whether or not they wear hats in school.What would be your null hypothesis and your alternative hypothesis (in words)? Be sure to label clearly which hypothesis is which.

Question 17

Whether or not we can rule out chance as an explanation for the relationship observed in a sample depends on what two things?

Question 18

Using the criterion of .05, which of the following results allows a researcher to conclude that a relationship between two categorical variables is statistically significant?

A)p-value = .04
B)p-value = .50
C)p-value = .95
D)None of the above.

Question 19

The question researchers are really asking when they are looking for a relationship between two variables is whether or not that relationship is present in the __________.

Question 20

For Questions , use the following narrative
Narrative: Aspirin and polyps
A well-designed experiment by the Ohio State University Medical Center studied whether or not taking an aspirin a day would affect colon cancer patients' chances of getting subsequent colon polyps.In the study, 635 patients with colon cancer participated; 317 of them were randomly assigned to the aspirin group, and the other 318 patients were assigned to a placebo (non-aspirin) group.The results showed that 17% of the patients in the aspirin group developed subsequent polyps, compared to 27% of the patients in the non-aspirin group.The results are summarized in the table below.

{Aspirin and polyps narrative} Compute the test statistic for the data.

Question 21

Suppose that a medical study found a statistically significant relationship between wearing gold jewelry and developing skin cancer.Suppose the study was based on a sample of 100,000 people and had a p-value of .049.How would you react to these results?

A)You feel these results are very convincing since the sample size was so large.
B)You are impressed by the sample size but the p-value is too close to .05 to feel very convinced; the result is marginal.
C)You are skeptical because the high sample size would lead to a small p-value even with a miniscule relationship, and thus gives misleading results.
D)None of the above

Question 22

Is it possible for an important relationship in a population to fail to achieve statistical significance in the sample and therefore go undetected, even if the sample is selected properly and the data are collected correctly? Explain your answer.

Question 23

For Questions , use the following narrative
Narrative: Teenage voting
Suppose you take a random sample of teenagers aged 18-19, and you find that 53% of the males in your sample are Democrats, and 54% of the females in your sample are Democrats, respectively.
{Teenage voting narrative} Could these results ever be statistically significant? Why or why not?

Question 24

If two variables have a statistically significant relationship that does not necessarily mean the two variables have a relationship of practical importance.Describe how this could happen.

Question 25

Suppose researchers say they 'failed to find a relationship' between two variables that they thought might have been related.What does this say to you, as an educated consumer of statistical information?

A)You should check to make sure the study was not based on a small number of individuals.
B)The researchers must not have observed any relationship in their sample.
C)There must be no relationship between these two variables in the population.
D)All of the above.

Question 26

A minor relationship in the population may achieve __________ significance but fail to achieve __________ significance if there are an extremely large number of observations.

Question 27

Suppose there is not enough evidence to conclude that the relationship in the population is real.Which of the following is not an equivalent way of saying this?

A)The relationship is not statistically significant.
B)We cannot reject the null hypothesis.
C)We accept the null hypothesis.
D)All of the above.

Question 28

An interesting relationship in the population may fail to achieve __________ significance if there are too _____ observations.

Question 29

A __________ test is a statistical procedure that is used to determine whether or not there is a relationship between two categorical variables.

Question 30

A minor relationship that is found to be __________ significant is not necessarily __________ significant.

Question 31

A measure of how unlikely the test statistic would be if the null hypothesis were true is the __________.

Question 32

Suppose a chi-square test statistic from a sample of size 1,000 is 38.2 with a p-value of .0001, so the relationship is statistically significant.If the sample size for this study had only been based on a sample size of 100 (but the percentages remained the same), what would the chi-square test statistic have been and what conclusion would have been drawn?

A)Chi-square = 38.2; p-value = .0001; the relationship is statistically significant.
B)Chi-square = 3.82; p-value = .001; the relationship is statistically significant.
C)Chi-square = 3.82; p-value = .052; the relationship is not statistically significant.
D)None of the above.

Question 33

For Questions , use the following narrative
Narrative: Teenage voting
Suppose you take a random sample of teenagers aged 18-19, and you find that 53% of the males in your sample are Democrats, and 54% of the females in your sample are Democrats, respectively.
{Teenage voting narrative} Should these results be considered significant from a practical standpoint? Why or why not?