Question 1

What type of validity refers to the extent to which a researcher's claim that any change in an outcome is a result of her or his intervention and not the result of other factors?

Accepted Answer

Internal validity refers to the extent to which a researcher can demonstrate that a change in the dependent variable was indeed caused by the manipulation of the independent variable, and not by other factors.

Question 2

In yesterday's class lecture, Dr. Walker highlighted his previous experimental studies showing that an individual's work satisfaction is more important than her or his leisure satisfaction in explaining general life satisfaction. He also stated that the findings come from studies he conducted in the early 1980s in the United States. What type of validity is specifically at risk if Dr. Walker interpreted the findings from his studies as applying to today's context?

Accepted Answer

External validity is at risk if Dr. Walker interpreted the findings from his studies conducted in the early 1980s as applying to today's context because it concerns whether the results of a study can be generalized to other situations, times, or populations.

Question 3

Which of the following statements is true?

Accepted Answer

Construct validity refers to how well a test or tool measures the concept it's intended to measure. When a measure is modified, its ability to accurately assess the intended construct may change, necessitating a reevaluation of its construct validity. This ensures the modified measure still accurately reflects the construct it aims to assess.

Question 4

Which kind of validity refers to the quality of researchers' arguments, their application of theory to support the needs for the study, and the appropriate interpretation of results based on the data?

Accepted Answer

Logical validity refers to the quality of researchers' arguments, their application of theory to support the needs for the study, and the appropriate interpretation of results based on the data.

Question 5

Does a correlation in the magnitude of r = .36, between a measure (Measure 1) and another measure (Measure 2) of a similar construct, support the construct validity of the first measure (Measure 1)?

Accepted Answer

A correlation of r = .36 suggests a moderate relationship, but whether it supports construct validity depends on the specific content and context of the measures involved.

Question 6

Which of the following statements is true?

Accepted Answer

Construct validity is supported by measures that are both consistent (reliable) and accurate (valid), ensuring that the instrument accurately measures the concept it intends to measure.

Question 7

In contrast to experimental study designs, which types of validity evidence are not relevant to correlational study designs?

Accepted Answer

Internal validity and external validity are not relevant to correlational study designs because correlational studies do not involve manipulating independent variables.

Question 8

What type of validity used to evaluate the merits of experimental research studies most closely aligns with the concept of generalizability, the latter of which can be used to evaluate the merits of non-experimental research studies?

Accepted Answer

External validity is concerned with the extent to which the results of a study can be generalized to other situations, populations, or time periods, aligning closely with the concept of generalizability in non-experimental research.

Question 9

The CONSORT 2010 statement was developed to assist researchers and readers with which of the following?

Accepted Answer

The CONSORT (Consolidated Standards of Reporting Trials) 2010 statement was specifically developed to improve the reporting of randomized controlled trials (RCTs), providing a checklist and flow diagram to help authors describe their trial design, methodology, and results clearly and transparently.

Question 10

Which of the following needs to be read in order to adequately evaluate the logical validity of a research study published in a journal?

Accepted Answer

The answer of Which of the following needs to be...

Question 11

The development of a nomological network can be useful in evaluating what type of validity?

Accepted Answer

A nomological network is a conceptual framework that outlines the relationships between constructs and their observable measures, thus it is primarily used in evaluating construct validity. It helps in establishing the evidence that a test measures the construct it purports to measure.

Question 12

What type of validity is best represented in the following example?
Dr) Piper is conducting a research study that examines the relationship between height and bone fracture occurrences over 35 years. Dr. Piper measures adolescents' sitting height at age 15, and has them report number of annual bone fractures for the next 35 years. In his previous longitudinal research studies, Dr. Piper found that sitting height in adolescence is predictive of actual height in adulthood, so he is confident that by using sitting height at age 15 he has an adequate measure of the participants' actual height when they are 50 years old.

Accepted Answer

Construct validity refers to how well a test or tool measures the concept it's intended to measure. In this example, Dr. Piper is using sitting height at age 15 as a measure for actual height in adulthood, based on his previous findings that sitting height is predictive of adult height. This demonstrates construct validity because it shows that the measure (sitting height) accurately represents the concept being studied (actual height in adulthood).

Question 13

What is required in order to evaluate the internal validity of a study?

Accepted Answer

The answer of What is required in order to evaluate...

Question 14

What are two key features of true experimental designs?

Accepted Answer

True experimental designs are characterized by the inclusion of a control group and the random assignment of participants to groups, which help establish causality by controlling for confounding variables.

Question 15

What is the one of the most effective strategies to increase the external validity of a research study in kinesiology?

Accepted Answer

Having clear inclusion criteria to identify potential participants helps in defining the population to which the results can be generalized, thereby increasing the external validity of a research study in kinesiology. This ensures that the study sample represents the broader population of interest.

Question 16

What type of validity is most threatened by a reliance on WEIRD samples to conduct research?

Accepted Answer

External validity is most threatened by reliance on WEIRD (Western, Educated, Industrialized, Rich, and Democratic) samples because it concerns the generalizability of the research findings to broader populations. WEIRD samples may not represent the diversity of human experiences and cultures, limiting the applicability of the research findings to only similar populations.

Question 17

Henrich, Heine, and Norenzayan (2010) discuss how researchers often rely on WEIRD samples to conduct their research. What does WEIRD stand for?

Accepted Answer

WEIRD stands for Western, Educated, Industrialized, Rich, and Democratic, highlighting the demographic bias in psychological research samples.

Question 18

Which of the following refers to the validity of the measure(s) using a research study?

Accepted Answer

Construct validity refers to the extent to which a test measures what it claims, or purports, to be measuring. It's about the appropriateness of inferences made on the basis of observations or measurements, particularly where those inferences relate to theoretical constructs.

Question 19

You conduct a correlational study on the relationship between physical activity levels and carbohydrate intake. You collect all of your data on a single measurement occasion using a questionnaire measuring physical activity levels and carbohydrate intake. What types of validity can you use to evaluate whether your study is any good?

Accepted Answer

Construct validity is relevant because it assesses whether the questionnaire accurately measures the theoretical constructs of physical activity levels and carbohydrate intake. Logical validity, while not a standard term in research methodology, could be interpreted as part of construct validity, involving the logical or theoretical justification for interpreting the questionnaire as an accurate measure of the constructs. Internal and external validity are more relevant to experimental designs and causality, not directly applicable to the measurement quality in a correlational study.

Question 20

Dr. Ferguson is conducting a research study on the effects of a vegetarian diet on women exercisers' body image. After completing her study, Dr. Ferguson is concerned that the improvements in women exercisers' body image may actually be due to the social support they received from the other study participants rather than the vegetarian diet. Dr. Ferguson's concern represents a threat to what type of validity?

Accepted Answer

Dr. Ferguson's concern is related to internal validity, which refers to the degree to which a study can establish a causal relationship between the independent and dependent variables. In this case, the potential influence of social support on body image could confound the results, making it unclear whether the observed effects are due to the vegetarian diet or the social support, thus threatening the study's internal validity.

Quiz 6: Evaluating the Merits of Quantitative Research Studies in Kinesiology

What type of validity refers to the extent to which a researcher's claim that any change in an outcome is a result of her or his intervention and not the result of other factors?

Which of the following statements is true?

Which kind of validity refers to the quality of researchers' arguments, their application of theory to support the needs for the study, and the appropriate interpretation of results based on the data?

Does a correlation in the magnitude of r = .36, between a measure (Measure 1) and another measure (Measure 2) of a similar construct, support the construct validity of the first measure (Measure 1) ?

Which of the following statements is true?

In contrast to experimental study designs, which types of validity evidence are not relevant to correlational study designs?

What type of validity used to evaluate the merits of experimental research studies most closely aligns with the concept of generalizability, the latter of which can be used to evaluate the merits of non-experimental research studies?

The CONSORT 2010 statement was developed to assist researchers and readers with which of the following?

Which of the following needs to be read in order to adequately evaluate the logical validity of a research study published in a journal?

The development of a nomological network can be useful in evaluating what type of validity?

What is required in order to evaluate the internal validity of a study?

What are two key features of true experimental designs?

What is the one of the most effective strategies to increase the external validity of a research study in kinesiology?

What type of validity is most threatened by a reliance on WEIRD samples to conduct research?

Henrich, Heine, and Norenzayan (2010) discuss how researchers often rely on WEIRD samples to conduct their research. What does WEIRD stand for?

Which of the following refers to the validity of the measure(s) using a research study?