Question 1

Ideally, focus groups should have _____ participants to optimize individual member participation.
A) 4 to 6
B) 6 to 9
C) 6 to 12
D) 12 to 18

Accepted Answer

Six to twelve participants is the ideal range for focus groups as it allows for a diversity of opinions and perspectives while still enabling each member to participate in the group discussion. Having fewer than six members can limit the range of viewpoints, while having more than 12 can make it difficult to manage the discussion and give sufficient attention to each member's contributions.

Question 2

All of the following are considered advantages to focus groups, EXCEPT:
A) high volume of content.
B) inability to generalization to other populations.
C) quick and efficient.
D) analyze group member interaction.

Accepted Answer

This option is the only one that is not an advantage to focus groups. The inability to generalize to other populations is a limitation of focus groups, not an advantage. The other options (high volume of content, quick and efficient, and ability to analyze group member interaction) are all advantages of using focus groups in research.

Question 3

Which of the following is part of the execution phase for the program evaluation process?
A) identify key stakeholders
B) describe the program
C) create an evaluation plan
D) gather the data

Accepted Answer

Gathering data is a key part of the execution phase for the program evaluation process. During this phase, evaluators collect data based on the evaluation plan developed in the previous phase. The data is then analyzed and used to make recommendations for program improvements or changes. Identifying key stakeholders, describing the program, and creating an evaluation plan are part of the planning phase of the program evaluation process.

Question 4

Dr. Marcus acknowledged several limitations of utilizing a single-item indicator in her examination of inappropriate social outbursts among highly introverted individuals. Which of the following would not be considered a limitation of a single-item indicator?
A) generalizability.
B) reliability
C) random error
D) it only measures effectiveness

Accepted Answer

A single-item indicator does not measure effectiveness, so this is not a limitation.

Question 5

_____ is a systematic and planned sequence of related studies where subsequent studies build directly on a previous study's findings to provide a more comprehensive understanding of a phenomenon.
A) Programmatic research
B) Descriptive research
C) Nonconcealed observation
D) Systematic observational research

Accepted Answer

Programmatic research is a type of research where subsequent studies are designed to build on the findings of the previous studies in a planned and systematic manner. This approach allows researchers to develop a more comprehensive understanding of a phenomenon by exploring it from different angles or using different methods. Descriptive research focuses on describing a phenomenon without necessarily exploring the underlying causes, while nonconcealed observation and systematic observational research refer to specific methods of data collection rather than a comprehensive research approach.

Question 6

_____ develops an application that provides specific information regarding a program's goals, along with evidence of the program's effectiveness in order to gain monetary gifts.
A) Dissertation writing
B) Programmatic research
C) Needs assessment
D) Grant writing

Accepted Answer

Grant writing is the process of developing a proposal to seek monetary gifts from foundations, corporations, or government entities. The application typically includes specific information regarding the program's goals and objectives, along with evidence of the program's effectiveness, to convince the granting organization to fund the program.

Question 7

In word clouds larger words typically indicate:
A) higher frequency of use.
B) lower frequency of use.
C) minimal frequency of use.
D) marginal use.

Accepted Answer

In word clouds, the size of the word is proportional to the frequency of its use in the given text. Therefore, larger words indicate higher frequency of use.

Question 8

Typically focus groups do not last longer than _____ to facilitate in efficiency.
A) 60 minutes
B) 90 minutes
C) 120 minutes
D) 180 minutes

Accepted Answer

Focus groups typically last between 60-90 minutes to allow for efficient gathering of information without causing fatigue or boredom for participants. Longer sessions may result in participants losing their focus and providing less insightful feedback.

Question 9

When completing a literature search to find information regarding specific measurements and scales it is important to extract all of the following information, EXCEPT:
A) Cronbach's alpha.
B) scale scoring.
C) example items.
D) popularity of scale.

Accepted Answer

While all of these pieces of information could be useful in assessing the appropriateness and reliability of a measurement scale, the popularity of a scale is less important than its psychometric properties and the specific details of its administration and scoring.

Question 10

Key findings of program evaluations tend to be represented visually by:
A) regression lines.
B) bar graphs.
C) cluster lines.
D) pictographs.

Accepted Answer

Bar graphs are the best choice for representing key findings of program evaluations visually because they can easily showcase the comparison of different measures or outcomes. They are also easy to understand for a wide range of audiences. Regression lines may be useful in certain cases, but they are more suitable for analyzing relationships between variables rather than presenting key findings. Cluster lines and pictographs may also have their uses, but they are less common and less effective for presenting program evaluation results.

Question 11

A unique way to represent information gathered from a program evaluation that conveys information in an engaging, visually appealing, and easily deciphered format is referred to as a(n):
A) APA pamphlet.
B) PSA.
C) infographic.
D) advertisement.

Accepted Answer

An infographic is a visually appealing way to present data and information in a concise and engaging manner. It is often used to highlight key findings from a program evaluation and can be easily shared across different platforms. APA pamphlets, PSAs, and advertisements may not be as effective in presenting program evaluation results in a visually appealing and engaging format.

Question 12

_____ is a visual representation of the frequency with which certain words are used in a qualitative assessment.
A) A Latin square design
B) A participant pool
C) A word cloud
D) A meta-analysis

Accepted Answer

A word cloud is a visual representation of frequently used words in qualitative assessment. The words are typically displayed in different sizes or weights depending on how often they were used. A word cloud provides an easy way of identifying key themes or topics that emerged during the qualitative analysis.

Question 13

A _____ is a statistic to evaluate whether a sample mean statistically differs from a specific value.
A) t-test for dependent means
B) single sample t-test
C) two-way ANOVA
D) repeated measures ANOVA

Accepted Answer

A single sample t-test is designed to evaluate whether a sample mean differs significantly from a specific value (i.e. population mean). The other options are not specific to testing whether a sample mean differs from a specific value.

Question 14

Which is the typical sequence for program evaluation?
A) baseline group, focus group, survey
B) focus group, survey, experiment
C) focus group, experiment, survey
D) baseline group, experiment, survey

Accepted Answer

The answer of Which is the typical sequence for program...

Question 15

Which of the following is NOT part of the communication of results phase for the program evaluation process?
A) report the results
B) clarify the evaluation's goals
C) form conclusions
D) make recommendations

Accepted Answer

Clarifying the evaluation's goals is part of the planning and design phase, not the communication of results phase. The communication of results phase includes reporting the results, forming conclusions based on those results, and making recommendations for future actions based on the evaluation findings.

Question 16

A(n) _____ identifies unmet goals and outcomes the program can improve in order to better serve the clients or establish evidence for program effectiveness.
A) needs evaluation
B) process evaluation
C) program evaluation
D) outcomes evaluation

Accepted Answer

The answer of A(n) _____ identifies unmet goals and outcomes...

Question 17

Which of the following outcomes would indicate a significant finding based on conducting a factorial ANOVA? A) F(1, 168) = 6.73, p = .09, eta² = .06. B) F(1, 168) = 5.73, p = .11, eta² = .06. C) F(1, 168) = 6.73, p = .04, eta² = .06. D) F(1, 168) = 4.73, p = .18, eta² = .06.

Accepted Answer

A significant finding would have a p-value less than .05. Choice C has a p-value of .04, indicating a significant finding. Choices A, B, and D all have p-values greater than .05, indicating non-significant findings.

Question 18

A(n) _____ assesses the general program operation, including who the program serves and how the program delivers services to that population.
A) needs evaluation
B) process evaluation
C) outcomes evaluation
D) program evaluation

Accepted Answer

A process evaluation assesses how a program is delivered and who it serves. A needs evaluation assesses the needs of the population that the program serves. An outcomes evaluation assesses the effectiveness of the program in achieving its desired outcomes. A program evaluation is a broader term that can encompass all of these types of evaluations. However, the question specifically asks for an evaluation that assesses how the program delivers services to the population, which is the focus of a process evaluation.

Question 19

Word clouds are a visual representation of a set of ________________ from a qualitative assessment.
A) means
B) clusters
C) data frequencies
D) a coding system

Accepted Answer

Word clouds are created using the frequencies of words or phrases found in a qualitative assessment. Therefore, the best choice is C, which refers to data frequencies.

Question 20

_____ determines whether a program effectively produces outcomes that are consistent with the state objectives or goals.
A) Needs evaluation
B) Process evaluation
C) Outcomes evaluation
D) Program evaluation

Accepted Answer

Outcomes evaluation is the process of determining whether a program has effectively produced results or outcomes that align with the organization's objectives or goals. This type of evaluation assesses the effectiveness of program activities by measuring its results or intended outcomes.

Quiz 13: Using Research in the Real World: How Do You Know If You Are Truly Helping

Ideally, focus groups should have _____ participants to optimize individual member participation.

All of the following are considered advantages to focus groups, EXCEPT:

Which of the following is part of the execution phase for the program evaluation process?

Dr. Marcus acknowledged several limitations of utilizing a single-item indicator in her examination of inappropriate social outbursts among highly introverted individuals. Which of the following would not be considered a limitation of a single-item indicator?

_____ is a systematic and planned sequence of related studies where subsequent studies build directly on a previous study's findings to provide a more comprehensive understanding of a phenomenon.

_____ develops an application that provides specific information regarding a program's goals, along with evidence of the program's effectiveness in order to gain monetary gifts.

In word clouds larger words typically indicate:

Typically focus groups do not last longer than _____ to facilitate in efficiency.

When completing a literature search to find information regarding specific measurements and scales it is important to extract all of the following information, EXCEPT:

Key findings of program evaluations tend to be represented visually by:

A unique way to represent information gathered from a program evaluation that conveys information in an engaging, visually appealing, and easily deciphered format is referred to as a(n) :

_____ is a visual representation of the frequency with which certain words are used in a qualitative assessment.

A _____ is a statistic to evaluate whether a sample mean statistically differs from a specific value.

Which is the typical sequence for program evaluation?

Which of the following is NOT part of the communication of results phase for the program evaluation process?

A(n) _____ identifies unmet goals and outcomes the program can improve in order to better serve the clients or establish evidence for program effectiveness.

Which of the following outcomes would indicate a significant finding based on conducting a factorial ANOVA?

A(n) _____ assesses the general program operation, including who the program serves and how the program delivers services to that population.

Word clouds are a visual representation of a set of ________________ from a qualitative assessment.

_____ determines whether a program effectively produces outcomes that are consistent with the state objectives or goals.