Deck 8: How to Construct a Questionnaire

Question 1

When developing a questionnaire, demographic questions should:

A) Be placed at the end of the questionnaire
B) Be placed at the beginning of the questionnaire
C) Not be included in a questionnaire
D) Be put at the beginning and end of the questionnaire

Answer 1

A

Question 2

A researcher wrote the following item stem for a 5-point rating scale. "Don't you agree that the University needs a football team." What is the problem with this item?

A) It uses unfamiliar language
B) It is a double-barreled question
C) It uses double negatives
D) It is a "leading" question

Answer 2

D

Question 3

Give multiple examples of response categories used for completely anchored rating scales.

Answer 3

not answered

Question 4

A researcher developed the following item for a questionnaire to be given to high school students: "I use metacognitive strategies." What is a key problem with this item?

A) It uses unfamiliar language, the term "metacognitive"
B) It is a double-barreled question
C) It uses a double negative
D) It is a "leading" item

Question 5

To make a set of categories exhaustive, it is necessary to:

A) Not use ranges of responses
B) Not use closed-ended items
C) Not use mutually exclusive categories
D) Include responses that will account for all possible responses

Question 6

Bill is developing a questionnaire. Which of the following should he do in constructing the questionnaire?

A) Try to fit the entire questionnaire on a single page
B) Avoid numbering the items on the questionnaire
C) Use a small font size
D) Put a title on the questionnaire

Question 7

List and explain the five major steps in questionnaire construction.

Question 8

Which of the following sets of closed-ended response categories has mutually exclusive categories?

A) 0-10, 10-20, 20-30, 30-40
B) 0-9, 10-19, 20-29, 30-39
C) 0-5, 5-10, 10-15, 15-20
D) 0, 1-3, 3-6, 6-9, 10 or more

Question 9

Harold is developing a questionnaire about intelligence. He is going to list statements and ask participants to agree or disagree with each statement. Which set of response categories is acceptable according to your textbook?

A) (1) Strongly Disagree (2) Disagree (3) Neutral (4) Agree (5) Strongly Agree
B) (1) Agree (2) Strongly Agree (3) Strongly Disagree (4) Disagree
C) (1) Disagree (2) Agree
D) (1) Yes (2) no

Question 10

Open-ended questions are generally better to use when:

A) The dimensions of variable are well-defined
B) The responses are well-defined
C) The research is confirmatory
D) The research is exploratory

Question 11

Summarize and explain the content in the checklist for questionnaire development.

Question 12

Mutually exclusive response categories:

A) Overlap
B) Do not overlap
C) Cannot be used on closed-ended items
D) Are used when designing open-ended items

Question 13

According to your textbook, which of the following is recommended?

A) Try to fit the entire questionnaire on a single page
B) Use plenty of white space on the questionnaire
C) Use a small font size so you can get a lot on each page
D) Avoid putting a title on the questionnaire

Question 14

When using open-ended questions, you should:

A) Leave sufficient blank space for the respondent to write in
B) Put in lines for the respondent to write on
C) Provide a full page of space for each open-ended item
D) Always follow-up an open-ended item with a closed-ended item

Question 15

Explain how the different parts of a questionnaire are organized into a smoothly operating whole.

Question 16

A researcher's survey on school financing asked parents to agree or disagree with this statement: "Parents should support the schools and taxes should be increased." What is the problem with this item?

A) It uses unfamiliar language
B) It is a double-barreled question
C) It uses double negatives
D) It is a "leading" item

Question 17

Explain each of the 15 principles of questionnaire construction.

Question 18

A self-report data collection instrument filled out by research participants is called:

A) An interview
B) A focus group
C) Secondary data
D) A questionnaire

Question 19

Which set of response categories is not acceptable according to your textbook?

A) Strongly Disagree (2) Disagree (3) Neutral (4) Agree (5) Strongly Agree
B) Strongly Agree (2) Agree (3) Disagree (4) Strongly Disagree
C) Strongly Disagree (2) Disagree (3) Agree (4) Strongly Agree
D) Strongly Disagree (2) Somewhat Agree (3) Agree (4) Strongly Agree

Question 20

Know when open-ended questions and closed-ended questions should be used.

Question 21

When participants respond in a particular way regardless of content, this is called:

A) A Likert scale
B) A double-barreled question
C) A semantic differential
D) A response set

Question 22

According to your text, how many points should a rating scale have?

A) Somewhere from 0 to 5 points
B) Somewhere from 1 to 4 points
C) Less than 10 points
D) Somewhere from 4 to 11 points

Question 23

When researchers want to limit who answers a set of questions they often use:

A) A fully anchored rating scale
B) Mutually exclusive response categories
C) Likert scales
D) A contingency question

Question 24

Guy saw the following on a questionnaire: "Males go to question 5, females go to question 15." This is an example of a(n):

A) Open-ended question
B) Contingency question
C) Double-barreled question
D) Leading question

Question 25

Sally is completing a questionnaire. Many times her answer to the question is influenced by what she thinks the researcher would like. This is called:

A) A social desirability response set
B) An acquiescence response set
C) A mutually exclusive response
D) A response anchor

Question 26

A fully anchored rating scale:

A) Includes a descriptor for each point of the rating scale
B) Includes a descriptor only at the end points of the rating scale
C) Must include only five anchored points
D) Uses a semantic differential

Question 27

Which of the following is true about rankings?

A) They cannot be used with open-ended items
B) They cannot be used with close-ended items
C) They require the respondent to rank order a set of responses
D) Ranking is an easy task for respondents

Question 28

Before giving out a questionnaire to be completed by respondents, it is important to:

A) Pilot test the questionnaire
B) Make sure the questionnaire has 5-point rating scales
C) Make sure the responses are all close-ended
D) Make sure you include a checklist in the questionnaire

Question 29

According to your textbook, which of the following is recommended?

A) Try to fit the entire questionnaire on a single page
B) Avoid "multiple response"-type items (designed to elicit multiple answers)
C) Use a small font size
D) Do not put a title on the questionnaire

Question 30

Which of the following is the correct ordering of the steps in questionnaire construction?

A) (1) review the relevant literature and begin planning the questionnaire, (2) write the items for the questionnaire, (3) design the layout and overall questionnaire, (4) conduct a pilot test of the questionnaire, (5) administer your questionnaire in your research study
B) (1) review the relevant literature and begin planning the questionnaire, (2) design the layout and overall questionnaire, (3) write the items for the questionnaire, (4) conduct a pilot test of the questionnaire, (5) administer your questionnaire in your research study
C) (1) review the relevant literature and begin planning the questionnaire, (2) write the items for the questionnaire, (3) conduct a pilot test of the questionnaire, (4) design the layout and overall questionnaire, (5) administer your questionnaire in your research study
D) (1) design the layout and overall questionnaire, (2) review the relevant literature and begin planning the questionnaire, (3) write the items for the questionnaire, (4) conduct a pilot test of the questionnaire, (5) administer your questionnaire in your research study

Question 31

What is the problem(s) with this set of response categories to the question "What is your current age?" 1-5
5-10
10-20
20-30
30-40

A) The categories are not mutually exclusive
B) The categories are not exhaustive
C) The categories are neither mutually exclusive nor exhaustive
D) There is no problem with the above set of response categories

Question 32

Another name for a summated rating scale is:

A) A checklist
B) A semantic differential
C) A Likert Scale
D) A fully anchored rating scale

Question 33

Maria wants to avoid an acquiescence response set. In order to do this she should:

A) Use reverse wording on some of the items
B) Use an exhaustive response set
C) Use mutually exclusive responses
D) Have all the items written so that higher ratings mean agreement with the construct

Question 34

A summated rating scale is best used when attempting to measure:

A) People's rank ordering of items
B) Demographics
C) Abstract concepts
D) Reverse worded items

Question 35

Harry is completing a questionnaire and the researcher has asked him to share his thoughts and perceptions public as he completes the questionnaire. This is known as:

A) The semantic differential technique
B) The think-aloud technique
C) The Likert scale technique
D) The fully anchored rating scale technique

Question 36

Mary read the following question on a questionnaire. "Should teachers be given raises and shorter work days?" She did not know how to answer it. What is the problem with this question?

A) It is a leading question
B) It is an open-ended question
C) It is a double barreled question
D) It is too long

Question 37

William created an item for a questionnaire. It was: "Don't you believe that teachers should earn more money?" What is the problem with this question?

A) It is a leading question
B) It is an open-ended question
C) It is a double-barreled question
D) It is too long

Question 38

When several items are rated and summed together, this is called a:

A) Checklist
B) Summated rating scale
C) Semantic differential
D) Ranking

Question 39

A technique used to measure the meaning participants attach to various attitudinal objects or concepts is called:

A) The semantic differential technique
B) The nonanchored rating scale
C) The mutually exclusive response list
D) The checklist

Question 40

When completing a questionnaire, Howard circled the number corresponding to "strongly agree" for each question. His pattern of responding would be labeled as:

A) A semantic differential
B) An acquiescence response set
C) A Likert scale
D) A fully anchored rating scale

Question 41

Walt is constructing a new questionnaire for his research study. He has reviewed the literature, began planning the questionnaire, and written the items for the questionnaire. His next task should be to:

A) Pilot test the questionnaire and make appropriate changes
B) Consider using the think-aloud technique in order to ensure that the questionnaire works the way it is intended
C) Design the overall layout and overall questionnaire
D) Test the questionnaire again after any changes have been made to it

Question 42

The question, "Please explain how you feel about the new test-preparation program" would most likely appear on a:

A) Quantitative Questionnaire
B) Qualitative Questionnaire
C) Demographic Questionnaire
D) Retrospective Questionnaire

Question 43

The question "Do you agree that we should lower property taxes and provide more county services?" is a:

A) Contingency question
B) Leading question
C) Laded question
D) Double-barreled question

Question 44

Which of the following can help avoid offending participants who feel their voice is not being heard when filling out a questionnaire?

A) Provide more questions
B) Provide exactly the same stimulus for every participant
C) Provide answer pools that the researcher believes are exhaustive
D) Provide open-ended questions

Question 45

A question that suggests a certain preferred answer is a:

A) Loaded Question
B) Leading Question
C) Open-ended Question
D) Closed-ended Question

Question 46

The set of words forming a question or statement is called the:

A) Constructive groupings
B) Item set
C) Anchor set
D) Item stem

Question 47

A question that combines two or more issues or attitude objects in the item stem is a:

A) Loaded Question
B) Leading Question
C) Double-barreled Question
D) Open-ended Question

Question 48

The question: "Don't you agree that special education teachers should earn more money than they currently earn?" is a:

A) Contingency question
B) Leading question
C) Laded question
D) Double-barreled question

Question 49

A question that allows participants to respond in their own words is a:

A) Loaded Question
B) Leading Question
C) Double-barreled Question
D) Open-ended Question

Question 50

Rating scale questions would more likely appear on a(n):

A) Quantitative Questionnaire
B) Qualitative Questionnaire
C) Demographic Questionnaire
D) Open-ended Questionnaire

Question 51

Assume that only the following two answers are allowed on a question concerning solutions to low graduation rates: a) fire teachers and b) make classes more rigorous. What kind of question would this be?

A) Open-ended question
B) Closed-ended question
C) Rating scale question
D) Double-barreled question

Question 52

Web surveys work well with contingency questions because:

A) The electronic format allows participants to be quickly routed to the proper item or questionnaire section after answering each contingency question
B) Most web users are especially careful in completing the questionnaire
C) The electronic format allows the researchers to combine the information from the contingency question and the other questions in a way that allows for reverse wording
D) Contingency questions cannot be used with a regular paper-and-pencil questionnaire

Question 53

A Likert scale is which of the following?

A) Fully-anchored rating scale
B) Numerical rating scale
C) Checklist
D) Summated rating scale

Question 54

Harold has developed a questionnaire. He is preliminarily testing it with volunteers similar to his proposed participants. This is process is called the:

A) Formative test
B) Anchor test
C) Pilot test
D) Norming stage

Question 55

Marley just completed a questionnaire. She disagreed with every item on the questionnaire. This tendency is known as a(n):

A) Response Set
B) Acquiescence response set
C) Social desirability response set
D) Reactivity set

Question 56

Reverse-worded items:

A) Should always be avoided
B) Have been shown to decrease the reliability and validity of a multi-item scale
C) Are not effective in dealing with "response sets"
D) Should include double negatives

Question 57

Kylie was completing a questionnaire. For every answer, she had to choose from a set of predetermined responses. From this information, we know that the questionnaire contained:

A) Loaded Questions
B) Leading Questions
C) Double-barreled Questions
D) Closed-ended Questions

Question 58

A question containing emotionally charged language is a:

A) Loaded Question
B) Leading Question
C) Double-barreled Question
D) Closed-ended Question

Question 59

Lois plans to ask questions about the frequency and intensity of participants' feelings of intolerance and prejudice. One problem that she should particularly worry about here is called _____________.

A) Acquiescence response set
B) Social desirability response set
C) Reverse worded response set
D) Improperly organized response set

Question 60

Which of the following statements is a double negative?

A) Please give no attention to the following words after this statement.
B) Which represents the worse influence on student behavior?
C) Do you not see that no reading program can improve student learning?
D) Can you please fully describe the results of non-participation in this program?

Question 61

A questionnaire should have a relatively high degree of difficulty because this will help ensure that the participants are actively engaged in the process of filling out the questionnaire.

Question 62

Questionnaires can include retrospective and prospective questions.

Question 63

Age and years completed in school are examples of questions that do not need mutually exclusive response categories.

Question 64

For the following rating scale: 1 2 3 4 5 6 7 8 9 10; What is the midpoint of the scale

A) 5
B) 6
C) between 5 and 6
D) It cannot be determined

Question 65

The checklist for questionnaire development suggests the use of all of the following except:

A) Titles
B) Multiple response questions
C) Short questions
D) Page numbers

Question 66

Research has indicated that shorter questions are more effective on questionnaires than longer questions.

Question 67

The final step in questionnaire construction is pilot testing.

Question 68

The question, "Please report the number of times you study in a week" followed by a choice of 0, 1, 2, 3, 4, 5, 6, or 7 is an example or which type of question?

A) Behavior
B) Opinion
C) Process
D) Background

Question 69

Because abstract concepts are so difficult to pin down it is best to identify one clear method with which you will measure the construct and use that method exclusively.

Question 70

The ordering of categories (positive to negative or negative to positive) in rating scales does not affect response patterns.

Question 71

A difference between a numerical rating scale and a fully anchored rating scale is that the latter scale has a descriptor on all points on the scale.

Question 72

Ideally, rankings should only be used with 3 to 5 items.

Question 73

Mutually exclusive categories do not overlap.

Question 74

Exhaustive categories include all possible responses.

Question 75

If the literature review finds a questionnaire that meets the researcher's needs, he or she does not need to create a new questionnaire.

Question 76

The question, "Please describe how you chose your current major" is which type of question?

A) Knowledge
B) Opinion
C) Process
D) Background

Question 77

When constructing a questionnaire:

A) The appearance of the questionnaire is not relevant.
B) Small fonts should be used to get a lot of information on a page.
C) Instructions should be clear
D) Questions should be broken across pages

Question 78

The first step in constructing a questionnaire is:

A) Review the literature that is relevant to the topic
B) Write items for the questionnaire
C) Conduct a pilot study
D) Design to layout and overall questionnaire

Question 79

A mixed questionnaire contains:

A) Loaded and double-barreled questions
B) Factual and opinion questions
C) Questions answered by ratings scales and rankings
D) Open-ended and closed-ended questions

Question 80

The question, "Do you think that students should be able to drop out of school at age 16" is which type of question?

A) Knowledge
B) Opinion
C) Process
D) Background