Identifying Flawed Multiple-choice Items

For each item or pair of items, decide what is wrong or which item is better and why. When you have come to a conclusion, "hover" your mouse button over the center of the blue rectangle below the question. If the answer isn't revealed, see the answers at the bottom of the page.

1A. The promiscuous use of sprays, oils, and antiseptics in the nose during acute colds is a pernicious practice because it may have a deleterious effect on:

a. the sinuses
b. red blood cells
c. white blood cells
d. the olfactory nerve

1B. Frequent use of sprays, oils, and antiseptics in the nose during a bad cold may result in:

a. the spreading of the infection to the sinuses
b. damage to the olfactory nerve
c. destruction of white blood cells
d. congestion of the mucous membranes in the nose

Which is the better question?

1B is better.

Why is it better?

The stem of 1A is long, difficult to read, and has unfamiliar words.

2A. In 1965, the death rate from accidents of all types per 100,000 population in the 15 - 24 age group was:

a. 59.0
b. 59.1
c. 59.2
d. 59.3

2B. In 1965, the death rate per 100,000 population in the 15 - 24 age group was due to:

a. respiratory disease
b. cancer
c. *accidents
d. rheumatic heart disease

Which is the better question?

2B is better.

Why is it better?

Options in 2A are too specific; they indicate to students that exact numbers are important.

3A. About how many calories are recommended for a 14-year old who is 62 inches tall, weighs 103 pounds, and is moderately active?

a. 1,500
b. 2,000
c. 2,500
d. 3,000

3B. About how many calories are recommended for a 14-year old who is 62 inches tall, weighs 103 pounds, and is moderately active?

a. 0
b. 2,000
c. 2,500
d. 3,000

Which is the better question?

3A is better.

Why is it better?

Option a in 3B is absurd; students can automatically eliminate it.

4. In what year did the United States enter World War II?

a. 1976
b. 1861
c. 1941
d. 1862

What is wrong with the question?

Choices are too dissimilar and not in order.

How can it be improved?

Make choices more plausible; put years in chronological order.

5. A buyer who has NOT purchased from ABC Company in the past is MOST LIKELY to buy from ABC Company when the buyer is engaging in:

a. Straight rebuy buying.
b. Selective buying.
c. New-task buying.
d. Selective task buying.
e. Modified rebuy buying.

What is wrong with the question?

Without content knowledge, test-takers can choose c, which is correct.

How can it be improved?

To revise, use definitions as the response and a term as the stem.

More improvement details...

Which scenario BEST defines.... Easier to write scenarios than alternative terms.

ANSWER KEY

1B is better. The stem of 1A is long, difficult to read, and has unfamiliar words.

2B is better. The options in 2A are too specific; they tell students that exact numbers are important.

3A is better. Option a in 3B is absurd; students can automatically eliminate it.

Question 4: The choices are too dissimilar and not in order. Make choices more plausible; put years in chronological order.

Question 5: Without content knowledge, test-takers can choose c, which is correct. To revise, use definitions as the response and a term as the stem. Alternatively, which scenario BEST defines...? It's easier to write scenarios than alternative terms.