Elsie Item-Writing Academy
About 45 minutes · Academy module: Flaw Clinic: MCAT — The Nine Flaws That Break a Four-Option Item
Unofficial faculty-development resource. Not affiliated with, endorsed by, or representing the AAMC, NBME, USMLE, LCME, or NRMP. Supports faculty-development documentation.
Most flawed items are not wrong; they are noisy. A flawed multiple-choice item lets a test-taker arrive at the key without knowing the content — or punishes a test-taker who does. The item-writing literature calls these item flaws, and they fall into a small, learnable taxonomy. This module walks the taxonomy at the MCAT level, where four options and a pre-medical audience mean every flaw is magnified: a single clued distractor can shift an entire cohort's score distribution.
Absolute terms. Stems or options built on "always," "never," "all," or "none" are nearly always the flaw rather than the content. Test-wise students learn to eliminate absolutes on sight, which means the item rewards test-taking strategy instead of knowledge — and worse, a sophisticated student can sometimes find a genuine counterexample and correctly defend a different answer. State claims precisely instead: give conditions, ranges, or "most likely" framing.
"All of the above" / "none of the above." These two options corrupt the item's logic. "All of the above" lets a student who recognizes two correct options skip evaluating the third; "none of the above" turns every item into a proof-of-nonexistence exercise. Both also complicate item analysis: a distractor-pull statistic for "all of the above" tells you nothing about which misconception drew students. Retire them; write four real options instead.
Grammatical cueing. The key must agree with the stem grammatically — but so must every distractor. If the stem ends "…is an example of a(n)" and only one option begins with a vowel, the article has handed away the answer. Read each option into the stem before finalizing.
Negative stems without emphasis. A stem that asks what is not true, with the negation buried in plain text, tests proofreading more than science. If a negative stem is truly needed, the negative word goes in ALL CAPS (NOT, EXCEPT, LEAST), and the options stay homogeneous.
Unfocused stems. "Which of the following is true regarding enzymes?" cannot be answered until the options are read — the stem carries no task. A focused stem poses one clear question: "Which pattern of Km and Vmax change best describes competitive inhibition?" Students should be able to cover the options and still know what is being asked.
Window dressing. MCAT passages already carry load; the item stem must not add more. Names, backstories, and colorful details that do not change the answer inflate reading time and can accidentally cue. Strip the stem to what the solver needs.
Clueing between stem and options. Verbal echoes — the stem says "energy currency" and one option says "ATP is the cell's energy currency" — let students match words instead of reasoning. Distractors should be wrong for content reasons, not because they lack the stem's vocabulary.
Two defensible answers. If a content expert can argue a second option, the item has no key; it has a dispute. Every rewrite in this module was submitted to two independent cold solves: the rewrite ships only if both solvers pick the intended key and neither can defend another option.
Implausible distractors. An option no prepared student would choose is dead weight — it inflates the guessing odds on the remaining three and wastes the distractor analysis. Every distractor should be selectable by someone with a real, nameable misconception.
---
Flawed item (intended key: A)
Which of the following statements about enzyme inhibition is always true?
A) A competitive inhibitor always increases Km. B) A noncompetitive inhibitor never changes Km. C) An uncompetitive inhibitor always decreases both Km and Vmax. D) An irreversible inhibitor never binds the active site.
Flaw taxonomy label: Absolute terms ("always"/"never") — compounding into two defensible answers.
Correction: Every option leans on an absolute, so the item tests absolutist phrasing rather than kinetics. Worse, the absolutes create a genuine dispute: option C is also correct in content (uncompetitive inhibition does lower both Km and Vmax), so a knowledgeable student can defend C while the key says A. The fix is to drop the absolutes, ask one focused question about a single data pattern, and let the options be four parallel mechanism names with no qualifiers to hide behind.
Model rewrite — cold-solve verified: 2/2 (solver 1: B, solver 2: B)
A laboratory measures the kinetics of an enzyme in the presence of a fixed concentration of an inhibitor. The Michaelis constant (Km) is increased while the maximum velocity (Vmax) is unchanged relative to the uninhibited reaction. Which type of inhibition does this pattern best describe?
A) Noncompetitive inhibition B) Competitive inhibition C) Uncompetitive inhibition D) Irreversible inhibition
Key: B
Flawed item (intended key: C)
Which of the following organelles contain their own DNA?
A) Mitochondria B) Chloroplasts C) All of the above D) None of the above
Flaw taxonomy label: "All of the above" / "none of the above."
Correction: Option C lets a student who recognizes mitochondria alone select the key without ever evaluating chloroplasts — partial knowledge earns full credit. And if this item ever anchors a set, its distractor statistics are uninterpretable: a pull on "all of the above" cannot tell you which organelle students misunderstood. The repair is structural, not cosmetic: retire both pseudo-options and write four genuine alternatives, so each option must be evaluated on its own content.
Model rewrite — cold-solve verified: 2/2 (solver 1: C, solver 2: C)
Which organelle is the principal site of oxidative phosphorylation in eukaryotic cells?
A) Smooth endoplasmic reticulum B) Golgi apparatus C) Mitochondrion D) Lysosome
Key: C
Flawed item (intended key: D)
Maya is a 29-year-old marathon runner training in the Arizona desert. After a long run on a hot afternoon, she drinks a citrus-flavored sports drink and wonders about the chemistry of her sweat. She recalls from her undergraduate chemistry course that buffers resist changes in pH. A solution contains 0.10 mol of a weak acid (Ka = 1.0 × 10⁻⁵) and 0.10 mol of its conjugate base in 1.0 L of solution. Given Maya's interest in exercise physiology, what is the pH of this solution?
A) 3.0 B) 4.0 C) 5.3 D) 5.0
Flaw taxonomy label: Window dressing.
Correction: Maya, the desert, the sports drink, and the citrus flavor change nothing about the calculation — they add reading load and one accidental cue channel (a tired reader may anchor on "citrus" and reach for an acidic answer). The stem's job is to present the buffer and ask for its pH. Everything else is cut; the numbers and the question remain.
Model rewrite — cold-solve verified: 2/2 (solver 1: D, solver 2: D)
A solution contains 0.10 mol of a weak acid (Ka = 1.0 × 10⁻⁵) and 0.10 mol of its conjugate base in 1.0 L of solution. What is the pH of this solution?
A) 3.0 B) 4.0 C) 5.3 D) 5.0
Key: D
---
Recording it adds the module to your Academy completion record on this device — module, track, level, and date, ready to download from your account page for faculty-development documentation.