MCQ Tips & Tricks

Universal

Pros and Cons

Goals

• recognize the common mistakes made in constructing MCQs
• identify the utility of an exam blueprint and item analysis
• employ OAKS quiz features to reduce cheating in online assessments

Plan

• overview of MCQs & first steps in exam creation
• interactive identification of question weaknesses or flaws
• tips for evaluating questions
• OAKS features

Remove all the barriers that will keep a knowledgeable student from answering the item correctly...Remove all clues that will help a less-than-knowledgeable student answer the item correctly.
-Suskie, 2009

A study from the NBME showed that violations of the most basic item-writing principles are very common in medical education tests.

-Jozefowics et al., 2002

Professional test item writers plan on one hour or more to write one good item.

-Van Hoozer, 1987

pollev.com/woodlief

Learning Objectives

Good test question writing begins with identifying the most important information or skill that is to be learned.

- Collins, 2006

Untitled Slide

Untitled Slide

LOOKOUT!

Untitled Slide

• Correct wording and grammar
• Avoid negatives
• Avoid absolutes
• Succinct, yet complete, stem
• Use plausible distractors
• Avoid imprecise terms

Untitled Slide

• # of options - 3, 4, or 5?
• keep questions independent
• question order

pollev.com/woodlief

Blueprint

Item Evaluation

OAKS Quiz Features

Untitled Slide

• Randomize
• Multi-select
• Pool questions
• Prevent moving backwards
• Group questions
• Time limit

Summary

• Pros and Cons
• Alignment with learning objectives and Bloom's
• Anatomy of a MCQ
• Common flaws
• Tips for constructing an exam
• Options in OAKS

Questions?