Guide

How to read test results like an exam board

Scores tell you about people. Item analysis tells you about your questions. Three numbers are enough to find and fix the weak ones.

1. Difficulty: how many people got it right

Difficulty is simply the percentage of people who answered correctly. Between about 30% and 85% is usually healthy. Above 95%, the question tells you almost nothing because everyone gets it. Below 20%, check the answer key first: the most common cause of a “very hard” question is a mistake in the key.

2. Discrimination: does it separate strong from weak?

Discrimination compares how people did on one question with how they did on the rest of the test. A good question is answered correctly more often by people who did well overall. Values above 0.30 are good; 0.15–0.30 is acceptable; below 0.15 the question isn’t doing much; and a negative value means strong candidates are getting it wrong. That almost always means confusing wording or a wrong answer key.

3. Distractors: which wrong answers people chose

For multiple-choice questions, look at how often each wrong option was picked. A wrong option nobody chooses should be replaced with a more realistic mistake. A wrong option that strong candidates choose more than weak ones may actually be correct, or the question may be ambiguous.

What to do with a problem question

Wait for at least 20–30 people before acting on these numbers; with only a handful, results bounce around. For overall test quality, read test reliability explained.

Put this guide into practice.

Build your question bank and send your first test free.

Start free

More guides

Free resources