How to Write Multiple-Choice Questions

by John Soares on January 24, 2012

Multiple-choice test questions are one of the most widely used methods of testing students’ knowledge. If you are a freelance writer for higher education or K-12 companies, you could be writing student assessment questions for a test bank, for a student study guide, or for a student companion website — or you may be a teacher creating your own tests.

I’ve been writing test questions for 20-plus years for at least a fifty different college textbooks published by companies like Pearson Education, Cengage, and McGraw-Hill, and in disciplines ranging from history and political science to geography, earth sciences, and biology. In those two decades I’ve probably written 50,000 or more multiple-choice questions.

I’ve also been a student of how to create the best questions, and I’ve distilled all my experience and knowledge in the 30 techniques below.

Note: I’ll update this post frequently as I come up with even more suggestions. I work on at least a half-dozen higher education projects every year that require writing these types of assessment items.

Defining Multiple-Choice Question Parts

The stem is the initial part of the question.

The options are the various answers from which the student chooses; they are usually designated sequentially with letters from A through D or E. They are also called distractors.

1. Stem
A. Option A
B. Option B
C. Option C
D. Option D
E. Option E

30 Techniques for Writing Quality Multiple-Choice Questions

1. Imagine you are the student taking the test.

This shouldn’t be too hard to do. You were a student once, right? You wanted a fair test then, so now that you are  the one writing the questions…

2. Make sure the questions are fair.

Questions should be easy to understand and they should only address information and skills that a student will have read in the textbook or encountered in other learning materials associated with the course.

3. Make sure the questions adequately test all the important material.

Don’t focus too much on specific parts of a chapter to the exclusion of other parts of a chapter. I’ve seen this far too often when I update an existing test bank/test-item file. For example, a chapter with 20 pages of text (excluding the introduction and end matter) that requires 40 multiple-choice questions per chapter should have roughly two questions per page, not 20 questions covering the first five pages and 20 questions covering the last 15 pages.

4. Follow guidelines from your editor.

When you get an assignment to write questions for a textbook or any other higher education or K-12 course material, your editor will likely give you a set of guidelines for number of questions per chapter, formatting, and perhaps other things such as indicating difficulty level and having a certain percentage of questions that are factual and a certain percentage that are some type of analytical/application/critical thinking. Follow those guidelines! Ask your editor for clarification if there’s anything you don’t understand.

5. Respect Bloom’s Taxonomy.

Bloom’s Taxonomy delineates six different types of assessment questions: remembering, understanding, applying, analyzing, evaluating, and creating. Not all are applicable to multiple-choice questions, especially creating, but in recent years more editors and higher-education companies ask freelance writers to create specific percentages of certain types of questions. (Read more about Bloom’s Taxonomy here; and I’ll have much more to say about Bloom’s Taxonomy in future posts.)

6. Put as much of the question as possible into the stem.

Most questions deal with a problem or ask for a specific response, so put that in the stem; this makes it easier for students to grasp the question.

7. Write the stem as a complete question when possible.

Again, this makes it easier on the test taker. It also makes it easier on you once you get used to it.

8. If you put a blank in the stem, try to put it at the end.

Of course, this isn’t always feasible; just make sure students aren’t confused. By “blank,” I mean an underscore line.

9. Make the stem blank roughly the size of the options.

Do this unless the options are all fairly long, and then go with a blank size that fits well with the stem.

10. Have the grammar and punctuation of each option match that in the stem.

Otherwise you can give away the answer to the perceptive student.

11. Bold and capitalize important words that are crucial for understanding the question.

I almost always put the following words in bold and capital letters: NOT, EXCEPT, LEAST, MOST. This helps students focus on what they need to consider to answer the question correctly.

12. Write questions with five options when possible.

This is more difficult than writing questions with only four options, but it decreases the percentage of correct answers for a random guesser. Typically, when you’re writing a test-item file, you need to be consistent with the number of options, and creating five is obviously more difficult than creating four.

13. Keep the options roughly the same length when feasible.

Especially take care that the correct answer is not substantially longer than the incorrect answers, or at least only rarely so.

14. Keep the language in the options as simple as possible.

You are testing for knowledge, not reading comprehension. Remember that many students taking the test are not native English speakers, and some may have only recently come to your country to study.

15. Avoid expressions that are culturally specific.

You can’t assume that all students have watched a particular TV program or know who a certain singer is.

16. Be consistent with formatting.

This includes how you punctuate the stem and options, and also other areas, such as student feedback and correct-answer indication.

17. Avoid using language directly from the textbook.

Sometimes it’s the best choice, but make it rare. Also make sure your editor says it’s OK. Mine always have, but they prefer I don’t.

18. Make the incorrect answers/options sound as plausible as possible.

You want to keep those persons who didn’t study enough from getting a higher score than they deserve.

19. Minimize using absolute words—always, never, all, none—in an option.

Test-smart students have learned that such options are rarely correct.

20. Have only one correct or obviously best answer.

It’s not fair to students to have an ambiguous question or a question with two right answers.

21. Be especially careful with numbers and percentages as options.

If you don’t pay strict attention, more than one option will be correct.

22. Place answer options in logical order from smallest to largest, earliest to latest, etc. when applicable.

This makes the question as clear as possible. If you are using test-generation software, see if you can turn off answer randomization on such questions and thus lock the answers in the order you want.

23. Use the term “NOT” in the stem only when there are no better options available for stating the stem in the positive voice.

Questions with “not” in the stem are typically a small minority of the questions a student faces, so they can potentially cause momentary mental confusion, or the student may not see “not” at all. When you do use it, capitalize and bold the entire word: “NOT.”

24. Assure that each of the possible option-choice letters is the correct one roughly 20 percent of the time when there are five options and 25 percent of the time when there are four options.

Otherwise students may notice a pattern to test and quiz answers over time. If a student figures out that “C” is the correct choice half the time, they can guess this when they don’t know the actual answer to a question.

25. To test for understanding and the ability to interpret and apply knowledge, use “why,” “which,” and “how” questions.

You can also give a hypothetical situation in the stem and then test for understanding in the options by using resolutions or explanations of the hypothetical situation. (See also the tip about Bloom’s taxonomy above.)

26. To test for factual knowledge, use “who,” “where,” and “when” questions.

These are usually the easiest questions to write. However…

27. For factual questions, be sure that the fact is not trivial.

There may be a thousand different facts in a textbook chapter. There is no way a student can memorize all of them, so test on what is truly important and what a student can reasonably be expected to know.

28. “None of these.”

First make sure you use “these” and not “above.” Test bank software often randomizes answers, so you cannot assume that what you put in the final option (“D” if there are four options, “E” if there are five options) will stay there. Second, “none of these” should be the correct answer about 20 percent of the time if there are five options and 25 percent of the time if there are four options. Third, be sure that when “none of these” is the correct answer, that none of the other options is partially correct. Also, check first about using “none of these”; some editors will not want you to use these types of questions at all.

29. “All of these.”

Try to avoid this type of question if possible. Use “all of these” questions only when you have to write so many multiple-choice questions that you think you will have difficulty coming up with enough for each chapter. If you do use “all of these,” the same guidelines and caveats given for “none of these” apply. (And, of course, don’t use “all of the above.”)

30. Avoid writing questions with two or more correct answers

They can be useful as a testing tool, but they are confusing to students and difficult to adapt in the software many companies use to create test banks.

This post is based on Chapter 10, “Creating Test Banks,” from John Soares’ ebook Writing College Textbook Supplements: The Definitive Guide to Winning High-Paying Assignments in the College Textbook Publishing Market.

Your Take

What are your thoughts on my tips? What would you add? Share in the comment section below…

Like this post? Then please help me out and share it on Twitter, Google+, LinkedIn, Facebook, and elsewhere. And don't miss any Writing College Textbook Supplements posts: subscribe by e-mail or subscribe by RSS.

    { 13 comments… CLICK HERE to add one }

    Summer Time is Prime Time for Higher Education Writing Projects

    by John Soares June 21, 2012

    Tweet Summer is prime time for winning freelance writing jobs to create supplements and ancillaries for higher education/college textbooks and courses. Editors Are Scrambling to Get Ancillaries Ready for Fall Supplements need to be revised with each new edition of a textbook. Publishers time the release of new editions to coincide with the beginning of [...]

    CLICK HERE to read the full article

    The Biggest Problem I See When I Revise Test Banks

    by John Soares June 6, 2012

    Tweet I’ve written many thousands of multiple-choice, true- false, and essay questions in my 20-plus years as a freelance writer for higher education publishers. Frequently I’m hired to revise an existing textbook supplement, often a test bank. This occurs when a new edition of the textbook is issued and test questions have to added, deleted, [...]

    CLICK HERE to read the full article

    Best Ways to Improve Your Freelance Writing

    by John Soares November 29, 2011

    Tweet As many of you know, I dish out plenty of advice on how to get your writing done faster and better over at my ProductiveWriters.com blog. In this post I feature the best PW articles that will make the biggest difference in helping you get your textbook supplements projects done quickly and well. Each [...]

    CLICK HERE to read the full article

    What You Need to Complete Your Textbook Supplement Project

    by John Soares October 27, 2011

    Tweet When you create or revise test questions or a lecture outline or a student study guide for a textbook, you’ll need a variety of materials, printed and electronic. Here’s a list of all the potential items you could need for a college textbook supplement or ancillary project in order to do a great job [...]

    CLICK HERE to read the full article

    Pay Rates for Multiple-Choice Questions

    by John Soares September 29, 2011

    Tweet The pay rates for multiple-choice questions that you write for a textbook or a learning manual can vary greatly. I recently answered the following forum question inside the Freelance Writers Den: “I have a potential opportunity to write 250 multiple-choice questions about a topic I know well, but I have no idea how long [...]

    CLICK HERE to read the full article

    Writing a Textbook Supplement in the Woods…

    by John Soares August 15, 2011

    Tweet I’m heading out for a three-day camping trip in the mountains to the west of Mount Shasta. Why? So I can finish lecture outlines for a science textbook. The project’s due on Friday, and I need to shield out all distractions. I just wrote about  it over at my Productive Writers blog. Please head [...]

    CLICK HERE to read the full article

    My Guest Post and Live Call About Writing College Textbook Supplements

    by John Soares July 5, 2011

    Tweet I hope my American readers all had a great Fourth of July. I definitely did! I have two important announcements this week… 1. My Guest Post on Carol Tice’s Blog Please go read my guest post on Carol Tice’s Make A Living Writing blog about the important aspects of writing college textbook supplements. Carol [...]

    CLICK HERE to read the full article

    When Editors Don’t Get Back to You

    by John Soares May 12, 2011

    Tweet One aspect of being a freelance writer is dealing with rejection, and also dealing with silence, which sometimes means rejection but oftentimes does not. Here’s an e-mail I received a while back from a purchaser of Writing College Textbook Supplements who was diligently applying my advice on how to connect with editors at textbook [...]

    CLICK HERE to read the full article

    Announcing the 2nd Edition of Writing College Textbook Supplements

    by John Soares March 23, 2011

    Tweet I’m very pleased to announce that I’ve just completed.. Writing College Textbook Supplements: The Definitive Guide to Winning High-Paying Assignments in the College Textbook Publishing Market, second edition. In the book I cover everything you need to know, from how to find editors to how to get paid well to how to actually create [...]

    CLICK HERE to read the full article