Designing Curriculum

Design Test / Evaluation Questions

By Algerd Moscosa

Learning Objectives

By the end, you will be able to:

1. Understand the importance of well-designed test questions.

2. Identify different types of test and evaluation questions.

3. Apply best practices in designing effective assessment items.

Open Ended

How do the types of questions we design impact student learning and the accuracy of our assessments?

Importance of Test and Evaluation Questions

Ensure alignment with learning objectives.

• Well-structured questions assess what was intended to be taught.

• Questions should directly measure the competencies outlined in the curriculum.

• Poorly aligned questions can mislead assessment results and fail to provide meaningful feedback.

Importance of Test and Evaluation Questions

Measure student understanding effectively.

• Properly designed questions help gauge comprehension beyond memorization.

• Ensuring a range of cognitive skills is assessed, from recall to application and analysis.

• Differentiating between surface-level understanding and deep comprehension.

Importance of Test and Evaluation Questions

Provide feedback for instructional improvement.

• Helps educators identify gaps in student learning and adjust teaching strategies.

• Assessment data should be analyzed to refine future instruction and curriculum design.

• Timely feedback allows students to understand their strengths and areas for improvement.

Importance of Test and Evaluation Questions

Differentiate between various levels of cognitive skills.

• Allows assessment of higher-order thinking, not just recall.

• Incorporating Bloom’s Taxonomy to ensure students are tested on a spectrum of learning skills.

• Encouraging critical thinking, problem-solving, and real-world application of knowledge.

Word Cloud

Now that we understand the importance of well-designed test and evaluation questions, what are the different types of questions we can use to assess student learning effectively?

Types of Test and Evaluation Questions

Objective Type

Provide a stem and several answer choices with one correct answer.

Multiple-choice questions (MCQs)

Simple statements requiring students to determine correctness.

True/False

Pairs related concepts for students to link correctly.

Matching Type

Requires students to recall key terms or concepts.

Fill-in-the-Blanks

Poll

Which objective question format do you most frequently use in your classroom assessments? Why do you prefer this type?

• Multiple-Choice Question

• True / False

• Matching Type

• Fill-in-the-Blanks

Subjective Type

Require brief but precise responses.

Short-answer questions

Encourage in-depth explanations, reasoning, and critical thinking.

Essay questions

Performance-Based Assessments

Collections of student work demonstrating learning progress.

Portfolios

Task-based assessments that integrate various skills.

Projects

Hands-on evaluations requiring demonstrations of skills.

Practical tasks

Open Ended

Which type of test and evaluation question do you find easier to use and more frequently applied in your classroom: objective or subjective? Why?

Designing Effective MCQs

Avoid unnecessary complexity or ambiguity.

Write clear and concise stems.

Negatively worded questions can confuse students and lead to misinterpretation.

Avoid using negative phrasing.

All answer choices should be reasonable to prevent easy elimination.

Ensure plausible distractors.

Avoid patterns or unintentional cues.

Keep answer choices balanced and fair.

Ensure all choices are of similar length and complexity.

Avoid giving clues in the answer choices.

Multiple Choice

Which of the following multiple-choice questions violates the principle of keeping answer choices balanced and fair?

Best Practices for Subjective Questions

Clearly define what students need to answer or discuss.

Use clear and direct prompts.

Ensure questions measure intended skills or knowledge.

Align with learning objectives.

Define clear criteria for evaluating responses.

Provide rubrics for grading consistency.

Design questions that require explanation, justification, or analysis.

Encourage critical thinking and application.

Writing Performance-Based Assessments

Provide detailed rubrics and guidelines.

Define clear criteria and expectations.

Design tasks that simulate actual challenges students may face.

Provide real-world or authentic tasks.

Predefined criteria ensure objective and fair grading.

Use rubrics for evaluation.

Predefined criteria ensure objective and fair grading.

Incorporate self and peer assessment.

Common Mistakes to Avoid

Poorly phrased questions can confuse students.

Ambiguous wording.

Poorly phrased questions can confuse students.

Ambiguous wording.

Avoid making questions unnecessarily difficult or too simple.

Unfair difficulty levels.

Avoid making questions unnecessarily difficult or too simple.

Unfair difficulty levels.

Prioritize questions assessing understanding and application.

Overuse of rote-memorization questions.

Prioritize questions assessing understanding and application.

Overuse of rote-memorization questions.

Ensure fairness across diverse student backgrounds.

Bias or culturally insensitive content.

Ensure fairness across diverse student backgrounds.

Bias or culturally insensitive content.

Every question should connect to curriculum objectives.

Lack of alignment with learning goals.

Every question should connect to curriculum objectives.

Lack of alignment with learning goals.

Multiple Choice

What is the mistake?

• The question is too broad and lacks precision.

• The question does not align with any learning objective.

• The answer choices are too obvious.

• The question is too easy for the grade level.

Multiple Choice

What is the mistake?

• The question assumes all students have the same cultural background.

• The answer choices are not fair and balanced.

• The question is not relevant to science.

• The question is too difficult for students.

Aligning Questions with Bloom’s Taxonomy

Open Ended

What is your understanding of the difference between 'Assessment for Learning' and 'Assessment of Learning'? How do you currently use these in your classroom?

Measures overall learning achievements at the end of instruction.

"OF" (Summative)

Helps students understand their progress and areas for improvement.

"FOR" (Formative)

Assessment FOR Learning
vs.
Assessment OF Learning

Examples: Quizzes, discussions, reflections, peer feedback.

Examples: Final exams, projects, standardized tests.

CASE STUDY

analyze real-world assessment challenges and apply best practices to improve test design

Open Ended

Identify the major flaws in Mr. Rivera’s test design.

Open Ended

How could these questions be revised to improve clarity, fairness, and alignment with learning objectives?

Open Ended

Why is it important to balance question difficulty in an assessment?

Open Ended

How can cultural sensitivity be ensured when designing test items?

SUMMARY

Incorporating multiple formats provides a more complete picture of student understanding.

Use a mix of question types for comprehensive evaluation.

Good questions promote student engagement and accurate measurement of learning.

Well-designed test questions enhance learning and assessment accuracy.

SUMMARY

Regular assessment updates help maintain quality and relevance.

Continuously review and improve test items.

Ensures that tests truly measure intended outcomes.

Align assessments with learning objectives.

QUIZ TIME!!

Multiple Choice

A teacher is preparing a lesson on test design and wants to start by ensuring students understand the basic definitions of assessment types. To check students' understanding, the teacher asks them to differentiate between formative and summative assessments.

Question: What is the primary purpose of formative assessment?

• To measure overall student achievement at the end of instruction.

• To rank students based on performance compared to peers.

• To provide ongoing feedback for learning improvement.

• To replace summative assessments in grading systems.

Multiple Choice

A school administrator is conducting a review of different assessments used by teachers. The goal is to categorize them as either formative or summative based on their purpose. The administrator comes across a test that is conducted at the end of a semester and contributes to the final grade.

Question: Which of the following is an example of a summative assessment?

• A weekly self-reflection journal.

• A final end-of-term examination.

• A peer evaluation checklist.

• A teacher’s informal observation notes.

Multiple Choice

A teacher notices that students have different responses to essay questions. Some students provide in-depth explanations, while others only list key points without justification. The teacher decides to discuss why essay questions are useful for assessing critical thinking.

Question: Why are essay questions effective for assessing higher-order thinking skills?

• They allow students to demonstrate factual recall without explanation.

• They require detailed analysis, reasoning, and argument construction.

• They are easier to grade objectively than multiple-choice questions.

• They reduce the time needed to complete an assessment.

Multiple Choice

A new teacher is designing multiple-choice questions but finds that students often guess answers rather than thinking critically. The teacher consults a mentor, who advises ensuring that incorrect answer choices (distractors) are well-designed so that students must apply knowledge rather than eliminate obviously wrong answers.

Question: What makes a distractor in a multiple-choice question effective?

• It is obviously incorrect so students can eliminate it easily.

• It is of similar length and plausibility as the correct answer.

• It is unrelated to the topic to confuse students.

• It contains grammatical clues that hint at the correct answer.

Multiple Choice

A teacher wants to ensure that the test questions in an upcoming exam align with the learning objectives of a unit on environmental sustainability. One objective states: "Students will analyze the effects of human activities on the water cycle." The teacher needs to choose a question that effectively assesses this objective.

Question: Which of the following test items best assesses critical thinking skills?

• "List the steps of the water cycle in order."

• "Identify the correct definition of photosynthesis."

• "Explain how human activities impact the water cycle."

• "Match the terms with their correct definitions."

Multiple Choice

After grading a recent exam, a teacher notices that most students got one particular question wrong. The teacher is unsure if the question was too difficult or if students genuinely lacked understanding of the topic. The teacher considers strategies to determine whether the test item was unfair.

Question: What is the best way to determine if a test question is unfairly difficult?

• Ask students to explain why they chose their answers.

• Compare the question’s difficulty to the rest of the test.

• Ensure the question is the longest in the test.

• Make the question worth more points to adjust difficulty.

Multiple Choice

A teacher creates the following multiple-choice question:
"Which of the following is NOT a renewable energy source?"
A. Solar Energy
B. Wind Energy
C. Fossil Fuels
D. Hydropower

During the test, students express confusion over the word "NOT", and some misinterpret the question, leading to errors. The teacher realizes that negative wording can make questions unclear.

Question: Why should negative phrasing be avoided in test questions?

• It makes the correct answer obvious to all students.

• It increases test reliability and validity.

• It can confuse students and lead to misinterpretation.

• It ensures the question is challenging enough.

Multiple Choice

A school principal wants teachers to use a variety of assessments to measure student learning. Some teachers rely mostly on multiple-choice tests, while others prefer essays and projects. The principal wants an assessment method that measures students’ ability to apply knowledge in real-world contexts.

Question: Which assessment type is best for evaluating students' ability to apply knowledge in real-world contexts?

• Multiple-choice tests

• Performance-based assessments

• True/False quizzes

• Fill-in-the-blank worksheets

Multiple Choice

A test question asks, "What is the capital of France?" with the following options:

A. Paris
B. Paris
C. Berlin
D. Rome

After reviewing the test, a colleague points out a flaw in the answer choices that could confuse students and make the test question invalid.

Question: What is the main issue with this question?

• The options are not in alphabetical order.

• The answer choices are too difficult.

• A distractor is missing from the choices.

• A duplicate answer is included, creating confusion.

Multiple Choice

A science teacher wants to create an assessment that goes beyond simple recall and requires students to propose a solution to an environmental issue. The teacher considers different types of questions to ensure the assessment aligns with the learning objective of developing problem-solving skills.

Question: Which test item best assesses students’ ability to generate and evaluate solutions?

• "Define the term 'carbon footprint'."

• "List three causes of air pollution."

• "Propose a sustainable plan to reduce carbon emissions."

• "Match the pollutants with their sources."

References

• General Guidelines for Creating Assessments

  • https://cei.umn.edu/teaching-resources/assessments/general-guidelines-creating-assessments

• Bloom’s Taxonomy Overview

  • https://fctl.ucf.edu/teaching-resources/course-design/blooms-taxonomy/

• Taxonomies of Learning

  • https://bokcenter.harvard.edu/taxonomies-learning