Understanding the Utility Index in Assessment Systems

What are the components of the original utility index described by Cees van der Vleuten?

• A) Reliability, Validity, Educational impact, Cost efficiency, Acceptability

• B) Reliability, Validity, Educational impact, Cost efficiency, Feasibility

• C) Reliability, Validity, Educational impact, Acceptability, Feasibility

• D) Reliability, Validity, Cost efficiency, Acceptability, Feasibility

Which component was added as an additional sixth component to the utility index?

• Reliability

• Validity

• Feasibility

• Cost efficiency

Fill in the blank: The purpose of both the overall assessment system and its individual assessment instruments must be clearly defined for ________.

• PMETB

• Reliability

• Validity

• Educational impact.

Fill in the blank: The utility index helps in reviewing assessment programs to ensure all components are ________.

• A) Addressed

• B) Ignored

• C) Simplified

• D) Complicated

What is the effect of trainee nervousness on reliability?

• It increases reliability

• It decreases reliability

• It has no effect

• It stabilizes reliability.

Fill in the blank: A perfectly reproducible test would have a reliability coefficient of ________.

• A) 0.5

• B) 0.8

• C) 1.0

• D) 1.5

Construct validity is also referred to as ________.

• Direct validity

• Indirect validity

• Predictive validity

• Educational validity

What is the relationship between novice and expert in assessments?

• High correlation

• Low correlation

• No correlation

• Variable correlation

Miller's Pyramid is used to describe levels of competence. What is the base level called?

• Knows

• Knows How

• Shows How

• Does

In Miller's Pyramid, which level represents applied knowledge?

• A) Knows

• B) Knows How

• C) Shows How

• D) Does