SECTION 3

What does the reliability of a measurement construct measure?

• How well a test aligns with its intended purpose.

• Whether test scores are consistent over time.

• The resources needed to administer a test.

• The relationship between test items.

What type of reliability ensures that different judges give similar scores?

• Test-retest reliability

• Inter-rater reliability

• Internal consistency

• Predictive reliability

What does it mean if a test is reliable but not valid?

• It measures what it is designed to measure, but is inconsistent.

• It produces consistent scores but does not measure the intended skills.

• It can be performed but is difficult to interpret.

• It is valid for some groups but not for others.

What factors affect feasibility?

• Availability of resources

• Number of checkpoints

• Testing conditions

• All of the above

What is the purpose of test-retest reliability?

• To ensure that scores align with actual performance.

• To ensure that scores are consistent across different administrations.

• To determine whether test items are related to each other.

• To confirm that raters interpret test feedback in the same way.

Define value and provide an example of a good test that has value.

Explain the difference between construct reliability and content reliability.

Why is the reliability among judges important in subjective evaluations?

List three factors that affect the feasibility of a test.

The correlation coefficient (R) of 0.95 indicates what about the reliability of the test?