Quiz on Reliability and Validity in Testing

What does the reliability coefficient reflect?

• The total score of a test

• The ratio of the variance of true scores to the variance of observed scores

• The ratio of observed scores to true scores

• The number of items in a test

Which method measures consistency over time?

• Parallel Forms Reliability

• Observer Agreement

• Test-Retest Reliability

• Internal Consistency Reliability

What is a potential issue with Test-Retest Reliability?

• The first test may affect the second test

• Scores may be influenced by unrelated factors

• Items differ in content

• It cannot be used for stable traits

Which method compares two equivalent versions of a test?

• Test-Retest Reliability

• Parallel Forms Reliability

• Internal Consistency Reliability

• Observer Agreement

What does the Split-Half Method assess?

• Consistency across different tests

• Consistency within the same test

• The validity of a test

• Inter-rater agreement

What is the purpose of the Kappa Statistic?

• To evaluate item difficulty

• To assess test-retest reliability

• To measure inter-rater agreement

• To measure internal consistency

What reliability benchmark is considered acceptable for research?

• > 0.95

• 0.80 - 0.90

• 0.70 - 0.80

• 0.50 - 0.60

What is face validity?

• Technical evidence of a test's validity

• The correlation between test scores and external criteria

• The appearance that a test is valid

• Statistical evidence supporting a test

What does predictive validity measure?

• How well a test predicts future performance

• The appearance of a test's validity

• The correlation between test scores and unrelated constructs

• How well a test relates to a criterion measured at the same time

What is the ideal difficulty range for test items?

• 0.70 to 0.90

• 0.30 to 0.70

• 0.10 to 0.20

• 0.90 to 1.00