Quiz on Reliability and Validity

What does the reliability coefficient measure?

• The ratio of true scores to observed scores

• The ratio of measurement error to true scores

• The ratio of variance of true scores to variance of observed scores

• The ratio of observed scores to measurement error

Which method measures consistency over time?

• Internal Consistency Reliability

• Test-Retest Reliability

• Parallel Forms Reliability

• Observer Agreement

What is a potential issue with Test-Retest Reliability?

• It measures internal consistency

• Items differ in selection criteria

• First test affects the second test

• It compares two equivalent versions

What does Parallel Forms Reliability compare?

• The same test at different times

• The internal consistency of a single test

• Two equivalent versions of a test measuring the same attribute

• Two tests measuring different attributes

Which method examines consistency within the same test?

• Test-Retest Reliability

• Internal Consistency Reliability

• Parallel Forms Reliability

• Observer Agreement

What does the Split-Half Method involve?

• Measuring inter-rater agreement

• Dividing a test into two halves

• Comparing two different tests

• Calculating the reliability coefficient

What is Coefficient Alpha (Cronbach's α) used for?

• Estimating test-retest reliability

• Estimating internal consistency

• Calculating observer agreement

• Comparing two test forms

What does the Kappa Statistic measure?

• Internal consistency

• Test-retest reliability

• Measurement error

• Inter-rater agreement

What is considered an acceptable reliability benchmark for research?

• 0.50 - 0.60

• 0.70 - 0.80

• 0.80 - 0.90

• > 0.95

What can increase the reliability of a test?

• Using fewer items

• Reducing test length

• Using more items

• Changing the scoring method