Reliability and Validity Review

Although face validity, content validity, criterion validity, and construct validity are each distinct ideas, all of them deal with _________

• How many levels a measurement has

• How ratio a measurement is

• How repeatable a measurement is

• How true/accurate a measurement is

Although test-retest reliability, inter-observer reliability and inter-item reliability are each distinct ideas, all of them deal with _________

• how many levels a measurement has

• how ratio a measurement is

• how repeatable a measure is

• how true/accurate a measurement is

A researcher is trying to develop a new measurement of extraversion. They create two versions of their self-report measure and give both versions to the same group participants. Afterwards, they compare the scores on both forms to each other.

• inter-rater reliability

• convergent validity

• face validity

• alternate-forms reliability

If a scale is it not reliable, then it cannot be valid

• True

• False

Casey is evaluating humor in individuals by how many jokes they say. He scores each person and adds up the total. Casey's advisor tells him that he needs to have another person also score the same individuals, and that he should then compare the scores given.

This is checking for:

• test-retest reliability

• convergent validity

• inter-rater reliability

• predictive/

  concurrent validity

Dave is worried if the IQ test he is using is a sound measurement of intelligence. To check this, he has the same participants take the IQ test two times, both a month apart to check for consistency.

• alternate forms reliability

• test-retest reliability

• convergent validity

• content validity

A researcher is looking for a scale to measure extroversion. However, when they review a extroversion scale, they find that all the questions are related to loneliness. From skimming the questions alone, you could determine poor:

• content validity

• face validity

• inter-item reliability

• alternate-forms reliability

Luis is checking that the Big Five Inventory (a personality measure) contains all parts of measuring personality: extraversion, agreeableness, openness, conscientiousness, and neuroticism.

• criterion validity

• concurrent validity

• inter-item reliability

• content validity

Bonus Points!!

Katie is worried if her measure of aggression correlates well with real-world levels of aggression.

She is worried about:

• convergent validity

• content validity

• criterion validity

• interitem reliability

Answer explanation

This is a tricky one! While

criterion validity is concerned

with a measure associates

with expected behavioral

outcome, we have predictive

and concurrent validity as

TYPES of criterion validity.

To check the __________ Ushma takes the Satisfaction with Life Scale (SWLS) and compares it to the Subjective Well-Being Scale (SWB) to ensure they correlate with each other.

• convergent validity

• discriminant validity

• alternate-forms reliability

• test-retest reliability