Week 11

Which form of reliability does this question refer to:

Is the (single) rater consistent with the scoring across multiple repetitions?

• Intra-rater reliability

• Internal consistency

• Parallel forms

• Inter-rater reliability

A measure of physical fitness has high internal consistency reliability when:

• Multiple observers make the same ratings while examining a test subject’s physical performance.

• Participants score at the high end of the scale every time they complete the measure

• Each of the items correlates with other items on the measure.

• Over administration of the measure on two separate days, multiple observers obtain the same score.

T/F: The most commonly used relative reliability indices are intraclass correlation (ICC) coefficient for categorical data and kappa coefficient for quantitative (interval, ratio) data.

• True

• False

You are in the process of establishing psychometric properties of an assessment that measures depression. Here is a set of results obtained from one individual that participated in the procedures to establish the psychometric properties of the assessment.

Assume that all items were intended to measure depression (in other words, the assessment is unidimensional). Based on the results shown, this assessment has:

• Good test-retest reliability

• Good internal consistency

• Good divergent validity

Consider the following statements about a hypothetical measure of physical fitness. Which one is not possible based on the relationship between reliability and validity?

• The test is high in validity and high in reliability

• The test is high in validity and low in reliability

• The test is low in validity and high in reliability

• The test is low in predictive validity and low in reliability

Why is a question, “Is this instrument valid or invalid?” not helpful?

Your client scored a 56 out of 57 in the Action Research Arm Test (ARAT), a standardized assessment that measures upper extremity performance (coordination, dexterity and functioning). 56 reflects a near perfect score (meaning that she was able to perform nearly all movement asked of her). What is the more appropriate next step for you as an occupational therapist?

• Determine that he is safe to discharge and the score warrants no more need for therapy

• Consider administering an assessment that measures his ability to complete a functional task

Your client completed the 5-meter walk test in 6.2 seconds for, which puts him at the 51th percentile in his age range (i.e. he scored better than 51% of the people who have taken this test). 

This test uses a ______ approach to assessment.

• Norm-referenced

• Criterion-referenced

Developing criterion-referenced curriculum-based assessment instruments involves

• completing a psychological evaluation of the student

• identifying skills to be measured, objectives, and standards of performance

• identifying objectives for a single student

Minimal Detectable Change (MDC) is

• the smallest meaningful & beneficial change, that is clinically important and perceived valuable to the patient

• the least amount of change, that exceeds the standard measurement error (SEM), that may reflect true change