PSYC314 W1to6 Revision

Relating scores obtained on a test to other test scores or data from

other assessment procedures is typically done

in an effort to establish the ________ validity of a test.

• Internal

• Face

• Content-related

• Criterion-related

Answer explanation

Relating scores obtained on a test to other test scores or data from other assessment procedures is typically done to establish the Criterion-related validity of a test.

Imagine Maya and Benjamin are comparing their scores on a brand-new intelligence test with their scores on the fourth edition of the Stanford-Binet intelligence scale. They notice a significant, positive relationship between the two sets of scores.

Arjun, who is a whiz at psychometrics, suggests that these findings could be supportive of what type of validity evidence for the new test?

• convergent evidence of construct validity

• content validity

• criterion-related validity

• discriminant evidence of construct validity

Answer explanation

The correct choice is convergent evidence of construct validity because a positive relationship between scores on two different tests supports the idea that they are measuring the same underlying construct.

In the context of test construction, the term 'item discrimination' refers to the ability of an item to:

• Differentiate between groups based on demographic characteristics

• Distinguish between individuals who have different levels of the trait or ability being measured

• Measure multiple dimensions or traits simultaneously

• Remain unbiased regardless of the test taker's background

Answer explanation

Item discrimination refers to the ability of an item to distinguish between individuals who have different levels of the trait or ability being measured.

Face validity of a psychological test is concerned with:

• Whether the test appears to measure what it claims to measure

• The extent to which the test scores correlate with a related measure

• The ability of the test to differentiate between individuals on the basis of the trait being measured

• The consistency of the test results when administered at different times

Answer explanation

Face validity of a psychological test is concerned with whether the test appears to measure what it claims to measure.

When a test is said to have high test-retest reliability, it means that:

• The test accurately measures what it intends to measure

• The test produces similar scores upon repeated administrations

• The items within the test are consistent with each other

• The test can differentiate between high and low scorers effectively

Answer explanation

High test-retest reliability means the test produces similar scores upon repeated administrations, indicating consistency over time.

An item-difficulty index of 1 occurs when:

• all examinees answer the item correctly

• all examinees evenly respond to the item correctly and incorrectly.

• all examinees answer the item incorrectly

• None of these statements are true

Answer explanation

An item-difficulty index of 1 occurs when all examinees answer the item correctly.

The greater the magnitude of the item-discrimination index:

• the more people in the lower-scoring group answered the item correctly as compared with those in the higher-scoring group.

• the more reliable the test

• the more people in the higher-scoring group answered the item correctly as compared with those in the lower-scoring group.

• the more valid the test

Answer explanation

The greater the magnitude of the item-discrimination index, the more people in the higher-scoring group answered the item correctly as compared with those in the lower-scoring group.

According to the ethical code of the APS, test results

• should never be shared with the examinee

• should only be shared with the individual and his/her family

• can never be shared with anyone except the examinee

• can be subpoenaed and, therefore, are not always confidential

Answer explanation

The correct answer is that test results can be subpoenaed and, therefore, are not always confidential according to the ethical code of the APS.

An assumption inherent in classical test theory is that:

• measurement can be perfectly accurate if the measuring tool is well-constructed.

• each test-taker has a true score that would have been obtained if not for measurement error.

• tests originally administered by paper-and-pencil tend to retain their value if they are not modified for computer administration.

• test-takers can be ranked according to the level of the trait or ability they exhibit in much the same way one ranks by height.

Answer explanation

The correct assumption in classical test theory is that each test-taker has a true score that would have been obtained if not for measurement error.

In Classical Test Theory, the total score of an individual is considered to be composed of which two components?

• True score and Error score

• True score and Difficulty index

• Discrimination index and Difficulty index

• Criterion score and Construct score

Answer explanation

In Classical Test Theory, the total score of an individual is composed of the True score (reflects the individual's actual ability) and the Error score (reflects the measurement error).