Psychometrics Quiz

What does utility refer to in everyday language?

• The size of something

• The color of something

• The beauty of something

• The usefulness of something or some process

What is the index of reliability used to tell us?

• The benefits of a training program

• The practical value of test scores

• How consistently a test measures what it measures

• The financial cost of testing

What is the main problem with using known groups in setting cut scores?

• Determination of where to set the cutoff score is affected by the composition of the contrasting groups

• Known groups method is not effective for setting cut scores

• It is difficult to find contrasting groups

• There are no standard guidelines for choosing contrasting groups

What is the process of setting rules for assigning numbers in measurement called?

• Pilot work

• Test construction

• Item development

• Scaling

What is the format of individual test items known as?

• Item format

• Test construction

• Selected-response format

• Item conceptualization

What is the purpose of a constructed-response format in tests?

• To tailor the content and order of presentation of test items

• To store items in an item bank

• To require test takers to supply or create the correct answer

• To provide a list of test words

What does the term 'ceiling effect' refer to in the context of assessments?

• The ability of the computer to tailor the content and order of presentation of test items

• The diminished utility of an assessment tool for distinguishing test takers at the high end of the ability

• Diminished utility for distinguishing test takers at the high end of the ability

• Diminished utility for distinguishing test takers at the low end of the ability

What is the primary purpose of a test tryout?

• To determine measurement equivalence across test taker populations

• To develop item banks for future tests

• To administer the test to a representative sample of test takers

• To evaluate the properties of existing tests

What is the main goal of differential item functioning (DIF) analysis?

• To identify the correct answers for each item
• To determine systematic differences in how subgroups of examinees respond to specific items
• To determine the difficulty level of the test as a whole
• To assess the reliability of the test scores

How can scoring drift be addressed in test development?

• By conducting a sensitivity review

• By using an anchor protocol for scoring

• By analyzing item alternatives

• By implementing cross-validation techniques