Reliability Test

What does reliability in a research instrument refer to?

• The consistency of measurement

• The accuracy of measurement

• The generalizability of findings

• The relevance of variables

Which type of reliability assesses the consistency of measurement over time?

• Test-retest reliability

• Internal consistency

• Inter-rater reliability

• Concurrent validity

When a research instrument measures what it is intended to measure, it is said to have:

• Accuracy

• Reliability

• Validity

• Consistency

Parallel Forms reliability assesses:

• The generalizability of findings

• The extent to which a measure correlates with another measure taken at the same time

• The relevance of variables in a study

• The extent to which a measure is consistent over time

What is the primary purpose of inter-rater reliability?

• Assessing the relevance of variables

• Assessing the consistency of measurement across different raters or observers

• Assessing the accuracy of measurement

• Assessing the consistency of measurement across different items

What does Cronbach's alpha measure in the context of research instruments?

• The generalizability of findings

• The accuracy of measurement

• The consistency of measurement over time

• The internal consistency or reliability of a set of items

You are doing test-retest reliability for your research instrument. Which of these statistical methods analyses categorical variables?

• Pearson R correlation

• Interclass Correlation

• Cohen Kappa

• Graphical method

Which of these statements is true regarding factors affecting Cronbach's alpha?

• More items generally leads to increase value

• If item are highly correlated with each other, it will lead to increase in value

• A one-dimensional scale will have higher alpha value

• All the above statements are true

In the context of ICC, when is a two-way random effects model typically used?

• When there is a single rater providing ratings for each subject

• When there is no interest in inter-rater reliability.

• When multiple measurements are taken on each subject or object by multiple raters or assessors.

• When the same raters provide ratings for each subject across different time points

Which of these statements is false regarding Kappa?

• Cohen Kappa requires 2 raters or 1 rater with twice measurement at different time points

• Fleiss Kappa requires >2 raters or 1 rater measures at >2 measurement at different time points

• Weighted Kappa requires ≤2 raters but deals with ordinal data

• All the statements above are false