Font size
WorksheetsMEC 1 WGU
Total questions: 107
Worksheet time: 55mins
When a teacher wants to ensure that the content being measured on her test is consistent with the purpose of the exam, what is he/she measuring?
Content Validity
Concurrent Validity
Consequential Validity
Construct Validity
W hat is the purpose ofconstruct validity?
Determine whether an assessment correlates highly with another assessment
Determine how closely the assessment represents the material is should be measuring
Identify whether the assessment measures the intended concept and not an unintended variable.
Analyze how well the assessment predicts outcomes of interest
Identify the penalty for scoring low on an assessment
What is the purpose of content validity in objective assessments?
Analyze how well the assessment can predict future outcomes
Determine how closely the assessment represents the material that should be assessed
Identify whether the assessment measures the intended concept and not an unintended variable
Determine whether the assessment correlates with another assessment
What is the purpose of criterion-related validity?
To see if an assessment is a reasonable method to get desired results
Measure the degree of correlation between an assessment and second assessment
Measure how well an assessment measures the intended concept and not an unintended variable
Measure the degree of agreement between a theoretical concept and an assessment
Measure how well an assessment measures what it is designed to measure
degree which results of an assessment is used for a particular purpose and has social consequences
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
degree of correlation between results of one assessment and another
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
degree it measures what the specifications indicate it is intended to measure
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
degree an assessment correlated with an existing measure of that performance
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
what is being measured is consistent with the exam’s purpose
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
to measure how well an assessment device measures what it was designed to measure
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
To measure the degree of agreement between a theoretical concept and an assessment
Consequential Validity
Concurrent Validity
Construct Validity
Criterion-Related Validity
Content Validity
How do you ensure validity of a test? (Multiple Answers)
The scoring procedures are evaluated for objectivity
Test is evaluated for evidence of bias
Test is evaluated for content consistency
Scores are evaluated for test-retest stability over time
Scores are evaluated with the Spearman-Brown correlation formula
What are threats to validity? (Multiple Answers)
Using a homogeneous grouping of prompts
Subjective scoring methods
Administering a pretest
Cheating by students
Ambiguous test directions
Test administered and then repeated on the same subjects at future date; results are compared and correlated with first test
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
Divide a test into 2 comparable halves and correlate scores on those halves
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
Estimate reliability that is computed from a single administration of the test
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
Measured by three different approaches: split-half consistency, Kuder-Richardson, and Cronbach’s alpha
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
The extent in which 2 or more forms of a test are consistent
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
The degree in which two tests measure the same content
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
When a well-designed behavior is evaluated by expert judges and the scores are in agreement
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
The consistency of a scoring system
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
The extent in which 2 or more evaluators agree
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
The degree of the relationship between scores
Internal Reliability
Equivalency Reliability
Inter-Rater Reliability
Stability Reliability
Test-retest reliability is also known as what?
Stability
Internal
Split-half
Equivalence
Split-test reliability is also called what?
Stability
Internal
Inter-Rater
Equivalence
Why is reliability essential?
Ensure an assessment approximate the real-life situation being measured
Demonstrate an ability to perform and maintain effectiveness
Ensure an assessment measures the construct that it purports to measure
Demonstrates a causal relationship between two variables
Which of the following are methods to determine reliability? (Multiple Answers)
ANOVA
ANCOVA
MANCOVA
Inter-rater
Parallel Forms
Which of the following are methods to determine reliability? (Multiple Answers)
Split-half measure of internal consistency
Cronbach’s alpha internal consistency measure
Analysis of covariance
Face validity
Kuder-Richardson
High Reliability Coefficients show:
High Reliability
Low Reliability
Low Reliability Coefficients show:
High Reliability
Low Reliability
Which are characteristics of reliability coefficients? (Multiple Answers)
Measure how well scores hold up over time
Measure less than the square root of the correlation between two test versions
Measures the degree to which items on a test are homogeneous
Measure the closeness of judges’ scores
Measure the correlation between predictor and predicted
Heterogeneous test groups
High Reliability Coefficient
Low Reliability Coefficient
Large number of test items
High Reliability Coefficient
Low Reliability Coefficient
Negligible standard error of measurement
High Reliability Coefficient
Low Reliability Coefficient
Minor differences in students’ scores
High Reliability Coefficient
Low Reliability Coefficient
Constructed-response test
High Reliability Coefficient
Low Reliability Coefficient
Projective test (e.g., personality tests)
High Reliability Coefficient
Low Reliability Coefficient
Short test
High Reliability Coefficient
Low Reliability Coefficient
Significant disparity in students’ scores
High Reliability Coefficient
Low Reliability Coefficient
Several subtest components of one larger test
High Reliability Coefficient
Low Reliability Coefficient
Significant standard error of measurement
High Reliability Coefficient
Low Reliability Coefficient
Inconsistent rating of constructed response items
High Reliability Coefficient
Low Reliability Coefficient
Is the Spearman-Brown Correlation used for:
Validity
Reliability
Never graded; anonymous
Formative
Summative
Performance Based
Placement
Conducted to improve the quality of student learning and not for grading students
Formative
Summative
Performance Based
Placement
Review of interim and final project deliverables by the development team
Formative
Summative
Performance Based
Placement
Review of design and interface by internal and external designers to improve navigation
Formative
Summative
Performance Based
Placement
Expose curriculum weaknesses to improve student learning
Formative
Summative
Performance Based
Placement
Provide information to improve teaching
Formative
Summative
Performance Based
Placement
Use information gathered in each stage of evaluation to revise the curriculum
Formative
Summative
Performance Based
Placement
Allows midcourse corrections
Formative
Summative
Performance Based
Placement
Assess organization of materials and presentation process of instruction
Formative
Summative
Performance Based
Placement
Implementation Evaluation
Formative
Summative
Performance Based
Placement
Evaluate student learning by using diagnostic surveys
Formative
Summative
Performance Based
Placement
Evaluate student learning through ongoing classroom assessment techniques
Formative
Summative
Performance Based
Placement
Provides information for decision makers who evaluate program development
Formative
Summative
Performance Based
Placement
Final course evaluation
Formative
Summative
Performance Based
Placement
End-of-course survey to measure student satisfaction with the teacher
Formative
Summative
Performance Based
Placement
A multiple-selection test taken at a test center
Formative
Summative
Performance Based
Placement
Conducted at the end of a curriculum to address long-term effects of the instruction
Formative
Summative
Performance Based
Placement
Assess the quality and impact of implemented curriculum
Formative
Summative
Performance Based
Placement
Provide evidence for possible cause-and-effect relationships
Formative
Summative
Performance Based
Placement
Evaluations investigating the demonstrable effect of curriculum
Formative
Summative
Performance Based
Placement
Data outcome used to determine if a program should be discontinued
Formative
Summative
Performance Based
Placement
Informs stakeholders of the extent to which curriculum met its goals
Formative
Summative
Performance Based
Placement
Determine cost-effectiveness
Formative
Summative
Performance Based
Placement
Determine impacts and effects of instruction
Formative
Summative
Performance Based
Placement
Impact Evaluation
Formative
Summative
Performance Based
Placement
Measure if your technology skills improved to the level predicted in the program’s proposal
Formative
Summative
Performance Based
Placement
Used to justify expenditures or funds for a program
Formative
Summative
Performance Based
Placement
Measures effectiveness of the curriculum against original objectives
Formative
Summative
Performance Based
Placement
Students create a map showing names and places in a novel
Formative
Summative
Performance Based
Placement
Assessment of the students’ ability to conduct a Chemistry experiment
Formative
Summative
Performance Based
Placement
Provides information about how a student understands and applies knowledge in a real-world scenario
Formative
Summative
Performance Based
Placement
Program entrance assessment
Formative
Summative
Performance Based
Placement
Measure skills in relation to the abilities needed in certain classes
Formative
Summative
Performance Based
Placement
Which is an element of a formative evaluation?
Inductive analysis
Affective evaluation
Meta-analysis
Implementation evaluation
Provide opportunities for interaction between the researcher and participants
Interview
Questionnaire
Recognized as having a high contact and response rate
Interview
Questionnaire
Permit researchers to record responses and reactions
Interview
Questionnaire
Allow flexible inquiry process with a high response rate
Interview
Questionnaire
Provide answers to well-defined questions in electronic format
Interview
Questionnaire
Offer framed oral conversations that result in data collection
Interview
Questionnaire
Provide answers to well-defined questions in electronic format
Interview
Questionnaire
Are aggregated through the use of electronic forms
Interview
Questionnaire
Provide anonymity for potentially sensitive responses
Interview
Questionnaire
Which of the following are types of QUALITATIVE data collected during assessments? (Multiple Answers)
Interval
Circular Scale
Discrete
Ratio
Nominal
Which of the following are types of QUANTITATIVE data collected during assessment?
Portfolio artifacts
Dichotomous scores
Polytomous scores
Discrete variables
Holistic scoring of essays
Administering a summative evaluation using student test
Quantative
Qualitative
Administering a survey with closed-ended question
Quantative
Qualitative
Obtaining academic records (e.g., GPAs) from management
Quantative
Qualitative
Using a Likert scale that asks students to rate items from 1 to 5
Quantative
Qualitative
Questionnaires with closed-ended questions to determine satisfaction
Quantative
Qualitative
A comparison of pre-test and post-test scores
Quantative
Qualitative
Obtain tabulated statistical data from management information systems
Quantative
Qualitative
Interviewing students to specifically capture scaled responses
Quantative
Qualitative
Scores of assessments
Quantative
Qualitative
Observations to record the number of times students are off task
Quantative
Qualitative
Observations to record the amount of time a student remains on task
Quantative
Qualitative
Time to complete a test
Quantative
Qualitative
Using focus groups
Quantative
Qualitative
Giving an essay exam
Quantative
Qualitative
A semantic differential scale to indicate attitude on a continuum
Quantative
Qualitative
Administering surveys with open-ended questions
Quantative
Qualitative
Observing students to describe types of interaction
Quantative
Qualitative
Generating theoretical insights through focus groups of students
Quantative
Qualitative
Observations to gather types of behavior seen during instruction
Quantative
Qualitative
