TERMS IN TESTING REVIEW

TERMS IN TESTING

Review

Introduction to Key Testing Concepts

●Validity: Measures if the test assesses what it's supposed to

●Reliability: Ensures consistent results each time

●Practicality: How easy it is to create, administer, and score

●Impact: How the test affects learning and teaching

These elements are crucial for effective and meaningful tests.

Fill in the Blanks

If the test gives consistent results every time, it shows the

of the test.

Fill in the Blanks

shows if the test measures what it is supposed to measure.

Fill in the Blanks

shows how the test affects learning and teaching.

Fill in the Blanks

means how easy and convenient it is to create, administer, and score a test.

Fill in the Blanks

A reliability

is a number that shows how reliable a test is. It tells you how consistent the test results are. It exists between 0.0 and 1.0

- 0.0 means no reliability.

- 1.0 means perfect reliability.

Types of Validity

●Content Validity: Covers all relevant topics or skills. E.g. A grammar test about the past simple must check students’ understanding of all the forms and usages of the past simple.

●Construct Validity: Measures the intended theoretical concept E.g. if a reading skills test was designed to measure the critical thinking skills of students, then the test should follow the same rules as other critical thinking skills tests.

●Criterion-related Validity: Compares results to specific external criteria.

●Concurrent Validity: Comparison with current outcomes. Eg. Level-test results compared with results of class work.

●Predictive Validity: Prediction of future outcomes. Eg. Mock test results compared with future test perfomance.

●Face Validity: Test appears appropriate for its purpose. Looks like a test.

Multiple Choice

__________ checks that the test covers all relevant topics or skills. For example, A grammar test about the past simple must check students’ understanding of all the forms and usages of the past simple.

• Content Validity

• Concurrent validity

• Construct validity

• Criterion-related Validity

Multiple Choice

__________ checks how well a test’s result compares to a specific external criterion or outcome like performance in a job or success in a future course..

• Content Validity

• Concurrent validity

• Construct validity

• Criterion-related Validity

Multiple Choice

__________ measures the intended theoretical concept of the test. E.g if a reading skills test was designed to measure the critical thinking skills of students, then the test should follow the same rules as other critical thinking skills tests.

• Content Validity

• Concurrent validity

• Construct validity

• Criterion-related Validity

Multiple Choice

__________ shows that the test looks appropriate. Basically, the test looks like a test.

• Content Validity

• Concurrent validity

• Face validity

• Criterion-related Validity

Multiple Choice

__________ compares the test results with current outcomes. Eg. Level-test results compared with results of class work.

• Content Validity

• Concurrent validity

• Construct validity

• Criterion-related Validity

Fill in the Blanks

validity compares the test results with future outcomes. For example, mock exam results help predict performances in future exams.

Marking Methods

Holistic Marking:

●Single overall score for the whole task

●Focuses on general quality

●Quicker but less detailed

Analytic Marking:

●Breaks task into different parts (e.g., grammar, vocabulary)

●Scores each part separately

●More detailed but time-consuming

Fill in the Blanks

test is a type of test used to find out a student's strengths and weaknesses in a particular subject or skill. It helps teachers understand what a student knows and what they need to improve.

Fill in the Blanks

of items is when each question or task on a test is separate from the others and doesn't affect each other.

Fill in the Blanks

In

marking, you break the task into different parts (like grammar, vocabulary, structure) and give a score for each part. It's more detailed but takes longer.

Fill in the Blanks

In

marking, you give a single overall score for the whole task, focusing on the general quality of the response. It's quicker but less detailed.

Fill in the Blanks

Holistic marking looks at the '

' picture.

Fill in the Blanks

Analytic marking looks at the '

' details.

Direct vs. Indirect Testing

Direct Testing:

●Directly measures specific skills or knowledge

●Example: Speaking test to assess speaking skills

Indirect Testing:

●Assesses knowledge/skills through related abilities

●Example: Multiple-choice grammar test to check writing ability

Fill in the Blanks

testing directly measures the specific skills that you want to evaluate. Example: Writing skills are assessed by instructing students to write an essay.

Fill in the Blanks

testing measures a person's knowledge or skills without directly asking them to show those specific abilities but rather using related skills or knowledge. An example of this is when you give students a gap-fill task to measure their writing or speaking skills.

Discreet Point vs. Integrative Testing

Discreet Point Testing:

●Tests specific skills/knowledge individually

●Example: Vocabulary quiz with gaps, and multiple choice questions/

Integrative Testing:

●Measures multiple language skills simultaneously

●Example: Writing an essay (combines grammar, vocabulary, organization)

Fill in the Blanks

testing combines different skills like reading, writing, listening, and speaking to see how well a learner can communicate effectively.

Fill in the Blanks

testing measures specific skills individually rather than as part of a larger task. It can take the form of gap-fill or multiple-choice questions.

Task vs. Item

Task:

●A specific activity consisting of instructions and a set of items students complete during a test to show their skills.

●Example: Write a paragraph about your favorite hobby

Item:

●Individual question assessing particular knowledge/skills

●Example: Multiple-choice question about verb tenses

Fill in the Blanks

A task is a specific activity consisting of

and a set of items students complete during a test to show their skills.

Fill in the Blanks

An item is an

question that measures a particular knowledge or skills. Each item can take various forms, such as multiple-choice questions, true/false statements, and short answer questions. Items are the building blocks of any assessment tool.

Multiple Choice

Example: Write a paragraph about your favorite hobby.

• Task

• Item

Multiple Choice

Example: Multiple-choice question about verb tenses

• Task

• Item

Norm-referenced vs. Criterion-referenced Marking

Norm-referenced:

●Compares student's score to peers

●Shows relative performance within a group

Criterion-referenced:

●Measures performance against defined standards

●Shows if students have learned specific material

Objective vs. Subjective Tests

Objective Tests:

●Based on clear, specific criteria

●No personal judgment involved

●Example: Multiple-choice questions

Subjective Tests:

●Depends on evaluator's judgment

●Can vary based on scorer

●Example: Essay questions

Pre-testing vs. Piloting

Pre-testing:

●Administered to a small, random group

●Checks test validity before full development

Pilot Testing:

●Given to a group similar to actual test-takers

●Assesses how test works in practice

Fill in the Blanks

tests evaluate a student's work based on clear, specific criteria without any

personal feelings or opinions influencing the scores.

Fill in the Blanks

marking compares student's performance with specific well-defined standards and goals rather than compare it with performance of their peers.

Fill in the Blanks

Pre-testing is the process of administering a test to a

small group of participants before it is fully developed

and distributed to an actual audience.

Fill in the Blanks

marking compares the scores of the test taker to that of others in the same group (like a class or

a grade level).

Fill in the Blanks

Subjective test has a way of grading or scoring that depends on the _______ ________ of the

evaluator rather than fixed rules or criteria. An example of this is when a teacher grades an essay or drawing.

Fill in the Blanks

Pilot testing is a way to try out a test before it is used widely. It involves giving the test to a small group of people

who are

to the actual test-takers. This helps see how the test works in practice.

Marking Scale and Answer Key

Marking Scale:

●System for grading based on clear rules and instructions

●Helps maintain consistency in scoring

Scoring / Answer Key:

●Guide showing correct answers

●Ensures quick and accurate checking of responses

Distractors and Stems in Multiple Choice Questions

Distractor:

●Incorrect options in multiple-choice questions

●Makes the test more challenging

Stem:

●Part of the question presenting the problem

●Provides context for the answer choices

Achievement vs. Proficiency Tests

Achievement Test:

●Measures learning from a specific course/subject

●Example: Final exam in a history class

Proficiency Test:

●Assesses overall skill level, regardless of learning method

●Example: TOEFL for English language proficiency

Fill in the Blanks

An answer key is a guide showing the correct answers of a test, but a marking scale is a guide showing ___ __ _____ students' tests based on clear instructions.

Fill in the Blanks

test measures how well students have learned material or skills from a specific course or subject

(like a final exam in school).

Multiple Choice

In multiple choice questions, a stem is part of the question that presents the problem and 1. __________ while the distractors are 2. _________ options that make the test more 3. ______________.

• 1. contest 2. correct 3. exciting

• 1. context 2. incorrect 3. challenging

• 1. context 2. correct 3. challenging

Fill in the Blanks

Unlike achievement test, proficiency test measures how well someone can perform in a

or skill area, not just

what they know about it.

Cloze Test vs. C-test

●Cloze Test:

●Words systematically removed from text

●Students fill in blanks (e.g., every 5th or 6th word)

●C-test:

●Part of every second word removed (starting from 3rd sentence)

●Tests overall language comprehension

Sample of behavior vs. specification.

Sample of Behaviour

specific examples of how a test-taker performs a task or answers questions during an

assessment.

Specification

detailed outline or description of what the test will cover.

Test Method Effect and Moderation

●Test Method Effect:

●How test design influences student performance

●Considers impact of format on results

●Moderation:

●Process of reviewing and adjusting assessments

●Ensures fairness, quality, and reliability

Fill in the Blanks

A piece of evidence that shows how a person behaves in a test situation is a

of behaviour.

Fill in the Blanks

A

includes information

about the test’s content, format, and the skills it aims to assess.

Fill in the Blanks

Test

effect means that the way a test is designed and given can affect how students perform.

Fill in the Blanks

In a

-test, words are systematically removed from a

text, and the test-taker is required to fill in the blanks with the correct words. For example, in order to test students' understanding of a text / reading comprehension skills, every 5th or 6th

word is removed from the text.

Fill in the Blanks

Reviewing and adjusting assessments to ensure they meet specific standards of fairness, quality, and

reliability is known as

.

Fill in the Blanks

In a

-test, words are systematically removed from a

text, and the test-taker is required to fill in the blanks with the correct words. For example, in order to test students' understanding of a text / reading comprehension skills, every 5th or 6th

word is removed from the text.

Backwash and Standardization

●Backwash (or Washback):

●Influence of tests on learning and teaching

●Can be positive (encouraging deep learning) or negative (promoting rote
memorization)

●Standardization:

●Creating consistent test conditions for all takers

●Ensures fair and comparable results

Intra-rater vs. Inter-rater Reliability

●Intra-rater Reliability:

●Consistency of scores given by same examiner over time

●Checks if an examiner is consistent in their marking

●Inter-rater Reliability:

●Agreement between different examiners

●Ensures fairness across multiple scorers

Split half method vs. alternative forms method.

Split half method:

This method checks if a test measures consistently across different sections.

The test is divided into two equal parts. Then, the scores from both halves are compared.

Alternative forms method

This method involves creating two different versions of the same test that

cover the same material. After students take both versions, their scores are compared.

It shows that both forms are reliable.

Fill in the Blanks

reliability checks if a teacher or examiner gives the same score to a student's work every time, they

look at it under any circumstances.

Fill in the Blanks

Creating a test in a consistent way so that it can be fairly given to everyone is known as

.

Fill in the Blanks

The extent to which the content of a test influences how students learn and what

they study is known as

effect.

Fill in the Blanks

In the split half method of testing, a test is divided into two equal parts. Then, the scores from both halves are compared but

In the

forms method, the examiner creates two different versions of the same test that

cover the same material.

Multiple Choice

When tests are overly narrow or focus only on rote memorization, teachers may 'teach to the test' concentrating solely on test-specific content. This situation is known as ___________

• positive washback effect

• negative washback effect

Fill in the Blanks

reliability checks how much different teachers give similar scores to the same work, ensuring fairness.

Fill in the Blanks

A pop quiz is a short,

test given to students to assess their understanding of the

material that has recently been covered in class.

Formative vs. Summative Assessment

Formative Assessment:

●Ongoing "check-ups" during learning process

●Provides feedback for improvement

●Example: Quizzes, class discussions

Summative Assessment:

●Final evaluation at end of learning period

●Measures overall achievement

●Example: Final exams, standardized tests

Continuous vs. Fixed-point Assessment

●Continuous Assessment:

●Regular evaluations throughout learning process

●Provides ongoing feedback

●Example: Weekly quizzes, project milestones

●Fixed-point Assessment:

●Evaluations at specific times

●Measures learning at particular moments

●Example: Midterm and final exams

Assessment Types: Learning, For Learning, As
Learning
Assessment of Learning:

●Measures what students have learned at end of unit/course

●Used for grades or certification

Assessment for Learning:

●Helps students improve during learning process

●Provides feedback to adjust teaching

Assessment as Learning:

●Encourages students to reflect on their own learning

●Promotes self-assessment and goal-setting

Fill in the Blanks

Formative assessment is like a

during the learning process. It helps teachers understand how students are

progressing and what they need to improve.

Fill in the Blanks

evaluations at specific times to measure what students have learned at that moment are known as

assessments.

Fill in the Blanks

Continuous assessments are

evaluations throughout the learning process for ongoing feedback.

Fill in the Blanks

A

assessment is like a final test at the end of a learning period. It shows what students have learned after

completing a course or unit. Exams, final projects, or standardized tests are examples.

Fill in the Blanks

A test whose main goal is to place students in the appropriate level of instruction is known as a

test.

Multiple Choice

This assessment is used to help students learn better while they are still

learning. It involves giving feedback during the learning process, such as quizzes or informal checks. The

goal is to understand what students know and what they need help with, so teachers can adjust their

teaching accordingly.

• Assessment of learning

• Assessment for learning

• Assessment as learning

Multiple Choice

This type of assessment looks at what students have learned at the end of a

lesson, unit, or course. It is like a final exam or project that shows how much knowledge a student has

gained. The focus here is on measuring learning outcomes, usually for grades or certification.

• Assessment of learning

• Assessment for learning

• Assessment as learning

Multiple Choice

This approach encourages students to take an active role in assessment of their

own learning. Students reflect on their understanding and skills, often setting their own goals and

assessing their progress. It promotes self-awareness and helps students become more independent

learners.

• Assessment of learning

• Assessment for learning

• Assessment as learning

Multiple Choice

_____________ is the process of drawing a conclusion based on evidence and reasoning rather than from direct statements.

• independence

• inferential

• inference

​You've got this!! I believe in you. Love you so so much!

​

My Irochka!