Testing for language teachers

The Cambridge marking scales for speaking and writing at B2 level are an example of...

• automated scoring

• holistic scoring

• analytic scoring

• comparative judgement

Answer explanation

analytic scoring means the candidate receives a separte score for individual elements of a task.

holistic scoring is a general impression.

comparative judgement is a computerised technique used for marking writing.

Which type of test would be best for an individualised course of study?

• diagnostic test

• placement test

• screening test

• proficiency test

Answer explanation

good computerised diagnostic testing will hopefully become available. DIALANG is an example currently in existence in 14 languages, although it is not very detailed.

Placement tests are used to assign students to the teaching programme best suited to their abilities.

Screening tests are used to avoid the time and expense of administering longer tests to students who have no chance of passing the high-stakes test.

proficiency tests are a test of ability, regardless of training (they are not connected to the content of a particular course).

Which type of test has most potential for positive backwash?

• criterion-referenced

• norm-referenced

• indirect

• discrete point

Answer explanation

criterion referenced testing sets meaningful standards and describes what a candidate can do in the language, whereas norm-referenced testing compares their performance to others in the cohort.

indirect testing tests the abilities underlying the skills; discrete point testing tests one element (for example a grammar point) at a time and is usually indirect. The current state of knowledge does not allow the creation of accurate and reliable indirect tests. (direct testing, which tests the skills we wish to measure, is more likely to lead to positive backwash than indirect).

A test can be said to have 'content validity' when...

• ...the results of the test agree with an independent and dependable assessment of validity

• ...it looks valid and is therefore accepted by stakeholders

• ...candidates are given the opportunity to familiarise themselves with the test structure and techniques beforehand

• ...there is a representative sample of the skills/ structures to be tested

Answer explanation

criterion-related validity is whether the results agree with an independent and dependable assessment of ability.

face validity means the test looks valid and is accepted by stakeholders.

consequential validity (or fairness) includes allowing test-takers to familiarise themselves with the format before taking the test.

A cloze test is an example of...

• subjective testing

• discrete point testing

• integrative testing

• communicative language testing

Answer explanation

subjectivity is a feature of scoring.

discrete point testing means testing one element at a time.

communicative language testing is an obsolete term given that most testing aims at evaluating communicative ability.

item response theory (IRT) is a measure of...

• validity

• reliability

• objectivity

• proficiency

Answer explanation

IRT is an approach to statistical analysis particularly suited to computer-based tests

A disadvantage of multiple choice tests is that...

• it is very difficult to write successful items

• it is quick and cheap to score

• it is less subjective than other forms of testing

• it is a poor test of receptive skills

Answer explanation

two of the distractors are advantages of multiple choice testing.

multiple choice tests are a poor test of PRODUCTIVE skills.

Which of these elements is LEAST useful in evaluating speaking ability in an interview format

• abruptly changing topic

• asking student to elaborate

• a prepared monologue

• asking student to act as an interpreter with the help of a colleague who speaks her/his L1

Answer explanation

changing topic allows evaluation of how the students copes with that.

interpreting can test both comprehension and production.

a prepared monologue is likely to lead to memorising, and is only appropriate where giving presentations is a course objective.

Formative assessment is characterised by...

• careful planning

• collection of relevant information at the appropriate level

• clear feedback and suggestions for improvement

• objectivity in scoring

Answer explanation

Careful planning and collecting relevant information should be features of all tests, both formative and summative.

Objectivity is a feature of scoring and depends on the type of task (scoring speaking and writing presents more challenges in terms of objectivity)

Which of these test techniques is an example of indirect testing?

• Information gap

• completing a chart with facts and figures from a recording

• gap fill

• decision-making

Answer explanation

Information gap tests speaking abilities directly.

Completing a chart with data is a direct test technique with real purpose.

Decision-making tests speaking abilities directly.

Gap fill is a discrete point technique testing underlying abilities rather than skills.