Assessment

49 of 49

Lesson 7: Outline \| Notes \| Glossary \| Preview \| Presentation \| Activities \| Directed Questions \| Assessment \| Required: Pre Test \| Post Test \| Case Study
	Assessment for Fairness of Standardized Tests

Multiple Choice

Attention: ONLINE RESPONDING IS DISABLED
Javascripting is either turned off or is not recognized by your browser.

1.	Which type of reliability examines the consistency of individual scores across different administrations of a test?

Internal reliability

(*)

Test-retest reliability

Correct

Parallel forms reliability

Inter-rater reliability

2.	Which type of reliability evaluates if different versions of the same test have the same measurement characteristics?

Internal reliability

Test-retest reliability

(*)

Parallel forms reliability

Correct

Inter-rater reliability

3.	Which type of reliability indicates the degree of consistency in responses across the many items of a single test?

(*)

Internal reliability

Correct

Test-retest reliability

Parallel forms reliability

Inter-rater reliability

4.	Which type of reliability refers to the amount of agreement or consistency between two different scorers scoring the same test?

Internal reliability

Test-retest reliability

Parallel forms reliability

(*)

Inter-rater reliability

Correct

5.	Which concept refers to any difference not attributable to actual differences in the trait or ability being measured

True variance

(*)

Error variance

Correct

Standard deviation

Score variability

6.	The Angoff method of developing cutscores refers to:

A method that relies on judges placing people into borderline groups based on their ability

A method that relies on judges placing people into contrasting groups based on their ability

A method that relies on a statistically driven average of all test takers

(*)

A method that requires judges to define a minimally competent individual

Correct

7.	Which is not an actual step in the process of developing cutscores?

A representative sample of judges should be assembled

Judges should be given ample opportunity to discuss and revise judgments

(*)

A sample of high scoring test takers should be assembled

Correct

The results should be reviewed in light of actual examinee data

8.	Which is not a descriptor of bias?

A systematic error

A technical concept

(*)

Identical to fairness

Correct

Can be analyzed impartially

9.	Which procedure for bias detection is concerned with the opinion of individuals representing the relevant subgroups in the population of potential examinees?

Empirical review

(*)

Judgmental review

Correct

Fairness review

differential item functioning analysis

10.

Which procedure for bias detection allows test developers to ascertain statistically whether or not individual items perform differently for relevant subgroups?

(*)

Empirical review

Correct

Judgmental review

Fairness review

Logical review

Test Development