click below
click below
Normal Size Small Size show me how
CI 152 Assessment 8
Reliability and Validity
Question | Answer |
---|---|
Indicates that multiple judgments draw the same conclusion about how well someone has performed: | judgment reliability |
Indicates that multiple administrations of the same test provide similar scores each time: | test-retest reliability |
Indicates that the learners respond similarly to all related items: | internal consistency reliability |
The assessment is an adequate representation of the content area: | content validity |
Indicates that scores agree with another measure of the same characteristic performed with a different test: | criterion validity |
Indicates that one has measured the contruct/characteristic one claims to have measured: | construct validity |
Indicates that an instrument appears to be valid: | face validity |
Validity can be no better than reliability... | if consistency is poor, what is measured doesn't matter since scores vary |
One must determine reliability first and then... | turn to validity |
Scoring consistency: | reliability |
Validity refers to... | whether one measures what one claims |
What is the object of measurement? | validity |
What is reliability strengthen by? | increasing the number of test items, improving the test environment, improving the quality of test items |
If fatigue and time are not factors, longer tests yield... | better reliability than short tests |
To improve the testing environment you can: | limit distractions, improve directions |
How can test item quality be gauged? | determining item difficulty and item discrimination |
Symbolized by a "p" value: | item difficulty |
Symbolized by a "di" value: | item discrimination |
The number who scored the item correctly divided by the number who attempted the item: | "p" item difficulty |
Group one minus group 2 and divided by chosen group size: | "di" item discrimination, di = (g1 – g2)/g |
Ordinarily we expect difficulty values to range from: | .4 (40% got the item correctly) and up. |
An item that everyone scores correctly has a difficulty index of: | 1.0 |
Difficulty has little meaning without... | discrimination |
We expect items to have discrimination values between: | .2 and .7 |
What do negative discrimination values indicate? | a flawed item that should be deleted |