click below
click below
Normal Size Small Size show me how
CI 152 Assessment 8
Reliability and Validity
| Question | Answer |
|---|---|
| Indicates that multiple judgments draw the same conclusion about how well someone has performed: | judgment reliability |
| Indicates that multiple administrations of the same test provide similar scores each time: | test-retest reliability |
| Indicates that the learners respond similarly to all related items: | internal consistency reliability |
| The assessment is an adequate representation of the content area: | content validity |
| Indicates that scores agree with another measure of the same characteristic performed with a different test: | criterion validity |
| Indicates that one has measured the contruct/characteristic one claims to have measured: | construct validity |
| Indicates that an instrument appears to be valid: | face validity |
| Validity can be no better than reliability... | if consistency is poor, what is measured doesn't matter since scores vary |
| One must determine reliability first and then... | turn to validity |
| Scoring consistency: | reliability |
| Validity refers to... | whether one measures what one claims |
| What is the object of measurement? | validity |
| What is reliability strengthen by? | increasing the number of test items, improving the test environment, improving the quality of test items |
| If fatigue and time are not factors, longer tests yield... | better reliability than short tests |
| To improve the testing environment you can: | limit distractions, improve directions |
| How can test item quality be gauged? | determining item difficulty and item discrimination |
| Symbolized by a "p" value: | item difficulty |
| Symbolized by a "di" value: | item discrimination |
| The number who scored the item correctly divided by the number who attempted the item: | "p" item difficulty |
| Group one minus group 2 and divided by chosen group size: | "di" item discrimination, di = (g1 – g2)/g |
| Ordinarily we expect difficulty values to range from: | .4 (40% got the item correctly) and up. |
| An item that everyone scores correctly has a difficulty index of: | 1.0 |
| Difficulty has little meaning without... | discrimination |
| We expect items to have discrimination values between: | .2 and .7 |
| What do negative discrimination values indicate? | a flawed item that should be deleted |