click below
click below
Normal Size Small Size show me how
NCE Appraisal
appraisal section
| Question | Answer |
|---|---|
| appraisal could include | surveys, observations, clinical interviews |
| subjective format | rater's biases may affect score |
| objective format | rater's judgment plays little to no part in scoring |
| Halo Effect | test taker's attributes significantly impacts the rating |
| short answer tests are | free choice |
| forced choice | recognition items |
| difficulty index indicates % of those who answered each item ___ | correctly |
| .5 difficulty index (value) = | 50% answered correctly; 50% answered incorrectly |
| .25 difficulty index = | 25% answered correctly; 75% answered incorrectly |
| dichotomous/dichotomy = | presented w/ 2 opposing forces (MBTI) |
| in the normative format | each item is independent of all other items |
| in the ipsative format | compares traits w/in same person (allows person tested to compare items) Kuder is used for this |
| in normative tests persons ___ be compared to others who have take test | can |
| a good speed test are set so that | no one finishes |
| power tests are designed to | evaluate level of mastery w/o time limit |
| projective tests rely on | free response format |
| personality tests measures | typical performance |
| spiral tests items get | progressively more difficult |
| cyclical test | sections are spiral in nature (in each section questions go from easy to more difficult) |
| test battery is considered a ____ test | horizontal test |
| horizontal tests measure | various factors (math, science) |
| vertical tests | have different versions for different levels |
| parallel tests | 2 versions/forms that are interchangeable |
| validity refers to | whether a test measures what it says it measures |
| reliability refers to | how consistent a test measures an attribute |
| 2 most critical factors in test selection are | validity & reliability |
| 1st most important factor in test selection is | validity |
| 2nd most important factor in test selection is | reliability |
| 5 basic types of validity are | content, construct, concurrent, predictive, consequential |
| content validity (rational or logical) | does the test examine or sample behavior under scrutiny? (just sampled memory & not vocabulary) |
| construct validity | test's ability to measure a theoretical construct (intelligence, self-esteem, artistic talent) |
| concurrent validity | deals with how well test compares to other instruments of same purpose |
| predictive validity (or empirical) | test's ability to predict future behavior according to established criteria (DVAC assess, school entrance exams - GRE) |
| concurrent and predictive are types of | criterion related validity |
| consequential validity | ascertain social implications of using tests |
| a test can be reliable and NOT | valid |
| construct is any trait you cannot | directly measure or observe |
| face validity | does test look or appear to measure intended attribute? |
| incremental validity | test is refined & becomes more valid as contradictory items are dropped |
| synthetic validity | looks for tests that have been shown to predict each job element or component (typing or filing) |
| convergent validity | relationship or correlation of a test to an independent measure or trait |
| discriminant validity | test will NOT reflect unrelated variables |
| subtypes of criterion validity are | concurrent and predictive |
| reliable tests are NOT always | valid |
| valid tests ARE always | reliable |
| test-retest reliability | tests for stability (only valid for IQ tests which remain stable) |
| interrater/interobserver (or scorer reliability) | 2 or more persons who grade or assess same responses will produce roughly the same score |
| reliability & validity are expressed by | correlation coefficients & the closer they are to 1.00 the better |
| a reliability coefficient of 1.00 indicates a | perfect score which has no error (generally occurs in physical measurement) |
| an excellent psychological or counseling test would have a reliability coefficient of | .90 - 90% of score measured the attribute and 10% of score is indicative of error |
| .70 = | 70% is true variance and 30% is error variance (70% answered correctly; 30% answered incorrectly) |
| .70 is generally acceptable for most psychological attributes but ___ is used for admissions for jobs, schools, etc. and sometimes ___ | .80 or .90 |
| 2 test (test-retest reliability) - to equate true variance (is shared here), you would ___ the coefficient | square |
| IQ = | intelligence quotient (division) |
| Binet's IQ measures MA/CA x 100 | mental age divided by chronological age x 100 |
| Francis Galton believed intelligence was | normally distributed like height or weight |
| Galton believed intelligence was also | inherited |
| Charles Spearman - 2 factor theory | general ability = G ; specific ability = S - were both applicable to any mental task |
| fluid and crystallization | fluid = flexible; crystallization = rigid & does not change or adapt |
| J.P. Guilford isolated 120 factors which added up to intelligence; | he also is remembered for thoughts on convergent and divergent thinking |
| convergent thinking is | when divergent thoughts & ideas are combined into a singular concept |
| divergent thinking is | ability to generate a novel idea |
| Binet and Theodore Simon are known for | creating 1st standardized IQ test |
| internal consistency or homogeneity also called inter-item consistency | find out if each item on test is measuring same thing as every other item |
| Kuder Richardson or KR-20; KR-21 can measure if performance on 1 item is truly related | to performance on another item |
| Lee J. Cronbach's alpha coefficient also measures | performance on 1 item is truly related to performance on another item |
| cross-validation | examines criterion validity of test by administering the test to a new sample (shrinkage) |
| Stanford-Binet IQ is | standardized |
| standardized tests are so b/c | scoring and administration procedures are formal & well delineated |
| IQ formula = | MA/CA x 100 |
| IQ formula was created by | Wilhelm Stern |
| Today Binet relies on standard age score (SAS) w/ a mean of | 100 & standard deviation (SD) of 16 |
| on Binet's test a 9 year old task would be one that 50% of 9 year old could answer | correctly |
| entropy | dysfunctional families are too open or too closed |
| negative entropy | healthy family is balanced |
| Wechsler yields a verbal IQ, performance IQ, & | full-scale IQ |
| WPPSI-III | Wechsler Preschool & Primary Scale of Intelligence |
| WAIS-III | Wechsler Adult Intelligence Scale |
| WISC-III | Wechsler Intelligence Scale for Children |
| Merrill-Palmer Scales of Mental Tests is intelligence tests for | infants |
| when a test is guided by a theory it is known as a | theory based test or inventory |
| group IQ tests | Otis Lennon, Lorge-Thorndike, California Test of Mental Abilities |
| group IQ tests are less accurate and have | lower reliability |
| group IQ tests began in | WWI w/ Army Alpha and Army Beta |
| culture-fair tests - items are known to subject regardless of | culture |
| ACA regulates that tests must be normed on that __ population before they can take it | specific |
| Arthur Jensen wrote an article in 1969 about | black/white IQ controversy |
| John Ertl invented electronic machine to analyze | neural efficiency to take place of pen and paper tests |
| Raymond Cattell responsible for | fluid and crystallization intelligence |
| Robert Williams created (BITCH) | Black Intelligence Test of Cultural Homogeneity - blacks often excelled when given a test laden w/ questions familiar to their community |
| MMPI-2 - a standardized personality test | Minnesota Multiphasic Personality Inventory 2 (new version to help dx & treat patients) suitable for those over 18, 6th grade reading level, & is 60-90m long |
| MMPI-A | suitable for 14-18 year old |
| psychometric | any form of mental testing |
| Likert Scale | test relies on a summated or linear rating scale (strongly agree - 5; agree -4) |
| in projection tests subjects are shown ___ stimuli | neutral |
| formats of projective tests | association - what comes to mind when you look at this inkblot; completion - complete this sentence w/ real feelings; construction -drawing a person |
| examiner bias is common when using | projectives & therapists need more training |
| 16 PF is the work of | Raymond B. Cattell - Personality Factor Questionnaire for 16 & above |
| 16 PF measures key personality factors such as | assertiveness, emotional maturity, & shrewdness |
| couples can take the 16 PF & be given individual & joint profile for | marital counseling |
| James McKeen Cattell | mental test spent time researching mental assessment & its relation to reaction time |
| tests and inventories that analyze data outside of a given theory are called | factor-analytic tests or inventories rather than theory based tests |
| Oscar Buros | Mental Measurement Yearbook - publication to review available tests |
| projective tests would be favored by ___ clinicians | psychodynamic - rely heavily on unconscious mind |
| Bender Visual Motor Gestalt | expressive projective measure |
| interest inventories are for those | high school age and up |
| interest inventories criticism is | emphasis on professional positions more than blue collar |
| interests and abilities are not | correlated |
| interest inventories are reliable and | non-threatening |
| O*NET Ability Profiler; GATB, LSAT, MCAT are ___ tests | aptitude |
| school selection tests are ___ tests | aptitude tests |
| social desirability | client purposely or when in doubt gives unusual responses |
| acquiescience | client always agrees |
| GRE measures | aptitude and achievement (aptitude-achievement test) |
| standard error of measurement tells | how accurate or inaccurate a test score is |
| low standard error means | high reliability |
| standard error of measurement of 3; Tom scored a 100; prediction is he'll score between | 103 and 109 (3 points + or -) X= T+E (X-obtained score, T-true score, E-error) |
| increasing test length | raises reliability |
| shortening test length | decreases reliability |
| informal assessment techniques include | self-reports, case notes, checklists, sociograms of groups, interviews, professional staffings, journals |
| test manual should give specific | target population |
| remember IQ tests measure 100 w/ SD of | 15 and Binet is 100 w/ SD of 16 |
| in normal distribution; 68% of population will fall between plus/minus 1 SD of mean | 100-15 or 100+15 (for IQ tests) |
| if 68% were 96% then it would fall between plus/minus | 2 SD of mean (100-30 or 100+30) |
| public law 93-380 or Buckley Amendment states | anyone over 18 can inspect their own records & those of their children |
| Family Education Rights & Privacy Act stipulates info cannot be released w/o | adult consent |
| Lewis Terman americanized the | Binet (Stanford Binet) |
| item difficulty index is calculate by taking the # of persons tests who answered the item correctly and | divide by the total # of persons tested (75/75=1.0) |