Test and measurement

Description:	Chapter 4 and 5
Category:	Psychology
Created by:	ashley5273 on 2007-09-29

Question	Answer
Psychology owes the advanced development of reliability assessment to the early work of	Charles Spearman
Abraham introduced the notion of	sampling error
The term error refers to discrepancies that will always exist between....... ability and the ...... of ability	true, measurement
the difference between a persons true score and observed score results from	measurement error
the equation for true/observed score	X = T + E
Spearman published the earliest work on reliability theory in his 1904 article	"The proof and measurement of Association between two things"
The distribution of random errors is what shape	bell shaped
Dispersion around the observed scored tells us	how much error there is in the measurement
Classical teat tehory uses the standard deviation of this distribution as a basic measure of error called	the standard error of measurement
standard error of measurement tells us	on average, how much an observed score deviates from a true score
if three random samples of items are selected from the entire domain of all possible items, each of the three samples should yield an unbiased estimate of the ........ related to the domain	true score
Reliability coeffiecients are	ratio coefficients that can also be expressed as the ratio of the variance of the true score on a test to the variance of the observed score on a test
reliability coefficients cab be interpreted as the proportion of variation in observed scores that can be attributed to	actual differences among people
three methods of estimating test reliability	test-retest, parallel form, and internal consistency
test-retest	consideres the consistecy of the test results when the test is admistered on differen occasions
parallel forms	evaluate the test across differen froms of the test
internal consistency	we examine how people perform on similar subsets of items selected from the same form of the measure
Test-Retest is appropritate when	it is assumed a trait being measured does not change over time... E.G intelligence
Carryover effect	occur when something about taking the test the firsttime influences the second time the test is taken
carryover effect can lead to an.......... of the true reliability of a test	overestimate
Parallel forms	the correlation between form a and from b of a test
split half method	a test given and divided into halves that are scored separately
Split half method can measure	internal consistency
Problem with split half	how its split; one half may have more difficult problems than the other half
to correct for half lenght you can use the.... formula	spearman-brown formula
spearman brown formula allows you	to estimate what the correlatoin between the two halves would have been if each half had been the length of the who test
spearman brown formula	R= 2r/(1+r) where r is the correlation between the two halves
the spearman brown formula increases the	reliability
Coefficient alpha	estimates teh internal consistency of tests in which the items are not scored 0 to 1 (right or wrong) in doing so he developed a more general reliability estimate
under what cirumstance is coefficient alpha appropriate measure of internal consisteny reliability of a test	when items are not dichotomosly scored
all measures of internal consistency (split half, coefficient alpha) evaluate the extent to which the different items on a test	measure the same ability of trait
if a test is designed to measure several different traits or characteristics, .................., is a good way to examine whether items within subgroups or components are internally consistent	factor analysis
behavirol psychologist prefer to use	observation of behavior opposed to psychological test
To asses the behavioral observations we must asses the reliability of the observer: two ways	interrater reliability or kappa
interrater reliability	the consistency among different judges who are evaluating the same behavior
three ways to an observer can evaluate behavior	record the precentage of times that two or more observers agree, kappa statistics
kappa statistics was introduced by	J. Cohen in 1960
Kappa statistics is	an agreement between two judges who each rate a set of objects using nominal scales.
the standard error of measurement is used to form .........around observed scores. Th	confidence intervals
Confidence intervals allow us to estimate the probability that the ........... falss within certain interval	true score
the interval around the observed score is the	confidence interval
if we have an 82 observed score and a 95% CI this means that	we are 95% that the true score relies around 78-84 interval
when importnat decisions are to be made on the basis of test socre, reliability coefficients should be ...... or higher	.95
basic research should have a reliability coefficient of	.70 to .80
allows test developers to estimate what the correlation between two measures would have been if the they had not been measured with error	correction for attenuation
a reliability of a difference score is expected to be	lowere that the reliability of either test on which it is based
administering two supposedly equivealent forms of test (form a and form b) to the same group of individuals yilelds a correlation coefficient indicating	alternative forms reliability
what did the suprem court rule in the case of Griggs vs. Duke Power?	Employees must provide evidence that a test used for selection of promotion of employees has a specific meaning.
Validity is	the agreement between test score or measure and the quality it is believed to mesure. "Does the test measure what is supposed to?"
Three primary types of evidence that can suppor a tests validity	face validity, content, and criterion related validity,
Face validity	mere appearance that a mesure has validity. If the items seem to be reasonably related to the perceived purpose of the test.
Face validity is not really validity because	it does not offer evidence to support conclusions drawn from test scores
consideres the adequacy of representation of the coneptual domain the test is designed to cover	content-related validity
has the test been constructed adequately would be what type of validity	content
contruct under representation is	the failure to capture important components of a construct
If a math test on included algebra not geometry this would be an example of	consrtuct under representation
Construct irrelevant variance is	when scores are influenced by irralevent factors
Test Anxiety, illiness, sleepy, are all factors that might influence a test this is temred	construct irrelevant variance
Criterion Related Evidence for Validity	tells us how well a test corresponds with a particulare criterion. Provided by high correlations between a rest and a well-defined criterion measure
predicitve validity	the forecasting function of test
Concurrent Relate evidence for validity is	assessments of thei simultaneous relationships between the test ad the crieterion-- such as between a learning disability and school performance
Validity coefficient	relationship between a test and a criterion is usually expressed a correlation called Validity coefficient
Are scale correlates well with other scales is an example of what type of evidence	Concurrent evidince (under criterion)
Construct validity evidence	is established through a series of activities in the which a reseracher simultaneously defines some construct and develops the instrumentation to measure it.
A construct is	something built by mental synthesis. Ex. Intelligence, love, curiosity, or mental health
convergent evidence	- When a measure correlates well with other tests believed to measure the same construct
- Convergent evidence is obtained in one of two ways	- 1) we show that a test measures the same things as other tests used for the same purpose.