click below
click below
Normal Size Small Size show me how
psy400ch7p157-
Potential Threats to Validity and Possible Solutions
| Term | Definition |
|---|---|
| four Potential Threats to validity | respondents do not understand question or answer fraudulently, respondents with an agenda, and careless respondents |
| Respondents Who Do Not Understand Questions | response patterns that do not make sense indicate that you should not use the data. |
| Respondents Who Answer Fraudulently | identify outliers in your data; allow only a single submission from any one IP address; prescreen participants; add similar (or even the same) questions |
| Respondents with an Agenda | use of a "lie scale” |
| participants who respond that | they never get angry are likely not providing valid responses |
| Careless responding is a particular risk when participants are required to complete a survey either for their | job or for class credit (as is common in introductory psychology classes) |
| "CR indicators” | Include “instructed response" questions; even-odd consistency; Use a strategy termed “LongString,"; ask participants whether their responses were accurate and of high quality |
| prevent CR responding by creating | perceived interaction between participants and researchers; notify participants they will receive feedback on the quality and utility of their responses |
| introduce a "virtual human" into the survey by having the virtual | figure occupy a small part of the screen |
| surveys are only one methodology for | reaching a definitive conclusion |
| THE PROS AND CONS OF INTERVIEWS | provide a rich source of data and enable the researcher to judge whether any threats to validity occur; Underststand, CR |
| Rich Data | help explain the results of more limited questions posed in a survey; ask why; rapport; bring data to life |
| Confirmation of Participant Understanding | young children, individuals who may not understand the language, or individuals with cognitive impairments; prescreen |
| Detecting Careless Interview Responding | excessive laughing or a particular response set, for instance, a consistent “yes" to every question without regard to content |
| With adult interviewees, facial expressions (e.g.,smirks) and a cavalier attitude may indicate CR | politely ask the respondent to take the survey seriously |
| Disadvantages of interviews | lack of efficiency, potential interviewer effects, response biases, and issues of standardization. |
| Inefficient Use of Time and Resources | FaceTime and Skype not recommended for initial interviews with participants |
| Interviewer effects: Influences that the interviewer may have on responses, | including the way in which he/she asks and responds to questions, tone of voice, or facial expressions. |
| Interviewers should be trained to provide neutral responses, but even the most highly trained interviewer may inadvertently | provide subtle cues that may influence the participant |
| Interviewers must be conscious that their own characteristics (e.g., age, gender, ethnicity) and behavior, including the way they | dress and present themselves, may influence participants in various,sometimes subtle ways |
| Response bias: desire to respond with responses one believes the researcher would want, | an unwillingness to provide sensitive information, or a tendency to always respond positively when unsure about a question |
| Acquiescence bias: a common form of response bias where | participant responds affirmatively to every question where they are unsure of the correct response. |
| Standardization | The designing of interview questions such that they are used in a consistent manner by all interviewers |