click below
click below
Normal Size Small Size show me how
psy400ch6p138-144
ch6power analysis
| Term | Definition |
|---|---|
| Retrospective power analysis | A series of computations that help you determine how much power you had in a study after the fact. |
| If you are dealing with an entirely new area, | you always have the option to do a pilot study first to get a handle on the effect size. |
| Why Is Power Often Underemphasized? | the issue of power can be evaded by having many analyses where at least some findings are likely to emerge as significant |
| bias for obtaining statistical significance in psychological research | that has likely contributed to the problem |
| Statistical significance | An indicator of the probability of obtaining an effect size as large as (or larger than) the one you obtained. |
| real-world implications of underpowered research | fail to detect meaningful effects |
| FORMULATE AN ANALYSIS PLAN | including an analysis plan in your protocol design may help to keep “ false positives" in your research findings to a minimum |
| You want your hypothesis—not the significant statistical results you may gather— | to drive your research and analyses |
| Thinking carefully about how you will analyze your data | will lead to a more thorough study design |
| p-Hacking: The process of deliberately manipulating factors in your research | to maximize your chance of uncovering a statistically significant finding (p <.05) |
| exploring your data for potentially statistically significant findings after your study is completed | leaves you open to the appearance of "p-Hacking" |
| you must disclose fully any steps you undertake that may either intentionally or unintentionally | enhance your chances of uncovering statistically significant findings |
| p-Hacking can include dropping groups, specific cases, or variables from an analysis | or adding analyses that were not part of an initial plan. |
| Clearly define your population of interest, | giving thought to the criteria for inclusion and exclusion |
| Consider representativeness, payment, measurements, | power analysis, and a general analysis plan |