Absence of an effet; Statistics; Power test; Equivalence test; Confidence interval
Abstract :
[en] In experimental studies, the lack of statistical significance is often interpreted as the absence of an effect. Unfortunately, such a conclusion is often a serious misinterpretation. Indeed, non-significant results are just as often the consequence of an insufficient statistical power. In order to conclude beyond reasonable doubt that there is no meaningful effect at the population level, it is necessary to use proper statistical techniques. The present article reviews three different approaches that can be used to show the absence of a meaningful effect, namely the statistical power test, the equivalence test, and the confidence interval approach. These three techniques are presented with easy to understand examples and equations are given for the case of the two-sample t-test, the paired-sample t-test, the linear regression coefficient and the correlation coefficient. Despite the popularity of the power test, we recommend using preferably the equivalence test or the confidence interval.
Research Center/Unit :
Centre de Neurosciences Cognitives et Comportementales - ULiège
Disciplines :
Neurosciences & behavior
Author, co-author :
Quertemont, Etienne ; Université de Liège - ULiège > Département de Psychologie : cognition et comportement > Psychologie quantitative
Language :
English
Title :
How to Statistically Show the Absence of an Effect
Alternative titles :
[fr] Comment démontrer statistiquement l'absence d'un effet
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Altman, D.G., & Bland, J.M. (1995). Absence of evidence is not evidence of absence. British Medical Journal 311, 485-485.
Brysbaert, M. (2011). Basic statistics for psychologists. Basingstoke, UK: Palgrave Macmillan.
Dunnett, C.W., & Gent, M. (1977). Significant testing to establish equivalence between treatments with special reference to data in the form of 2 × 2 tables. Biometrics, 33, 593-602. (Pubitemid 8236330)
Goertzen, J.R., & Cribbie, R.A. (2010). Detecting a lack of association: An equivalence testing approach. British Journal of Mathematical and Statistical Psychology, 63, 527-537.
Hocnig, J.M., & Heisy, D.M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. The American Statistician, 55, 19-24.
Lenth, R.V. (2009). Java applets for power and sample size [Computer software]. Retrieved April 8,2011, from http://www.stat.uiowa.edu/-rlenth/Power.
Masson, M.E.J., & Loftus, G.R. (2003). Using confidence intervals for graphically based data interpretation. Canadian Journal of Experimental Psychology, 57, 203-220. (Pubitemid 37180498)
Parkhurst, D.F. (2001). Statistical significance tests: Equivalence and reverse tests should reduce misinterpretation. Bioscience, 51, 1051-1057.
Rogers, J.L., Howard, K.I., & Vessey, J.T. (1993). Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113, 553-565.
Schuirmann, D.J. (1987). A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. Journal of Pharmacokinetics and Biopharmaceutics, 15, 657-680.
Tryon, W.W. (2001). Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests. Psychological Methods, 6, 371-386.
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.