Errores de interpretación de los valores p entre psicólogos profesionales españolesun estudio exploratorio

  1. Laura Badenes Ribera
  2. María Dolores Frías Navarro
  3. Amparo Bonilla Campos
Journal:
International Journal of Developmental and Educational Psychology: INFAD. Revista de Psicología

ISSN: 0214-9877

Year of publication: 2017

Issue Title: La psicología hoy: retos, logros y perspectivas de futuro. Psicología de la Adolescencia

Volume: 1

Issue: 2

Pages: 551-560

Type: Article

DOI: 10.17060/IJODAEP.2017.N1.V2.870 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: International Journal of Developmental and Educational Psychology: INFAD. Revista de Psicología

Abstract

This paper analyzes the misinterpretatons of the p-value made by Spanish practitioner psychologists given that lack of knowledge and understanding of p value might affect the professionals’ decisions and jeopardize the quality of psychological interventions. We carried out a survey on 77 practitioner psychologists from Spain (68.8% women, mean age of 41.44 years, SD = 9.42). Our findings are consistent with previous research and suggest that many participants did not know how to correctly interpret p values. More than a third of them believed that p-value indicate the clinical or practical significance of the findings. These results highlight the importance of the training in statistical concepts, research design methodology, and statistical inference tests in order to improve professional practice among practitioner psychologists.

Bibliographic References

  • American Psychological Association (2005). Policy Statement on Evidence-Based Practice in Psychology. Washington, DC: Author.
  • American Psychological Association (2006). Evidence-based practice in psychology: APA Presidential Task Force on evidence-based practice. American Psychologist, 61, 271–285. doi:10.1037/0003-066X.61.4.271
  • American Psychological Association (2010). Publication Manual of the American Psychological Association (6th ed.). Washington, DC: Author.
  • Babione, J. M. (2010). Evidence-Based Practice in Psychology: An ethical framework for graduate education, clinical training, and maintaining professional competence. Ethics & Behavior, 20, 443-453. doi: 10.1080/10508422.2010.521446
  • Badenes-Ribera. L., y Frias-Navarro, D. (2017). Falacias sobre el valor p compartidas por profesores y estudiantes universitarios . Universitas Psychologica, (in press)
  • Badenes-Ribera. L., Frias-Navarro, D., Iotti, B., Bonilla-Campos, A., y Longobardi, C. (2016). Misconceptions of the p-value among Chilean and Italian academic psychologists. Frontiers in Psychology, 7, 1247. doi: 10.3389/fpsyg.2016.01247
  • Badenes-Ribera, L., Frias-Navarro, D., Monterde-i-Bort, H., & Pascual-Soler, M. (2015). Interpretation of the p value. A national survey study in academic psychologists from Spain. Psicothema, 27, 290-295. doi: 10.7334/psicothema2014.283
  • Beyth-Maron, R., Fidler, F., y Cumming, G. (2008). Statistical cognition: Towards evidence-based practice in statistics and statistics education. Statistics Education Research Journal, 7, 20-39.
  • Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
  • Cohen, J. (1994). The earth is round (p<.05). American Psychologist, 49, 997-1003. doi:10.1037/0003-066X.49.12.997
  • Cumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York, NY: Routledge.
  • Cumming, G., Fidler, F., Kalinowski, P, y Lai, J. (2012). The statistical recommendations of the American Psychological Association publication manual: Effect sizes, confidence intervals, and meta-analysis. Australian Journal of Psychology, 64, 138-146. doi: 10.1111/j.1742-9536.2011.00037.x
  • Cumming, G., Fidler, F., Leonard, M., Kalinowski, P, Christiansen, A., …, y Wilson, S. (2007). Statistical reform in Psychology: Is anything changing? Psychological Science, 18, 230-232. doi: 10.1111/j.1467-9280.2007.01881.x
  • Daset, L. R., y Cracco, C. (2013). Psicología Basada en la Evidencia: algunas cuestiones básicas y una aproximación a través de una revisión bibliográfica. Ciencias Psicológicas; 7, 209 – 220.
  • Falk, R., y Greenbaum, C. W. (1995). Significance tests die hard: the amazing persistence of a probabilistic misconception. Theory y Psychology, 5, 75-98. doi: 10.1177/0959354395051004
  • Faulkner, C., Fidler, F., y Cumming, G. (2008). The value of RCT evidence depends on the quality of statistical analysis. Behavior Research and Therapy, 46, 270-281. doi: 10.1016/j.brat.2007.12.001
  • Frias-Navarro, D. (2011). Técnica estadística y diseño de investigación. Valencia: Palmero Ediciones.
  • Frías-Navarro, D. y Pascual-Llobell, J. (2003). Psicología clínica basada en pruebas: Efecto del tratamiento. Papeles del Psicólogo, 85, 11-118. Disponible en: http://www.papelesdelpsicologo.es/vernumero.asp?id=1074
  • Frías, M. D., Pascual, J., y García, J.F. (2000). Tamaño del efecto del tratamiento y signficación estadistica. Psicothema, 12, 236-240. Disponible en: http://www.psicothema.com/pdf/555.pdf
  • Garfield, J. (2002). The challenge of developing statistical reasoning. Journal of statistic education, 10. Disponible en www.amstat.org/publications/jse/v10n3/garfield.html
  • Haller, H., y Krauss, S. (2002). Misinterpretations of significance: a problem students share with their teachers? Methods of Psychological Research Online [On-line serial], 7, 120. Retrieved from: http://www.metheval.uni-jena.de/lehre/0405-ws/evaluationuebung/haller.pdf
  • Harrison, J., Thompson, B., y Vannest, K. J. (2009). Interpreting the evidence for effective interventions to increase the academic performance of students with ADHD: Relevance of the statistical significance controversy. Review of Educational Research, 79, 740-775. doi: 10.3102/0034654309331516
  • Hoekstra, R., Morey, R.D., Rouder, J.N., y Wagenmakers, E. (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21, 1157-1164. doi: 10.3758/s13423-013-0572-3
  • Kazdin, A. E. (1999). The meanings and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 332-339. doi:10.1037/0022-006X.67.3.332
  • Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146-159. doi: 10.1037/0003-066X.63.3.146
  • Kline, R. B. (2013). Beyond significance testing: Statistic reform in the behavioral sciences. Washington, DC: American Psychological Association
  • Kühberger, A., Fritz, A., Lermer, E., y Scherndl, T. (2015). The significance fallacy in inferential statistics. BMC Research Notes, 17, 8, 84. doi: 10.1186/s13104-015-1020-4.
  • Leek, J. (2014). On the scalability of statistical procedures: Why the p-value bashers just don’t get it. Simply Statistics Blog, Disponible en: http://simplystatistics.org/2014/02/14/on-the-scalability-of-statisticalprocedures-why-the-p-value-bashers-just-dont-get-it/
  • Monterde-i-Bort, H., Frias-Navarro, D., & Pascual-Llobell, J. (2010). Uses and abuses of statistical significance tests and other statistical resources: A comparative study. European Journal of Psychology of Education, 25, 429-447. doi:10.1007/s10212-010-0021-x
  • Newcombe, R.G. (2012). Confidence intervals for proportions and related mesuares of effect size. Boca Raton, FL: CRC Press
  • Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301. doi:10.1037/1082-989X.S.2.241
  • Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. Chicester: John Wiley & Sons.
  • Perezgonzalez, J. D. (2015). Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing. Frontiers in Psychology, 6, 223. doi:10.3389/fpsyg.2015.000223
  • Pfannkuch, M., y Wild, C. (2004). Towards an understanding of statistical thinking. En D. Ben-Zvi, y J. Garfield, (Eds.). The challenge of developing statistical literacy, reasoning and thinking (pp. 17-45). Dordrecht: Kluwer Academic Publishers.
  • Sackett, D.L., Straus, S. L., Richardson, W.S., Rosenberg, W.M.C. y Haynes, R. B. (2000). Evidence Based Medicine. How to practice y teach EBM (3rd Edition). Edinburgh, England & New York (NY): Churchill Livingstone.
  • Sánchez-Meca, J., Boruch, R.F., Petrosino, A., y Rosa-Alcázar, A.I. (2002). La Colaboración Campbell y la Práctica basada en la Evidencia. Papeles del Psicólogo, 83, 44-48. Disponible en: http://www.papelesdelpsicologo.es/resumen?pii=896
  • Sullivan, G. M., y Feinn, R. (2012). Using Effect Size—or Why the P Value Is Not Enough. Journal of Graduate Medical Education, 4, 279–282. doi: 10.4300/JGME-D-12-00156.1
  • Téllez, A., García, C. H., y Corral-Verdugo, V. (2015). Effect size, confidence intervals and statistical power in psychological research. Psychology in Russia: State of the Art, 8, 27-46. doi: 10.11621/pir.2015.0303
  • Vázquez, C., y Nieto, M. (2003). Psicología (clínica) basada en la evidencia) (PBE): una revisión conceptual y metodológica. En J. L. Romero (Ed), Psicópolis: Paradigmas actuales y alternativos en la psicología contemporánea. Barcelona. Paidós.
  • Verdam, M. G. E., Oort, F. J., & Sprangers, M. A. G. (2014). Significance, truth and proof of p values: reminders about common misconceptions regarding null hypothesis significance testing. Quality of Life Research, 23, 5–7. doi:10.1007/s11136-013-0437-2
  • Wasserstein., R. L., y Lazar, N. A. (2016). The ASA's Statement on p-values: Context, process, and purpose. The American Statistician, 70, 129-133. doi: 10.1080/00031305.2016.1154108
Data source: Dialnet