International Test Commission guidelines for test adaptationA criterion checklist

  1. Ana Hernández 1
  2. María Dolores Hidalgo 2
  3. Ronald K. Hambleton 3
  4. Juana Gómez-Benito 4
  1. 1 Universitat de València
    info

    Universitat de València

    Valencia, España

    ROR https://ror.org/043nxc105

  2. 2 Universidad de Murcia
    info

    Universidad de Murcia

    Murcia, España

    ROR https://ror.org/03p3aeb86

  3. 3 University of Massachusetts at Amherst
  4. 4 Universitat de Barcelona
    info

    Universitat de Barcelona

    Barcelona, España

    ROR https://ror.org/021018s57

Show affiliations +
Journal:
Psicothema

ISSN: 0214-9915,  1886-144X

Year of publication: 2020

Volume: 32

Issue: 3

Pages: 390-398

Type: Article

DOI: 10.7334/PSICOTHEMA2019.306 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Psicothema

Abstract

Background: To improve the quality of test translation and adaptation, and hence the comparability of scores across cultures, the International Test Commission (ITC) proposed a number of guidelines for the adaptation process. Although these guidelines are well-known, they are not implemented as often as they should be. One possible reason for this is the broad scope of the guidelines, which makes them difficult to apply in practice. The goal of this study was therefore to draw up an evaluative criterion checklist that would help test adapters to implement the ITC recommendations and which would serve as a model for assessing the quality of test adaptations. Method: Each ITC guideline was operationalized through a number of criteria. For each criterion, acceptable and excellent levels of accomplishment were proposed. The initial checklist was then reviewed by a panel of 12 experts in testing and test adaptation. The resulting checklist was applied to two different tests by two pairs of independent reviewers. Results: The final evaluative checklist consisted of 29 criteria covering all phases of test adaptation: planning, development, confirmation, administration, score interpretation, and documentation. Conclusions: We believe that the proposed evaluative checklist will help to improve the quality of test adaptation.

Bibliographic References

  • American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
  • American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
  • Bakker, A. B., Ficapal-Cusí, P., Torrent-Sellens, J., Boada-Grau, J., & Hontangas-Beltrán, P. M. (2018). The Spanish version of the Job Crafting Scale. Psicothema, 30(1), 136-142. doi:10.7334/ psicothema2016.293
  • Buela-Casal, G., Guillén-Riquelme, A., & Seisdedos, N. (2015). Cuestionario de Ansiedad Estado/Rasgo. Madrid: TEA Ediciones.
  • Duarte, M. E., & Rossier, J. (2008). Testing and assessment in an international context: Cross-and multi-cultural issues. In J. A. Athanasou & R. Van Esbroeck (Eds.), International handbook of career guidance (pp. 489- 510). Dordrecht: Springer. doi:10.1007/978-1-4020-6230-8_24
  • Epstein, J., Santo, R.M., & Guillemin, F. (2015). A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of Clinical Epidemiology, 68(4), 435-441. doi:10.1016/j.jclinepi.2014.11.021
  • Evers, A., Muñiz, J., Hagemeister, C., Hstmælingen, A., Lindley, P., Sjöberg, A., & Bartram, D. (2013). Assessing the quality of tests: Revision of the EFPA review model. Psicothema, 25, 283-291. doi:10.7334/ psicothema2013.97
  • Hambleton, R. K. (1994). Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment, 10, 229-244. doi:10.1027//1015-5759.15.3.270
  • Hambleton, R. K. (1996). Adaptación de tests para su uso en diferentes idiomas y culturas: fuentes de error, posibles soluciones y directrices prácticas [Adapting tests for use in different languages and cultures: Sources of error, possible solutions, and practical guidelines]. In J. Muñiz (Coord.), Psicometría (pp. 207-238). Madrid: Universitas.
  • Hambleton, R.K. (2005). Issues, designs and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton, P.F. Merenda & S.D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3-38). New Jersey: Lawrence Erlbaum Associates.
  • Hambleton, R. K., & Lee, M. K. (2013). Methods for translating and adapting tests to increase cross-language validity. In D.H. Saklofske, C.R. Reynolds, V.L. Schwean (Eds.), The Oxford handbook of child psychological assessment (pp. 172-181). New York, NY: Oxford University Press. doi:10.1093/oxfordhb/9780199796304.013.0008
  • Hambleton, R. K., & Zenisky, A. (2011). Translating and adapting tests for cross-cultural assessments. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 46-74). New York, NY: Cambridge University Press.
  • Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (Eds.) (2005). Adapting educational and psychological tests for crosscultural assessment. Hillsdale, NJ: Lawrence Erlbaum Publishers. doi:10.4324/9781410611758
  • Iliescu, D. (2017). Adapting tests in linguistic and cultural situations. Cambridge: Cambridge University Press. doi:10.1017/978131 6273203.
  • International Test Commission (2005). International Guidelines on Test Adaptation. Retrieved from www.intestcom.org
  • International Test Commission (2014). ITC Statement On the Use of Tests and Other Assessment Instruments for Research Purposes. Retrieved from www.intestcom.org
  • ITC Guidelines for Translating and Adapting Tests (Second Edition) (2017). Retrieved from www.intestcom.org
  • ITC Guidelines for Translating and Adapting Tests (Second Edition) (2018). International Journal of Testing, 18(2), 101-134, doi:10.1080 /15305058.2017.1398166
  • Lourido, D. T., Arce, C., & Ponte, D. (2018). Adaptation of the Test of Performance Strategies Competition Subscale to Spanish. Psicothema, 30(1), 123-129. doi:10.7334/psicothema2017.124
  • Matsumoto, D., & van de Vijver, F. J. R. (2011). Cross-cultural research methods in psychology. New York, NY: Cambridge University Press. doi:10.1017/CBO9780511779381
  • Miller, L. A., & Lovler, R. L. (2018). Foundations of psychological testing: A practical approach. London: Sage Publications.
  • Muñiz, J., & Hambleton, R. K. (1996). Directrices para la traducción y adaptación de los tests [Guidelines for test translation and adaptation]. Papeles del Psicólogo, 66, 63-70.
  • Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: segunda edición [Guidelines for test translation and adaptation: Second edition]. Psicothema, 25, 151- 157. doi:10.7334/psicothema2013.24
  • Muñiz, J., Hernández, A., & Fernández-Hermida, J. R. (2020). Test use in Spain: The psychologists’viewpoint. Psychologist Papers, 41(1), 1-15. doi:10.23923/pap.psicol2020.2921
  • Muñiz, J., Bartram, D., Evers, A., Boben, D., Matesic, K., Glabeke, K., & Zaal, J. N. (2001). Testing practices in European countries. European Journal of Psychological Assessment, 17(3), 201-2011. doi: 10.1027//1015-5759.17.3.201.
  • Rios, J. A., & Sireci, S. G. (2014). Guidelines versus practices in crosslingual assessment: A disconcerting disconnect. International Journal of Testing, 14, 289-312. doi:10.1080/15305058.2014.924006
  • Swami, V., & Barron, D. (2019). Translation and validation of body image instruments: Challenges, good practice guidelines, and reporting recommendations for test adaptation. Body Image, 31, 204-220. doi:10.1016/j.bodyim.2018.08.014
  • Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W., Bouter, L. M., & de Vet, H. C. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 2, 651-657. doi:10.1007/ s11136-011-9960-1
  • Valdivia Vázquez, J. A. (2014). Test adaptation activities across languages and cultures (Order No. 3640085). Retrieved from https://search. proquest.com/docview/1625043213?accountid=14777
  • van de Vijver, F. J. R., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1(2), 89-99. doi:10.1027/1016-9040.1.2.89
  • van de Vijver, F. J. R., & Leung, K. (2011). Equivalence and bias: A review of concepts, models and data analytic procedures. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 17-45). New York, NY: Cambridge University Press. doi:10.1017/CBO9780511779381.003
Data source: Dialnet