Modeling item bankinganalysis and design of a computerized system

  1. Molina Ibáñez, J. Gabriel
  2. Pareja, Ignacio
  3. Sanmartin Arce, Jaime
Journal:
REMA

ISSN: 1135-6855

Year of publication: 2008

Volume: 13

Issue: 2

Pages: 1-14

Type: Article

DIALNET GOOGLE SCHOLAR lock_openDialnet editor

More publications in: REMA

Abstract

Computerized adaptive tests rely on item banks from which to select the more suited items to be applied along the test administration; however, the availability of item banks is rather limited and, on the other hand, the development of an item bank can involve a great deal of effort for test users. The aim of this work concerned the analysis and design of a computerized system aimed to support the whole process of developing and maintaining item banks. Resulting from it, an item banking model is proposed which provides the basis to implement such a computerized system and, also, to encourage the discussion about the more suitable model for this goal. It is to be expected that the availability of sound item banking software could help to extend the application of item-bank based tests, like computerized adaptive tests, beyond the boundaries of large-scale testing programs.

Bibliographic References

  • 1. Assessment Systems Corporation (1996). XCALIBRE (version 3.5) [Computer program]. St. Paul, MN: Author. Available: http://www.assess.com
  • 2. Baker, F. B. (1993). EQUATE 2.0: A computer program for the characteristic curve method of IRT equating. Applied Psychological Measurement, 17, 20.
  • 3- Barbero, M. I. (1996). Bancos de items. En J. Muñiz (Ed.): Psicometría. Madrid: Editorial Universitas.
  • 4. Berger, M. P. F. (1994). D-optimal sequential sampling designs for IRT models. Journal of Educational Statistics, 19, 43-56.
  • 5. Dorans, N. J. (1990). Equating methods and sampling designs. Applied Measurement in Education, 3, 3-17.
  • 6. Embretson, S. E. & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
  • 7. Ferrando, P. J., & Lorenza-Seva, U. (2001). Checking the appropriateness of item response theory models by predicting the distribution of observed scores: The program EO-Fit. Educational and Psychological Measurement, 61, 895-902.
  • 8. Flaugher, R. (1990). Item pools. In H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 41-64). Hillsdale, NJ: Lawrence Erlbaum.
  • 9. Jones, D. H., & Jin, Z. (1994). Optimal sequential designs for on-line item estimation. Psychometrika, 59, 59-75.
  • 10. Logic eXtension Resources (2006). LXR-TEST (version 6) [Computer program]. Rancho Cucamonga, CA: Author. Available: http://www.lxrtest.com
  • 11. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
  • 12. Lorenzo-Seva, U., & Ferrando, P. J. (2003). IMINCE: An unrestricted factor-analysis-based program for assessing measurement invariance. Behavior Research Methods, Instruments, & Computers, 35, 2, 318-321.
  • 13. Lunz, M. E., Bergstrom, B. A., & Gershon, R. C. (1994). Computer adaptive testing. International Journal of Educational Research, 21, 623-634.
  • 14. Mislevy, R. J., & Bock, R. D. (1990). BILOG (version 3) [Computer program]. Chicago: SSI Scientific Software. Available: http://www.ssicentral.com
  • 15. Molina, J. G., Sanmartín, J., & Pareja, I. (1997). Item banks information storage and management: Analysis of a computer system. Paper presented at the 10th European Meeting of the Psychometric Society. Santiago de Compostela, Spain.
  • 16. Molina, J. G., Sanmartín, J., & Pareja, I. (1999). Desarrollo de un sistema informático orientado a la construcción y gestión de bancos de items [Development of a computerized system oriented to the development and management of item banks]. In J. Olea, V. Ponsoda & G. Prieto (Eds.), Tests informatizados: Fundamentos y aplicaciones. Madrid: Pirámide.
  • 17. Navas, M. J. (1993) Aplicación de la TRI al campo de la medida: Creación de un banco de items para evaluar la capacidad matemática. Tesis doctoral, Madrid: Universidad Nacional de Educación a Distancia (UNED).
  • 18. Navas, M. J. (1999) Un siglo utilizando tests. Revista Electrónica de Metodología Aplicada, 4, 1-11.
  • 19. Novell Inc. (1995). AppWare (version 1.2) [Computer language]. Provo, Utah: Author.
  • 20. Olea, J., Abad, F. J., Ponsoda, V., & Ximénez, M. C. (2004) Un test adaptativo informatizado para evaluar el conocimiento de inglés escrito: diseño y comprobaciones psicométricas. Psicothema, 16, 519-525.
  • 21. Olea, J., Ponsoda, V., & Prieto, G. (1999). Tests informatizados: Fundamentos y aplicaciones. [Computerized tests: Foundations and applications]. Madrid: Pirámide.
  • 22. Ponsoda, V. (2000). Overview of the computerized adaptive testing special section. Psicológica, 21, 115-120.
  • 23. Renom, J. (1993). Tests adaptativos computerizados. Fundamentos y aplicaciones. Barcelona:PPU.
  • 24. Renom, J. (1997). Retos y perspectivas de los tests adaptativos informatizados. En A. Cordero (Coordinador). La evaluación psicológica en el año 2000. Madrid: TEA Ediciones.
  • 25. Rojas, A. J. (2001). Pasado, presente y futuro de los test adaptativos informatizados: Entrevista con Isaac I. Béjar. Psicothema, 13, 685-690.
  • 26. Sands, W. A., Waters, B. K., & McBride, J. R. (Eds.) (1997). Computerized adaptive testing: From inquiry to operation. Washington: American Psychological Association.
  • 27. Sanmartín, J., & Vidal, A. (1988). Generation, correction and analysis of computerized objective tests. Wheels for the Mind Europe, 3, 23-28.
  • 28. Sommerville, I. (1985). Software engineering. Wokingham: Addison-Wesley. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
  • 29. Thissen, D., Chen, W., & Bock, D. (2004). MULTILOG (version 7) [Computer program]. Chicago: SSI Scientific Software. Available: http://www.ssicentral.com
  • 30. Timminga, E., & van-der-Linden, W. J. (1996). CONTEST (version 1.0) [Computer program]. Groningen 9700AV: The Netherlands. P. O. BOX 841.
  • 31. Vale, C. D. (1986). Linking item parameters onto a common scale. Applied Psychological Measurement, 10, 333-344.
  • 32. van der Linden, W. C., & Glass, C. A. W. (Eds.) (2000). Computerized adaptive testing: Theory and practice. Boston, MA: Kluver Academic Publishers.
  • 33. Wainer, H., & Mislevy, R. J. (1990). Item response theory, item calibration and proficiency estimation. In H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 65-102). Hillsdale, NJ: Lawrence Erlbaum.
  • 34. Wainer, H., & Steinberg, L. (2000). Computerized adaptive testing: A primer (2nd edition). Hillsdale, NJ: Lawrence Erlbaum.
  • 35. Weiss, D. J. (2005). Manual for the FastTEST Test Development System (version 2.0) [Computer program]. St. Paul, MN: Assessment Systems Corporation. Available: http://www.assess.com
  • 36. Willits, J. (1992), Database design and construction. London: Library Association Publishing.
  • 37. Wise, S. L., & Kingsbury, G. G. (2000). Practical issues in developing and maintaining a computerized adaptive test. Psicológica, 21, 135-155.
Data source: Dialnet