A multistage adaptive test of fluid intelligence

  1. Manuel Martín-Fernández 1
  2. Vicente Ponsoda 1
  3. Julio Olea 1
  4. Pei-Chun Shih 1
  5. Javier Revuelta 1
  1. 1 Universidad Autónoma de Madrid (España)
Zeitschrift:
Psicothema

ISSN: 0214-9915

Datum der Publikation: 2016

Ausgabe: 28

Nummer: 3

Seiten: 346-352

Art: Artikel

DIALNET GOOGLE SCHOLAR lock_openOpen Access editor

Andere Publikationen in: Psicothema

Zusammenfassung

Background: Multistage adaptive testing has recently emerged as an alternative to the computerized adaptive test. The current study details a new multistage test to assess fluid intelligence. Method: An item pool of progressive matrices with constructed response format was developed, and divided into six subtests. The subtests were applied to a sample of 724 college students and their psychometric properties were studied (i.e., reliability, dimensionality and validity evidence). The item pool was calibrated under the graded response model, and two multistage structures were developed, based on the automatic test assembly principles. Finally, the test information provided by each structure was compared in order to select the most appropriate one. Results: The item pool showed adequate psychometric properties. From the two compared multistage structures, the simplest structure (i.e., routing test and two modules in the next stages) were more informative across the latent trait continuum and were therefore kept. Discussion: Taken together, the results of the two studies support the application of the FIMT (Fluid Intelligence Multistage Test), a multistage test to assess fluid intelligence accurately and innovatively

Bibliographische Referenzen

  • Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2002). Individual differences in working memory within a nomological network of cognitive and perceptual speed abilities. Journal of Experimental Psychology: General, 131, 567-589.
  • Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005). Working memory and intelligence: The same or different constructs? Psychological Bulletin, 131, 30-60.
  • Carpenter, P. A., Just, M. A., & Shell, P. (1990). What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychological Review, 97(3), 404.
  • Chalmers, R. P. (2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29.
  • Colom, R., Abad, F. J., Quiroga, M. A., Shih, P. C., & Flores-Mendoza, C. (2008). Working memory and intelligence are highly related constructs, but why? Intelligence, 36(6), 584-606.
  • Colom, R., Escorial, S., Shih, P. C., & Privado, J. (2007). Fluid intelligence, memory span, and temperament difficulties predict academic performance of young adolescents. Personality and Individual Differences, 42(8), 1503-1514.
  • Colom, R., Rebollo, I., Palacios, A., Juan-Espinosa, M., & Kyllonen, P. C. (2004). Working memory is (almost) perfectly predicted by g. Intelligence, 32(3), 277-296.
  • Cordero Pando, A. (1984). PMA: Aptitudes Mentales Primarias 6ª ed. rev. [PMA: Primary Mental Aptitudes 6th edition]. Madrid: TEA Ediciones.
  • Diao, Q., & van der Linden, W., J. (2011). Automated test assembly using lp_solve version 5.5 in R. Applied Psychological Measurement, 35, 398-409.
  • Elosúa, M. R., Gutiérrez, F., García-Madruga, J. A., Luque, J. L., & Gárate, M. (1996). Adaptación española del “Reading Span Test” de Daneman y Carpenter [Spanish standardization of the Reading Span Test]. Psicothema, 8, 383-395.
  • Glas, C. A., & van der Linden, W. J. (2003). Computerized adaptive testing with item cloning. Applied Psychological Measurement, 27(4), 247- 261.
  • Hendrickson, A. (2007). An NCME instructional module on multistage testing. Educational Measurement: Issues and Practice, 26(2), 44-52. Kunda, M., McGreggor, K., & Goel, A. K. (2013). A computational model for solving problems from the Raven’s Progressive Matrices intelligence test using iconic visual representations. Cognitive Systems Research, 22, 47-66.
  • Luecht, R. M., & Nungester, R. J. (1998). Some practical examples of computer-adaptive sequential testing. Journal of Educational Measurement, 35, 229-249.
  • Martín-Fernández, M., Ponsoda, V., Olea, J., Shih, P.C. & Revuelta, J. (2015). Test multietapa de inteligencia fluida [Fluid Intelligence Multistage Test]. Retrieved from: http://www.iic.uam.es/catedras /map/publicaciones.
  • Maydeu-Olivares, A., & Joe, H. (2006). Limited information goodness- of-fit testing in multidimensional contingency tables. Psychometrika, 71(4), 713-732.
  • Miyake, A., Friedman, N. P., Rettinger, D. A., Shah, P., & Hegarty, M. (2001). How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. Journal of Experimental Psychology: General, 130, 621-640.
  • Primi, R. (2001). Complexity of geometric inductive reasoning tasks: Contribution to the understanding of fluid intelligence. Intelligence, 30(1), 41-70.
  • Revelle, W. (2015). Procedures for personality and psychological research. Evanston, Il: Northwestern University.
  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. New York, NY: Psychometric Society.
  • Samejima, F. (1974). Normal ogive model on the continuous response level in the multidimensional latent space. Psychometrika, 39(1), 111- 121.
  • Snow, R. E., Kyllonen, P. C., & Marshalek, B. (1984). The topography of ability and learning correlations. Advances in the Psychology of Human Intelligence, 2, 47-103.
  • Swanson, L., & Stocking, M. L. (1993). A model and heuristic for solving very large item selection problems. Applied Psychological Measurement, 17(2), 151-166.
  • von Davier, A. A., Holland, P. W., & Thayer, D. T. (2004). The kernel method of test equating. New York, NY: Springer.
  • Wang, X., Fluegge, L., & Luecht, R. (2012). A large-scale comparative study of the accuracy and efficiency of ca-MST. Paper presented at the annual meeting of the National Council on Measurement en Education, Vancouver, BC, Canada.
  • Yan, D., von Davier, A. A., & Lewis, C. (2014). Computerized multistage testing: Theory and applications. New York, NY: CRC Press.
  • Corral, S., & Cordero Pando, A. (2006). DAT-5: Test de Aptitudes Diferenciales Versión 5 [DAT-5: Differential aptitude test]. Madrid: TEA Ediciones.
  • Konis, K. (2014). lpSolveAPI: R Interface for lp_solve version 5.5.2.0. R package version 5.5.2.0-14. Retrieved from https://cran.r-project.org/web/packages/lpSolveAPI/index.html.
Fuente de los datos: Dialnet