Protoco. How to deal with Partial Least Squares (PLS) research in Operations Managementa guide for sending papers to academic journals

  1. Marin-Garcia, Juan A. 1
  2. Alfalla-Luque, Rafaela 2
  1. 1 ROGLE - Departamento de Organización de Empresas - Universidad Politécnica de Valencia
  2. 2 GIDEAO Research Group, Departamento de Economía Financiera y Dirección de Operaciones Universidad de Sevilla
Zeitschrift:
WPOM

ISSN: 1989-9068

Datum der Publikation: 2019

Ausgabe: 10

Nummer: 1

Seiten: 29-69

Art: Artikel

DOI: 10.4995/WPOM.V10I1.10802 DIALNET GOOGLE SCHOLAR lock_openOpen Access editor

Andere Publikationen in: WPOM

Ziele für nachhaltige Entwicklung

Zusammenfassung

Este protocolo de trabajo se enmarca en el contexto de la publicación en tres fases (Marin-Garcia, 2019). Tiene como objetivo establecer el procedimiento de trabajo para responder a las siguientes preguntas: 1) ¿en qué revistas han publicado entre 2014 y 2018 artículos de Dirección de Operaciones analizados con Partial Least Squares (PLS)?; 2) ¿Siguen vigentes los resultados de las revisiones anteriores sobre el tema, basadas en un conjunto muy limitado de revistas y realizadas antes de las modificaciones sustanciales en los métodos de reporte de estudios basados en PLS?; 3)¿Cumplen los artículos recientes con las recomendaciones de reporte?; 4) ¿Qué tipo de modelo de medida se ha considerado para los constructos más frecuentes en los artículos seleccionados?; 5)¿Qué valores de R2 son habituales en los estudios de campo transversales representados en los artículos seleccionados?; 6) ¿En qué rango de potencia estadística (statistical power)se han situado las relaciones analizadas con PLS?El artículo resume las recomendaciones actuales para seleccionar los procedimientos de análisis y hacer el reporte de las investigaciones que utilizan ecuaciones estructurales con PLS. Consideramos que ello supone una gran contribución para los investigadores, pues ayuda a mejorar los análisis y reportes derivados del empleo de PLS y, con ello, aumentar las probabilidades de aceptación en revistas relevantes.Otracontribucióndel presente trabajo, además de establecer el protocolo mencionado,es presentar una lista de los artículos recientes de Dirección de Operaciones que han usado PLSy el procedimiento de codificaciónpara realizar nuestrarevisión sistemática(que se publicará más adelante).

Bibliographische Referenzen

  • Alfalla-Luque, R., Machuca, J. A. D., & Marin-Garcia, J. A. (2018). Triple-a and competitive advantage in supply chains: Empirical research in developed countries. International Journal of Production Economics, 203(September), 48-61. doi:https://doi.org/10.1016/j.ijpe.2018.05.020
  • Aria, M., & Cuccurullo, C. (2017). Bibliometrix: An r-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959-975. doi:https://doi.org/10.1016/j.joi.2017.08.007
  • Ato, M., & Vallejo, G. (2011). Los efectos de terceras variables en la investigación psicológica. Anales de Psicología, 27(2), 550-561.
  • Avkiran, N. K. (2018). An in-depth discussion and illustration of partial least squares structural equation modeling in health care. Health Care Management Science, 21(3), 401-408. doi:10.1007/s10729-017-9393-7
  • Becker, J. M., Rai, A., & Rigdon, E. E. (2013a). Predictive validity and formative measurement in structural equation modeling: Embracing practical relevance. Paper presented at the Proceedings of the International Conference on Information Systems, Milan, Italy.
  • Becker, J. M., Rai, A., Ringle, C. M., & Völckner, F. (2013b). Discovering unobserved heterogeneity in structural equation models to avert validity threats. MIS Quarterly: Management Information Systems, 37(3), 665-694. doi:10.25300/MISQ/2013/37.3.01
  • Benet-Zepf, A., Marin-Garcia, J. A., & Küster, I. (2018). Clustering the mediators between the sales control systems and the sales performance using the amo model: A narrative systematic literature review. Intangible Capital, 14(3), 387-408. doi:http://dx.doi.org/10.3926/ic.1222
  • Blome, C., Hollos, D., & Paulraj, A. (2014). Green procurement and green supplier development: Antecedents and effects on supplier performance. International Journal of Production Research, 52(1), 32-49. doi:10.1080/00207543.2013.825748
  • Bodoff, D., & Ho, S. Y. (2016). Partial least squares structural equation modeling approach for analyzing a model with a binary indicator as an endogenous variable. Communications of the Association for Information Systems, 28(23). doi:10.17705/1CAIS.03823
  • Bollen, K. A. (2011). Evaluating effect, composite, and causal indicators in structural equation models. Mis Quarterly, 35(2), 359-372. doi:10.2307/23044047
  • Bollen, K. A., & Bauldry, S. (2011). Three cs in measurement models: Causal indicators, composite indicators, and covariates. Psychological Methods, 16(3), 265-284. doi:10.1037/a0024448
  • Bond, T. (2008). Tuneable goodness-of-fit statistics. Rasch Measurement Transactions, 22(1), 1156-1157.
  • Boronat-Soler, T. (2018). Which are the leading journals in human resources management and operations management in the web of science and scopus databases? Design and application of a classification method. WPOM-Working Papers on Operations Management, 9(2), 127-181. doi:10.4995/wpom.v9i2.10763
  • Cepeda-Carrion, G., Cegarra-Navarro, J.-G., & Cillo, V. (2019). Tips to use partial least squares structural equation modelling (pls-sem) in knowledge management. Journal of Knowledge Management, 23(1), 67-89. doi:doi:10.1108/JKM-05-2018-0322
  • Champely, S. (2018). Pwr: Basic functions for power analysis. R package version 1.2-2.: https://CRAN.R-project.org/package=pwr
  • Chin, W. W. (1998). Commentary: Issues and opinion on structural equation modeling. Mis Quarterly, vii-xvi.
  • Diamantopoulos, A. (2006). The error term in formative measurement models: Interpretation and modeling implications. Journal of modelling in management, 1(1), 7-17. doi:10.1108/17465660610667775
  • Diamantopoulos, A., & Siguaw, J. A. (2006). Formative versus reflective indicators in organizational measure development: A comparison and empirical illustration. British Journal of Management, 17(4), 263-282. doi:10.1111/j.1467-8551.2006.00500.x
  • Dijkstra, T. K., & Henseler, J. (2015a). Consistent and asymptotically normal pls estimators for linear structural equations. Computational Statistics & Data Analysis, 81, 10-23. doi:10.1016/j.csda.2014.07.008
  • Dijkstra, T. K., & Henseler, J. (2015b). Consitent partial least squares path modeling. Mis Quarterly, 39(2), 297-316.
  • do Valle, P. O., & Assaker, G. (2016). Using partial least squares structural equation modeling in tourism research: A review of past research and recommendations for future applications. Journal of Travel Research, 55(6), 695–708. doi:https://doi.org/10.1177/0047287515569779
  • Duarte, P., & Amaro, S. (2018). Methods for modelling reflective-formative second order constructs in pls: An application to online travel shopping. Journal of Hospitality and Tourism Technology, 9(3), 295-313. doi:doi:10.1108/JHTT-09-2017-0092
  • Eck, N. J. V., & Waltman, L. (2014). Visualizing bibliometric networks (pp. 285-320)
  • Esposito Vinzi, V., Chin, W. W., Henseler, J., & Wang, H. (2010). Handbook of partial least squares. Concepts, methods and applications. London: Springer.
  • Fassott, G., Henseler, J., & P.S, C. (2016). Testing moderating effects in pls path models with composite variables. Industrial Management & Data Systems, 116(9), 1887-1900. doi:10.1108/IMDS-06-2016-0248
  • Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using g*power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149-1160. doi:10.3758/BRM.41.4.1149
  • Felipe, C., Roldán, J., & Leal-Rodríguez, A. (2017). Impact of organizational culture values on organizational agility. Sustainability, 9(12), 2354.
  • Garfield, E. (2004). Historiographic mapping of knowledge domains literature. Journal of Information Science, 30(2), 119-145. doi:10.1177/0165551504042802
  • Grace, J. B., & Bollen, K. A. (2008). Representing general theoretical concepts in structural equation models: The role of composite variables. Environmental and Ecological Statistics, 15(2), 191-213. doi:10.1007/s10651-007-0047-7
  • Gudergan, S. P., Ringle, C. M., Wende, S., & Will, A. (2008). Confirmatory tetrad analysis in pls path modeling. Journal of Business Research, 61(12), 1238-1249.
  • Hair, J. F., Hult, G. T., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (pls-sem). 2nd edition. Thousand Oaks: Sage.
  • Hair, J. F., Hult, G. T., Ringle, C. M., Sarstedt, M., Castillo Apraiz, J., Cepeda Carrión, G., & Roldan, J. L. (2019a). Manual de partial least squares structural equation modeling (pls-sem) (2nd ed.). Terrassa, Spain: OmniaScience:.
  • Hair, J. F., Ringle, C. M., & Sarstedt, M. (2012a). Partial least squares: The better approach to structural equation modeling? Long Range Planning, 45(5), 312-319. doi:https://doi.org/10.1016/j.lrp.2012.09.011
  • Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019b). When to use and how to report the results of pls-sem. European Business Review, 31(1), 2-24. doi:doi:10.1108/EBR-11-2018-0203
  • Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. (2018). Advanced issues in partial least squares structural equation modeling. Los Angeles: SAGE.
  • Hair, J. F., Sarstedt, M., Ringle, C. M., & Mena, J. (2012b). An assessment of the use of partial least squares structural equation modeling in marketing research. Journal of the Academy of Marketing Science, 40(3), 414-433.
  • Henseler, J. (2015). Is the whole more than the sum of its parts? On the interplay of marketing and design research: Initial lecture: Universiteit Twente
  • Henseler, J. (2017a). Bridging design and behavioral research with variance-based structural equation modeling. Journal of Advertising, 46(1), 178-192. doi:10.1080/00913367.2017.1281780
  • Henseler, J. (2017b). User manual adanco 2.0.1 (1st ed.). Kleve: Composite Modeling GmbH & Co.
  • Henseler, J., Dijkstra, T. K., Sarstedt, M., Ringle, C. M., Diamantopoulos, A., Straub, D. W., . . . Calantone, R. J. (2014). Common beliefs and reality about pls: Comments on ronkko and evermann (2013). Organizational Research Methods, 17(2), 182-209. doi:10.1177/1094428114526928
  • Henseler, J., Hubona, G., & Ray, P. A. (2016a). Using pls path modeling in new technology research : Updated guidelines. Industrial Management & Data Systems, 116(1), 2-20. doi:10.1108/IMDS-09-2015-0382
  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115-135. doi:10.1007/s11747-014-0403-8
  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2016b). Testing measurement invariance of composites using partial least squares. International Marketing Review, 33(3), 405-431. doi:10.1108/IMR-09-2014-0304
  • Henseler, J., Ringle, C. M., & Sinkovics, R. R. (2009). The use of partial least squares path modeling in international marketing. In R. R. Sinkovics & N. G. Pervez (Eds.), Advances in international marketing (pp. 277-319). Bingley: Emerald
  • Henseler, J., & Roldan, J. L. (2017). Coping with endogeneity in composite modeling. Paper presented at the Paper presented at 8th Annual Conference of the European Decision Sciences Institute, Granada, Spain.
  • Hock, C., Ringle, C. M., & Sarstedt, M. (2010). Management of multi-purpose stadiums: Importance and performance measurement of service interfaces. International Journal of Services Technology and Management, 14(2-3), 188-207. doi:10.1504/IJSTM.2010.034327
  • Hult, G. T. M., Hair, J. F., Proksch, D., Sarstedt, M., Pinkwart, A., & Ringle, C. M. (2018). Addressing endogeneity in international marketing applications of partial least squares structural equation modeling. Journal of International Marketing, 26(3), 1-21. doi:10.1509/jim.17.0151
  • Illia, L., Sonpar, K., & Bauer, M. W. (2014). Applying co-occurrence text analysis with alceste to studies of impression management. British Journal of Management, 25(2), 352-372. doi:10.1111/j.1467-8551.2012.00842.x
  • Image. (2015). Alceste 2015. A software for textual data analysis. Windows version. Toulouse: Image.
  • Jarvis, C.-B., MacKenzie, S.-B., & Podsakoff, P.-M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199-218.
  • Kareem, J. A. H., & Amin, O. (2017). Ethical and psychological factors in 5s and total productive maintenance. Journal of Industrial Engineering and Management-Jiem, 10(3), 444-475. doi:10.3926/jiem.2313
  • Kaufmann, L., & Gaeckler, J. (2015). A structured review of partial least squares in supply chain management research. Journal of Purchasing and Supply Management, 21(4), 259-272. doi:https://doi.org/10.1016/j.pursup.2015.04.005
  • Khan, G. F., Sarstedt, M., Shiau, W.-L., Hair, J. F., Ringle, C. M., & Fritze, M. P. (2019). Methodological research on partial least squares structural equation modeling (pls-sem): An analysis based on social network approaches. Internet Research. doi:10.1108/IntR-12-2017-0509
  • Kumar, D. S., & Purani, K. (2018). Model specification issues in pls-sem: Illustrating linear and non-linear models in hospitality services context. Journal of Hospitality and Tourism Technology, 9(3), 338-353. doi:doi:10.1108/JHTT-09-2017-0105
  • Latan, H. (2018). Pls path modeling in hospitality and tourism research: The golden age and days of future past Applying partial least squares in tourism and hospitality researchedition: 1chapter: 4. Bingley: Emerald Publishing Limited
  • Losilla, J.-M., Oliveras, I., Marin-Garcia, J. A., & Vives, J. (2018). Three risk of bias tools lead to opposite conclusions in observational research synthesis. Journal of Clinical Epidemiology(101), 61-72. doi:10.1016/j.jclinepi.2018.05.021
  • Marin-Garcia, J. A. (2015). Publishing in two phases for focused research by means of "research collaborations". WPOM-Working Papers on Operations Management, 6(2), 76-80. doi:http://dx.doi.org/10.4995/wpom.v6i2.4459
  • Marin-Garcia, J. A. (2018). Development and validation of spanish version of fincoda: An instrument for self-assessment of innovation competence of workers or candidates for jobs. WPOM-Working Papers on Operations Management, 9(2), 182-215. doi:10.4995/wpom.v9i2.10800
  • Marin-Garcia, J. A. (2019). Publishing in three stages to support evidence based practice in om, hrm and teaching&learning innovation. WPOM-Working Papers on Operations Management, 10(2), in press.
  • Marin-Garcia, J. A., & Alfalla-Luque, R. (2018). Protocol: Is there agreement or disagreement between the absolute and relative impact indices obtained from the web of science and scopus data? WPOM-Working Papers on Operations Management, Vol 9(1), 53-80. doi:10.4995/wpom.v9i1.8989
  • Marin-Garcia, J. A., Alfalla-Luque, R., & Machuca, J. A. D. (2018). A triple-a supply chain measurement model: Validation and analysis. International Journal of Physical Distribution & Logistics Management, 48(10), 976-994. doi:10.1108/IJPDLM-06-2018-0233
  • Marin-Garcia, J. A., & Martinez Tomas, J. (2016). Deconstructing amo framework: A systematic review. Intangible Capital, 12(4), 1040-1087. doi:http://dx.doi.org/10.3926/ic.838
  • Marin-Garcia, J. A., & Mateo Martínez, R. (2013). Barreras y facilitadores de la implantación del tpm. Intangible Capital, 9(3), 823-853. doi:http://dx.doi.org/10.3926/ic.360
  • Matthews, L. M., Sarstedt, M., Hair, J. F., & Ringle, C. M. (2016). Identifying and treating unobserved heterogeneity with fimix-pls: Part ii – a case study. European Business Review, 28(2), 208-224. doi:doi:10.1108/EBR-09-2015-0095
  • Medina-López, C., Marin-Garcia, J. A., & Alfalla-Luque, R. (2010). Una propuesta metodológica para la realización de búsquedas sistemáticas de bibliografía (a methodological proposal for the systematic literature review). WPOM-Working Papers on Operations Management, 1(2), 13-30. doi:http://dx.doi.org/10.4995/wpom.v1i2.786
  • Muller, T., Schuberth, F., & Henseler, J. (2018). Pls path modeling - a confirmatory approach to study tourism technology and tourist behavior. Journal of Hospitality and Tourism Technology, 9(3), 249-266. doi:10.1108/jhtt-09-2017-0106
  • Nitzl, C. (2016). The use of partial least squares structural equation modelling (pls-sem) in management accounting research: Directions for future theory development. Journal of Accounting Literature, 37, 19-35. doi:https://doi.org/10.1016/j.acclit.2016.09.003
  • Peng, D. X., & Lai, F. (2012). Using partial least squares in operations management research: A practical guideline and summary of past research. Journal of Operations Management, 30(6), 467-480.
  • Petter, S. (2018). "Haters gonna hate": Pls and information systems research. SIGMIS Database, 49(2), 10-13. doi:10.1145/3229335.3229337
  • Reinert, M. (1990). Alceste une méthodologie d'analyse des données textuelles et une application: Aurelia de gerard de nerval. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 26(1), 24-54. doi:10.1177/075910639002600103
  • Reyes, J., Alvarez, K., Martinez, A., & Guaman, J. (2018). Total productive maintenance for the sewing process in footwear. Journal of Industrial Engineering and Management-Jiem, 11(4), 814-822. doi:10.3926/jiem.2644
  • Richter, N. F., Cepeda, G., Roldán, J. L., & Ringle, C. M. (2016). European management research using partial least squares structural equation modeling (pls-sem). European Management Journal, 34(6), 589-597. doi:https://doi.org/10.1016/j.emj.2016.08.001
  • Rigdon, E., Sarstedt, M., & Ringle, C. (2017). On comparing results from cb-sem and pls-sem: Five perspectives and five recommendations. ZFP-Journal of Research and Management, 39(3), 4-16. doi:10.15358/0344-1369-2017-3-4
  • Rigdon, E. E. (2012). Rethinking partial least squares path modeling: In praise of simple methods. Long Range Planning, 45(5–6), 341-358. doi:http://dx.doi.org/10.1016/j.lrp.2012.09.010
  • Rigdon, E. E. (2014). Rethinking partial least squares path modeling: Breaking chains and forging ahead. Long Range Planning, 47(3), 161-167. doi:http://dx.doi.org/10.1016/j.lrp.2014.02.003
  • Rigdon, E. E. (2016). Choosing pls path modeling as analytical method in european management research: A realist perspective. European Management Journal, 34(6), 598-605. doi:http://dx.doi.org/10.1016/j.emj.2016.05.006
  • Ringle, C. M., & Sarstedt, M. (2016). Gain more insight from your pls-sem results: The importance-performance map analysis. Industrial Management & Data Systems, 116(9), 1865-1886. doi:10.1108/IMDS-10-2015-0449
  • Ringle, C. M., Sarstedt, M., Mitchell, R., & Gudergan, S. P. (2018). Partial least squares structural equation modeling in hrm research. The International Journal of Human Resource Management, 1-27. doi:10.1080/09585192.2017.1416655
  • Ringle, C. M., Sarstedt, M., & Straub, D. (2012). Editor's comments: A critical look at the use of pls-sem in "mis quarterly". Mis Quarterly, 36(1), ii-xiv. doi:10.2307/41410402
  • Ringle, C. M., Wende, S., & Becker, J. M. (2015). Smartpls 3. Boenningstedt: SmartPLS GmbH. Available at http://www.smartpls.com
  • Roberts, N., & Thatcher, J. B. (2009). Conceptualizing and testing formative constructs: Tutorial and annotated example. The DATA BASE for Advances in Information Systems, 4(3), 9-39.
  • Roldán, J. L., & Sánchez-Franco, M. J. (2012). Variance-based structural equation modeling: Guidelines for using partial least squares in information systems research. In M. Mora, O. Gelman, A. Steenkamp, & M. Raisinghani (Eds.), Research methodologies, innovations and philosophies in software systems engineering and information systems (pp. 193–221). Hershey PA: IGI Global
  • Sanchez-Franco, M. J., Cepeda-Carrion, G., & Roldán, J. L. (2019). Understanding relationship quality in hospitality services: A study based on text analytics and partial least squares. Internet Research, 0(0), in press. doi:doi:10.1108/IntR-12-2017-0531
  • Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with pls and cbsem: Where the bias lies! Journal of Business Research, 69(10), 3998-4010. doi:http://dx.doi.org/10.1016/j.jbusres.2016.06.007
  • Sarstedt, M., Ringle, C. M., & Hair, J. F. (2017). Treating unobserved heterogeneity in pls-sem: A multi-method approach. In H. Latan & R. Noonan (Eds.), Partial least squares path modeling: Basic concepts, methodological issues and applications (pp. 197-217). Cham: Springer International Publishing
  • Schuberth, F., Henseler, J., & Dijkstra, T. K. (2018a). Confirmatory composite analysis. Frontiers in Psychology, 9(2541), 1-14. doi:10.3389/fpsyg.2018.02541
  • Schuberth, F., Henseler, J., & Dijkstra, T. K. (2018b). Partial least squares path modeling using ordinal categorical indicators. Quality & Quantity, 52(1), 9-35. doi:10.1007/s11135-016-0401-7
  • Sharma, P. N., Sarstedt, M., Shmueli, G., Kim, K. H., & Thiele, K. O. (2019). Pls-based model selection: The role of alternative explanations in information systems research. Journal of the Association for Information Systems, in press.
  • Shmueli, G., Ray, S., Velasquez Estrada, J. M., & Chatla, S. B. (2016). The elephant in the room: Predictive performance of pls models. Journal of Business Research, 69(10), 4552-4564. doi:https://doi.org/10.1016/j.jbusres.2016.03.049
  • Streukens, S., & Leroi-Werelds, S. (2016). Bootstrapping and pls-sem: A step-by-step guide to get more out of your bootstrap results. European Management Journal, 34(6), 618-632. doi:https://doi.org/10.1016/j.emj.2016.06.003
  • Tabet, S. M., Lambie, G. W., Jahani, S., & Rasoolimanesh, S. M. (2019a). An analysis of the world health organization disability assessment schedule 2.0 measurement model using partial least squares–structural equation modeling. Assessment, 1073191119834653. doi:10.1177/1073191119834653
  • Tabet, S. M., Lambie, G. W., Jahani, S., & Rasoolimanesh, S. M. (2019b). The factor structure of outcome questionnaire–45.2 scores using confirmatory tetrad analysis–partial least squares. Journal of Psychoeducational Assessment, 0734282919842035. doi:10.1177/0734282919842035
  • Urbach, N., & Ahleman, F. (2010). Structural equation modeling in information systems research using partial least squares. Journal of Information Technology Theory and Application, 11(2), 1-39.
  • Usakli, A., & Kucukergin, K. G. (2018). Using partial least squares structural equation modeling in hospitality and tourism: Do researchers follow practical guidelines? International Journal of Contemporary Hospitality Management, 30(11), 3462-3512. doi:doi:10.1108/IJCHM-11-2017-0753
  • Voorhees, C., Brady, M., Calantone, R., & Ramirez, E. (2016). Discriminant validity testing in marketing: An analysis, causes for concern, and proposed remedies. Journal of the Academy of Marketing Science, 44(1), 119-134. doi:10.1007/s11747-015-0455-4
  • Whitt, H. P. (1986). The sheaf coefficient: A simplified and expanded approach. Social Science Research, 15(2), 174-189. doi:https://doi.org/10.1016/0049-089X(86)90014-1
  • Wulff Barreiro, E. (2007). El uso del software histcite para identificar artículos significativos en búsquedas por materias en la web of science. Documentación de las Ciencias de la Información, 30, 45-64.
Fuente de los datos: Dialnet