Hostname: page-component-8448b6f56d-t5pn6 Total loading time: 0 Render date: 2024-04-23T14:30:01.165Z Has data issue: false hasContentIssue false

Validation of the Spanish Version of the School Engagement Measure (SEM)

Published online by Cambridge University Press:  24 November 2016

Estibaliz Ramos-Díaz*
Affiliation:
Universidad del País Vasco/Euskal Herriko Unibertsitatea (Spain)
Arantzazu Rodríguez-Fernández
Affiliation:
Universidad del País Vasco/Euskal Herriko Unibertsitatea (Spain)
Lorena Revuelta
Affiliation:
Universidad del País Vasco/Euskal Herriko Unibertsitatea (Spain)
*
*Correspondence concerning this article should be addressed to Estibaliz Ramos-Díaz. University of the Basque Country. Developmental and Educational Psychology Department. Barrio Sarriena s/n. 48940. Leioa, Bizkaia (Spain). Phone: +34–647504368. E-mail: estibaliz.ramos@ehu.eus

Abstract

The scientific study of school engagement has recently been the subject of considerable interest in the field of educational psychology, and significant advances have been made in our knowledge of this construct. For instance, there is currently consensus in the scientific community that it is multifaceted, and has three dimensions: behavioral engagement, emotional engagement, and cognitive engagement. However, more advanced statistical analyses are needed to validate Spanish-language measures of school engagement, which this study proposes to do. The sample was comprised of 1,250 adolescents from Basque Country (49% boys, 51% girls) aged 12 to 15 years old (M = 13.72, SD = 1.09). The results of confirmatory factor analysis on the School Engagement Measure (Fredricks, Blumenfeld, Friedel, & Paris, 2005) supported a three-dimensional structure of school engagement (χ2(100) = 676.93, p < .001; GFI = .931; CFI = .906; IFI = .907; SRMR = .058; RMSEA = .068). Reliability indexes were satisfactory, ranging from .83 to .94. Adequate evidence of concurrent validity was found for the variable perceived school performance (p < .01). The results are discussed from an educational perspective, and with an eye to future research.

Type
Research Article
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abbott-Chapman, J., Martin, K., Ollington, N., Venn, A., Dwyer, T., & Gall, S. (2014). The longitudinal association of childhood school engagement with adult educational and occupational achievement: Findings from an Australian national study. British Educational Research Journal, 40(1), 102120. https://doi.org/10.1002/berj.3031 Google Scholar
Appleton, J. J. (2012). Systems consultation: Developing the assessment-to-intervention link with the student engagement instrument. In Christenson, S. L., Reschly, A. L., Wylie, C., Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 725741). New York, NY: Springer.Google Scholar
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the student engagement instrument. Journal of School Psychology, 44, 427445. https://doi.org/10.1016/j.jsp.2006.04.002 Google Scholar
Barrett, P. (2007). Structural equation modeling: Adjudging model fit. Personality and Individual Differences, 42, 815824. https://doi.org/10.1016/j.paid.2006.09.018 Google Scholar
Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.Google Scholar
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods Research, 21, 230258. https://doi.org/10.1177/0049124192021002005 Google Scholar
Chase, P. A., Hilliard, L. J., Geldhof, G. J., Warren, D. J. A., & Lerner, R. M. (2014). Academic achievement in the high school years: The changing role of school engagement. Journal of Youth and Adolescence, 43, 884896. https://doi.org/10.1007/s10964-013-0085-4 CrossRefGoogle ScholarPubMed
Finn, J. D. (1989). Withdrawing from school. Review of Educational Research, 59, 117142. https://doi.org/10.2307/1170412 Google Scholar
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59109. https://doi.org/10.3102/00346543074001059 CrossRefGoogle Scholar
Fredricks, J. A., Blumenfeld, P. C., Friedel, J., & Paris, A. (2005). School engagement. In Moore, K. A. & Lippman, L. (Eds.), Conceptualizing and measuring indicators of positive development: What do children need to flourish? (pp. 305321). New York, NY: Kluwer Academic/Plenum Press.Google Scholar
Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In Christenson, S. L., Reschly, A. L., Wylie, C., Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 763782). New York, NY: Springer.Google Scholar
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 3950. https://doi.org/10.2307/3151312 Google Scholar
Garrett, C. (2011). Defining, detecting, and promoting student engagement in college learning environments. Transformative Dialogues: Teaching & Learning Journal, 5, 112.Google Scholar
Glanville, J. L., & Wildhagen, T. (2007). The measurement of school engagement: Assessing dimensionality and measurement invariance across race and ethnicity. Educational and Psychological Measurement, 67, 10191041. https://doi.org/10.1177/0013164406299126 CrossRefGoogle Scholar
Green, J., Liem, G. A. D., Martin, A. J., Colmar, S., Marsh, H. W., & McInerney, D. (2012). Academic motivation, self-concept, engagement, and performance in high school: Key processes from a longitudinal perspective. Journal of Adolescence, 35, 11111122. https://doi.org/10.1016/j.adolescence.2012.02.016 Google Scholar
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis. Upper Saddle River, NJ: Pearson Prentice Hall.Google Scholar
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 155. https://doi.org/10.1080/10705519909540118 Google Scholar
Kline, R. B. (2011). Principles and practice of structural equation modeling. New York, NY: The Guilford Press.Google Scholar
Kristjánsson, K. (2012). Positive psychology and positive education: Old wine in new bottles? Educational Psychologist, 47, 86105.CrossRefGoogle Scholar
Li, Y., Lynch, A. D., Kalvin, C., Liu, J., & Lerner, R. M. (2011). Peer relationships as a context for the development of school engagement during early adolescence. International Journal of Behavioral Development, 35, 329342. https://doi.org/10.1177/0165025411402578 Google Scholar
Mahatmya, D., Lohman, B. J., Matjasko, J. L., & Farb, A. (2012). Engagement across developmental periods. In Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 4563). New York, NY: Springer Science + Business Media.Google Scholar
Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle, and high school years. American Educational Research Journal, 37(1), 153184. https://doi.org/10.2307/1163475 Google Scholar
Moral, J., Sánchez-Sosa, J. C., & Villareal-González, M. (2010). Desarrollo de una Escala Multidimensional Breve de Ajuste Escolar [Development of a Brief Scale of School Adjustment]. Revista Electrónica de Metodología Aplicada, 15(1), 111.Google Scholar
Motti-Stefanidi, F., & Masten, A. S. (2013). School success and school engagement of immigrant children and adolescents: A risk and resilience developmental perspective. European Psychologist, 18, 126135. https://doi.org/10.1027/1016-9040/a000139 CrossRefGoogle Scholar
Muñiz, J., & Hambleton, R. K. (1996). Directrices para la traducción y adaptación de tests [Guidelines for test translation and adaptation]. Papeles del Psicólogo, 66, 6370.Google Scholar
Nunnally, J. C. (1967). Psychometric theory. New York, NY: McGraw-Hill.Google Scholar
Peterson, R. A., & Kim, Y. (2013). On the relationship between coefficient alpha and composite reliability. Journal of Applied Psychology, 98(1), 194198. https://doi.org/10.1037/a0030767 Google Scholar
Reschly, A. L., & Christenson, S. L. (2006). Prediction of dropout among students with mild disabilities: A case for the inclusion of student engagement variables. Remedial and Special Education, 27, 276292. https://doi.org/10.1177/07419325060270050301 Google Scholar
Reschly, A. L., & Christenson, S. L. (2012). Jingle, jangle, and conceptual haziness: Evolution and future directions of the engagement construct. In Christenson, S. L., Reschly, A. L., Wylie, C., Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 319). New York, NY: Springer Science + Business Media.Google Scholar
Rodríguez-Fernández, A., Ramos-Díaz, E., Madariaga, J. M., Arrivillaga, A., & Galende, N. (2016). Steps in the construction and verification of an explanatory model of psychosocial adjustment. European Journal of Education and Psychology, 9(1), 2028. https://doi.org/10.1016/j.ejeps.2015.11.002 Google Scholar
Ros, I., (2014). El sentimiento de pertenencia de los estudiantes por curso y género en una cooperativa escolar de trabajo asociado [Sense of belonging in students, by year in school and gender, in a student worker cooperative]. Revista de Psicología y Educación, 9(1), 201218.Google Scholar
Ros, I., Goikoetxea, J., Gairín, J., & Lekue, P. (2012). Student engagement in the school: Interpersonal and inter-center differences. Journal of Psychodidactics, 17, 291307.Google Scholar
Rumberger, R. W., & Rotermund, S. (2012). The relationship between engagement and high school dropout. In Christenson, S. L., Reschly, A. L., Wylie, C., Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 491513). New York, NY: Springer Science + Business Media.CrossRefGoogle Scholar
Skinner, E., Furrer, C., Marchand, G., & Kindermann, T. (2008). Engagement and disaffection in the classroom: Part of a larger motivational dynamic? Journal of Educational Psychology, 100, 765781. https://doi.org/10.1037/a0012840 Google Scholar
Schumacker, R. E., & Lomax, R. G. (2010). A beginner’s guide to structural equation modeling. New York, NY: Routledge/Taylor & Francis Group.Google Scholar
Veiga, F. H., Burden, R., Appleton, J., Taveira, M. C., & Galvão, D. (2014). Envolvimiento de los estudiantes en la escuela: Conceptualización y relaciones con variables personales y rendimiento académico. Una revisión de la literatura [Student involvement in school: Conceptualization and relationship to personal variables and academic achievement. A review of the literature]. Revista de Psicología y Educación, 9(1), 2947.Google Scholar
Voelkl, K. E. (2012). School identification. In Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 193218). New York, NY: Springer.Google Scholar
Wang, M. T., & Holcombe, R. (2010). Adolescents’ perceptions of school environment, engagement, and academic achievement in middle school. American Educational Research Journal, 47, 633662. https://doi.org/10.3102/0002831209361209 Google Scholar
Wang, M. T., Willett, J. B., & Eccles, J. S. (2011). The assessment of school engagement: Examining dimensionality and measurement invariance by gender and race/ethnicity. Journal of School Psychology, 49, 465480. https://doi.org/10.1016/j.jsp.2011.04.001 Google Scholar
Wylie, C., & Hodgen, E. (2012). Trajectories and patterns of student engagement: Evidence from a longitudinal study. In Christenson, S. L., Reschly, A. L., Wylie, C., Christenson, S. L., Reschly, A. L., & Wylie, C. (Eds.), Handbook of research on student engagement (pp. 585599). New York, NY: Springer Science + Business Media.Google Scholar
Yazzie-Mintz, E. (2007). Voices of students on engagement: A report on the 2006 High School Survey of Student Engagement. Bloomington, IN: Center for Evaluation & Educational Policy, Indiana University.Google Scholar