Desarrollo y validación de una herramienta de Observación del Clima Emocional (OCE)
DOI:
https://doi.org/10.30827/profesorado.v28i1.27947Keywords:
competencias emocionales, clima de aula, emociones, método Delphi, metodología observacionalAbstract
This work presents the process of creation (study 1) and validation (study 2) of an instrument of "Emotional Climate Observation (OCE)". In study 1, a Delphi method was carried out in 3 rounds, in which 12 experts on the subject participated. As a result, the OCE emerged, composed of 6 main dimensions and 2 observable aspects in each dimension. The resulting dimensions relate to didactic aspects and aspects related to teachers' emotional competences. In study 2, with the data collected from the 10 observations made by three observers, the psychometric properties of the OCE were analyzed through the Generalizability Theory (GT) and the intraclass and Kappa correlation coefficients. The results obtained show that the OCE is a valid, reliable and useful tool to determine the degree to which the teacher generates a positive, neutral or negative emotional climate, and can be used in educational research or training.
Downloads
References
Alonso-Tapia, J., & Nieto, C. (2019). Classroom emotional climate: nature, measurement, effects and implications for education// Clima emocional de clase: naturaleza, medida, efectos e implicaciones para la educación. Revista de Psicodidactica, 24(2), 79-87. https://doi.org/10.1016/j.psicod.2018.08.002
Andrés-García, I., Muñoz-Moreno, F., Ruíz-López del Prado, G., Gil-Sáez, B., Andrés-Puertas, M., & Almaraz-Gómez, A. (2019). Validación de un cuestionario sobre actitudes y práctica de actividad física y otros hábitos saludables mediante el método Delphi. Revista Española Salud Pública, 93, e201909081.
Anguera, M. T. (2003). La observación. En C. M. Rosset (Ed.), Evaluación psicológica. Concepto, proceso y aplicación en las áreas del desarrollo y de la inteligencia (pp. 271-308). Sanz y Torres.
Anguera, M. T., Blanco, A., Hernández, A., & Losada, J. L. (2011). Diseños observacionales: Ajuste y aplicación en psicología del deporte. Cuadernos de Psicología del Deporte, 11(2), 63-76.
Anguera, M. T., Camerino, O., Castañer, M., Sánchez-Algarra, P., & Onwuegbuzie, A. . (2017). The specificity of observational studies in physical activity and sports sciences: Moving forward in mixed methods research and proposals for achieving quantitative and qualitative symmetry. Frontiers in Psychology, 8:2196. https://doi.org/10.3389/fpsyg.2017.02196
Bar-On, R. (1997). The Emotional Intelligence Inventory (EQ- i): Technical manual. Multi-Heal.
Barrientos, A., Sánchez, R., & Arigita, A. (2019). Formación emocional del profesorado y gestión del clima de su aula. Praxis & Saber, 10(24), 119-141. https://doi.org/https://doi.org/10.19053/22160159.v10.n25.2019.9894
Bieg, S., Grassinger, R., & Dresel, M. (2019). Teacher humor : longitudinal effects on students’ emotions. European Journal of Psychology of Education, 34, 517-534. https://doi.org/https://doi.org/10.1007/s10212-018-0402-0
Bisquerra, R., & Pérez, N. (2007). Las competencias emocionales. Educación XX1, 10, 61-82. https://doi.org/10.5944/educxx1.1.10.297
Blanco-Villaseñor, A. (1991). La teoría de la generalizabilidad aplicada a diseños observacionales. Revista Mexicana de Análisis de la Conducta, 17(3), 23-63.
Blanco-Villaseñor, Á., Castellano, J., & Hernández-Mendo, A. (2014). Aplicación de la TG en el deporte para el estudio de la fiabilidad , validez y estimación de la muestra. Revista de Psicología del Deporte, 23(1), 131-137.
Cerda, J., & Villarroel, L. (2008). Evaluación de la concordancia inter-observador en investigación pediátrica: Coeficiente de Kappa. Revista Chilena de Pediatria, 79(1), 54-58. https://doi.org/10.4067/s0370-41062008000100008
Chacón-Moscoso, S., Anguera, M. T., Sanduvete-Chaves, S., Losada, J. L., Lozano-Lozano, J. A., & Portell, M. (2019). Methodological quality checklist for studies based on observational methodology (MQCOM). Psicothema, 31(4), 458-464. https://doi.org/10.7334/psicothema2019.116
Díaz, M. C., Borges, A., Valadez, M. D., & Zambrano, R. (2015). Assessing of good teaching practices through systematic observation. Universitas Psychologica, 14(3), 913-922. https://doi.org/10.11144/Javeriana.upsy14-3.vbpd
Escartí, A., Gutiérrez, M., Pascual, C., & Wright, P. (2013). Observación de las estrategias que emplean los profesores de educación física para enseñar responsabilidad personal y social. Revista de Psicologia del Deporte, 22(1), 159-166.
Evans, I. M., Harvey, S. T., Buckley, L., & Yan, E. (2009). Differentiating classroom climate concepts: Academic, management, and emotional environments. Kotuitui, 4(2), 131-146. https://doi.org/10.1080/1177083X.2009.9522449
Fabra, P., Balaguer, I., Tomas, I., Smith, N., & Duda, J. (2018). Spanish version of the multidimensional motivational climate observation system (MMCOS): reliability and validity evidences. Revista de Psicología del Deporte/Journal of Sport Psychology, 27(1), 11-22.
Fierro-Suero, S., Almagro, B., Castillo, I., & Sáenz-López, P. (2020). Observational instrument for interpersonal motivational climate (OCIM) for physical education teachers. Cultura, Ciencia y Deporte, 15(46), 575-596. https://doi.org/http://dx.doi.org/10.12800/ccd.v15i46.1647
Fierro-Suero, S., Saénz-López, P., Carmona, J., & Almagro, B. (2022). Achievement emotions, intention to be physically active and academic performance in physical education: Gender differences. Journal of Teaching in Physical Education, Advance online publication. https://doi.org/https://doi.org/10.1123/jtpe.2021-0230 ©
Fleiss, J. L., Levin, B., & Paik, M. C. (1982). Statistical Methods for Rates and Proportions (3rd ed). Wiley-Inte. https://doi.org/10.2307/2982107
Gazelle, H. (2006). Class climate moderates peer relations and emotional adjustment in children with an early history of anxious solitude: A child × environment model. Developmental Psychology, 42(6), 1179-1192. https://doi.org/10.1037/0012-1649.42.6.1179
Goleman, D. (1995). Emotional intelligence. Bantam Boo.
Gómez-Leal, R., Holzer, A. A., Bradley, C., Fernández-Berrocal, P., & Patti, J. (2022). The relationship between emotional intelligence and leadership in school leaders: a systematic review. Cambridge Journal of Education, 52(1), 1-21. https://doi.org/10.1080/0305764X.2021.1927987
Haerens, L., Aelterman, N., Van den Berghe, L., De Meyer, J., Soenens, B., & Vansteenkiste, M. (2013). Observing physical education teachers’ need-supportive interactions in classroom settings. Journal of Sport and Exercise Psychology, 35, 3-17. https://doi.org/10.1123/jsep.35.1.3
Harvey, S. T., Evans, I. M., Hill, R. V. J., Henricksen, A., & Bimler, D. (2016). Warming the emotional climate of the classroom : Can teachers ’ social-emotional skills change? The International Journal of Emotional Education, 8(2), 70-87.
Hernández-Mendo, A., Blanco-Villaseñor, A., Pastrana, J. L., Morales-Sánchez, V., & Ramos-Pérez, F. J. (2016). SAGT: Aplicación informática para análisis de generalizabilidad. Revista Iberoamericana de Psicologia del Ejercicio y el Deporte, 11(1), 77-89.
Hernández-Mendo, A., Ramos-Pérez, F., & Pastrana, J. (2012). SAGT: Programa informático para análisis de Teoría de la Generalizabilidad (Safe Creative Código: 1204191501059).
Hernandez, A., Días, F., & Morales, V. (2010). Construcción de una herramienta observacional para evaluar las conductas prosociales en las clases de educación física. Revista de Psicologia del Deporte, 19(2), 305-318.
Jennings, P. A., & Greenberg, M. T. (2009). The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Review of Educational Research, 79(1), 491-525. https://doi.org/10.3102/0034654308325693
Jia, Y., Way, N., Ling, G., Yoshikawa, H., Chen, X., Hughes, D., Ke, X., & Lu, Z. (2009). The influence of student perceptions of school climate on socioemotional and academic adjustment: A comparison of chinese and american adolescents. Child Development, 80(5), 1514-1530. https://doi.org/10.1111/j.1467-8624.2009.01348.x
Jiménez Morales, M. I., & López-Zafra, E. (2009). Inteligencia emocional y rendimiento escolar: Estado actual de la cuestión. Revista Latinoamericana de Psicologia, 41(1), 69-79.
Liu, W., Mei, J., Tian, L., & Huebner, E. S. (2016). Age and gender differences in the relation between school-related social support and subjective well-being in school among students. Social Indicators Research, 125(3), 1065-1083. https://doi.org/10.1007/s11205-015-0873-1
Llamas-Díaz, D., Cabello, R., Megías-Robles, A., & Fernández-Berrocal, P. (2022). Systematic review and meta-analysis: The association between emotional intelligence and subjective well-being in adolescents. Journal of Adolescence, 94(7), 925-938. https://doi.org/10.1002/jad.12075
López-Gómez, E. (2018). El método delphi en la investigación actual en educación: Una revisión teórica y metodológica. Educacion XX1, 21(1), 17-40. https://doi.org/10.5944/educXX1.15536
López-González, L., & Oriol, X. (2016). La relación entre competencia emocional, clima de aula y rendimiento académico en estudiantes de secundaria. Cultura y Educacion, 28(1), 130-156. https://doi.org/10.1080/11356405.2015.1120448
López, L., & Bisquerra, R. (2013). Validación y análisis de una escala breve para evaluar el clima de clase en educación secundaria. Psicopedagogía, 62-77.
Lucas-Molina, B., Williamson, A. A., Pulido, R., & Pérez-Albéniz, A. (2015). Effects of teacher–student relationships on peer harassment: a multilevel study. Journal of adolescence, 52(3), 298-315. https://doi.org/10.1002/pits
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18, 315-341. https://doi.org/10.1007/s10648-006-9029-9
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology, 36, 36-48. https://doi.org/10.1016/j.cedpsych.2010.10.002
Pérez, A., Ramos, G., & López, E. (2009). Diseño y análisis de una escala para la valoración de la variable clima social aula en alumnos de educación primaria y secundaria. Revista de Educación, 350, 221-252.
Pérez, A., Ramos, G., & López, E. (2010). Clima social aula: percepción diferenciada de los alumnos de educación secundaria obligatoria. Cultura y Educación, 22(3), 259-281. https://doi.org/10.1174/113564010804932184
Pérez, J. I. R., Molleda, C. B., Díaz, F. J. R., & Cueto, E. G. (2014). Transcultural validation of an emotional climate scale for prison environments. Revista Latinoamericana de Psicologia, 46(2), 92-101. https://doi.org/10.1016/s0120-0534(14)70012-3
Polit, E. F., Beck, T. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30, 459–467.
Portell, M., Anguera, M. T., Chacón-Moscoso, S., & Sanduvete-Chaves, S. (2015). Guidelines for reporting evaluations based on observational methodology. Psicothema, 27(3), 283-289. https://doi.org/10.7334/psicothema2014.276
Portney, L. G., & Watkins, M. P. (2009). Foundations of Clinical Research: Applications to practice (3rd ed). Pearson ed.
Quintana-Orts, C., Mérida-López, S., Rey, L., & Extremera, N. (2021). A closer look at the emotional intelligence construct: How do emotional intelligence facets relate to life satisfaction in students involved in bullying and cyberbullying? European Journal of Investigation in Health, Psychology and Education, 11(3), 711-725. https://doi.org/10.3390/EJIHPE11030051
Reeve, J. (2010). Motivation and emotion. McGraw Hill.
Reguant-Álvarez, M., Torrado-Fonseca, M., & Fecha. (2016). El método Delphi. REIRE, Revista d’ Innovació i Recerca en Educació, 9(1), 87-102. https://doi.org/10.1344/reire2016.9.1916
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate , student engagement , and academic achievement. Journal of Educational Psychology, 104(3), 700-712. https://doi.org/10.1037/a0027268
Rubin, D. B., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. Journal of the American Statistical Association, 69(348), 1050. https://doi.org/10.2307/2286194
Rueda, P., Pérez-Romero, N., Cerezo, M. V., & Fernández-Berrocal, P. (2022). The Role of Emotional Intelligence in Adolescent Bullying: A Systematic Review. Psicologia Educativa, 28(1), 53-59. https://doi.org/10.5093/psed2021a29
Sáenz-López, P. (2020). Educar Emocionando. Uhu.es publicaciones.
Sánchez-Álvarez, N., Berrios Martos, M. P., & Extremera, N. (2020). A Meta-Analysis of the Relationship Between Emotional Intelligence and Academic Performance in Secondary Education: A Multi-Stream Comparison. Frontiers in Psychology, 11(July), 1-11. https://doi.org/10.3389/fpsyg.2020.01517
Sánchez-Oliva, D., Pulido-González, J. J., Leo, F. M., González-Ponce, I., & García-Calvo, T. (2017). Effects of an intervention with teachers in the physical education context : A self- determination theory approach. PLoS ONE 12(12):, 12(12), e0189986.
Smith, N., Tessier, D., Tzioumakis, Y., Quested, E., Appleton, P., Sarrazin, P., Papaioannou, A., & Duda, J. L. (2015). Development and validation of the multidimensional motivational climate observation system. Journal of Sport and Exercise Psychology, 37(1), 4-22. https://doi.org/10.1123/jsep.2014-0059
Stone, A. A., & Shiffman, S. (2002). Capturing momentary, self-report data: A proposal for reporting guidelines. Annals of Behavioral Medicine, 24(3), 236-243. https://doi.org/10.1207/S15324796ABM2403_09
Torrijos, P., Martín, J. F., & Rodríguez, M. J. (2018). La educación emocional en la formación permanente del profesorado no universitario. Profesorado, Revista De Currículum Y Formación Del Profesorado, 22(1), 579-597. https://doi.org/https://doi.org/10.30827/profesorado.v22i1.9943
Ulloa, M., Evans, I., & Jones, L. (2016). The effects of emotional awareness training on teachers’ ability to manage the emotions of preschool children: An experimental study. Escritos de Psicología, 9(1), 1-14. https://doi.org/10.5231/psy.writ.2015.1711
Uztosun, M. S. (2018). Professional competences to teach English at primary schools in Turkey : a Delphi study. European Journal of Teacher Education, 00(00), 1-17. https://doi.org/10.1080/02619768.2018.1472569
Valero-Valenzuela, A., Camerino, O., Manzano-Sánchez, D., Prat, Q., & Castañer, M. (2020). Enhancing learner motivation and classroom social climate : A mixed methods approach. International Journal of Environmental Research and Public Health, 17, 5272. https://doi.org/doi:10.3390/ijerph17155272
Vizoso-Gómez, C. (2022). Inteligencia emocional y compromiso laboral en el profesorado: revisión de la literatura. Profesorado, Revista De Currículum Y Formación Del Profesorado, 26(3), 395–414. https://doi.org/https://doi.org/10.30827/profesorado.v26i3.21451
Wang, M. Te, L. Degol, J., Amemiya, J., Parr, A., & Guo, J. (2020). Classroom climate and children’s academic and psychological wellbeing: A systematic review and meta-analysis. Developmental Review, 57, 100912. https://doi.org/10.1016/j.dr.2020.100912
Wyant, J. D., Tsuda, E., & Yeats, J. T. (2020). Delphi investigation of strategies to develop cultural competence in physical education teacher education. Physical Education and Sport Pedagogy, 25(5), 525-538. https://doi.org/10.1080/17408989.2020.1746252
Yoder, P., Lloyd, B., & Symons, F. (2018). Observational measurement of behavior (2nd ed). Paul H. Brookes Publishing Co.
Downloads
Published
Versions
- 2024-06-14 (5)
- 2024-06-12 (4)
- 2024-04-16 (3)
- 2024-04-08 (2)
- 2024-03-22 (1)
