Diseño y validación del Test Situacional Desarrollo de Competencias Socioemocionales de Jóvenes (DCSE-J)

Sara Rodríguez-Pérez; Josefina Sala-Roca; Eduardo Doval; Aida Urrea-Monclús

doi:10.30827/relieve.v27i2.22431

Authors

Sara Rodríguez-Pérez University of Oviedo
Josefina Sala-Roca Autonomous University of Barcelona
Eduardo Doval Autonomous University of Barcelona
Aida Urrea-Monclús University of Lleida

DOI:

https://doi.org/10.30827/relieve.v27i2.22431

Keywords:

Situational test, Socioemotional competences, Youth, Social Skills, Emotional Intelligence

Abstract

This article presents the design and validation of the situational judgment test of socioemotional competence development in young people (SCD-Y), a copyleft psychoeducational instrument for use with young people aged 12 to 18 years. The test presents five scenarios from everyday life which represent different problematic situations. Interviews were held with 117 young people in order to elaborate the different response options. Seven experts assigned response options to dimensions which had been initially proposed at an earlier stage. In addition, 11 experts assigned discrete scores to each response option. Exploratory factor analysis was carried out on data from 1,227 students attending 12 schools. Test-retest reliability was examined using data from 123 students. Convergent validity was tested using a sample of 215 students who also completed the TMMS-24 and STEM_Y tests. The SCD-Y is a promising psychoeducational evaluation instrument. Notably, it was generally accepted and positive evaluated by teachers, with validity and reliability outcomes also being acceptable up to the present date.

Downloads

Download data is not yet available.

Author Biographies

Sara Rodríguez-Pérez, University of Oviedo

Assistant Professor of the Department of Educational Sciences of the University of Oviedo. She is a teacher, pedagogue and sexologist. She coordinated and developed the Asexora project (Sexological Counseling for young people) in collaboration with the Youth Council of the Principado de Asturias. She has participated in research projects on intervention with families in educational spaces, influence of gender in academic decisions, well-being of care leavers, emotional education and Dual Professional Training. She is currently part of the IARS group (Childhood and Adolescence at Social Risk). Instagram: medrando_con_buenos_tratos

Josefina Sala-Roca, Autonomous University of Barcelona

Professor of the Department of Theory of Education and Social Pedagogy of the Autonomous University of Barcelona. She coordinates the Research Group on Childhood and Adolescence at Social Risk (IARS). The IARS group has developed various studies on the development of socio-emotional and employability competencies of children and young people. Also, in collaboration with FEPA, FEDAIA and DGAIA among others, it has developed studies on the factors that affect the well-being and positive development of young people in care, as well as the difficulties and supports in their transition to independent life. The research carried out has been published in various articles and reports. Twitter: @IARS_uab

Eduardo Doval, Autonomous University of Barcelona

Professor of the Department of Psychobiology and Methodology of Health Sciences at the Autonomous University of Barcelona. His main research focuses on the identification and study of aberrant response patterns in educational assessment tests. He is a member of the GIES group (Research group in stress and health).

Aida Urrea-Monclús, University of Lleida

Acting Associate Professor of the Department of Pedagogy of the University of Lleida. Her research and teaching focuses on the promotion of children's rights both in the child protection system and in the educational system. Currently, she participates in research to promote the participation of young people in the protection system, especially in their transition to independent life and in family reunification processes. She is part of the IARS Group, the GRISIJ Group and the Education and Adolescence Chair. Twitter: @aida_aum

References

Allen, V., Rahman, N., Weissman, A., MacCann, C., Lewis, C. y Roberts, R. D. (2015). The Situational Test of Emotional Management – Brief (STEM-B): Development and validation using item responsive theory and latent class analysis. Personality and Individual Differences, 81, 195–200. https://doi.org/10.1016/j.paid.2015.01.053

Allen, V. D., Weissman, A., Hellwig, S., MacCann, C. y Roberts, R. D. (2014). Development of the situational test of emotional understanding – Brief (STEU-B) using item response theory. Personality and Individual Differences, 65, 3–7. https://doi.org/10.1016/j.paid.2014.01.051

Bar-On, R. y Parker, J. (2000). EQ-I: YV. Bar-On Emotional Quotient inventory: Youth version. Technical manual. Multi Health Systems, Inc. https://doi.org/10.1037/t14077-000

Bisquerra, R. y Pérez-Escoda, N. (2015). ¿Pueden las escalas Likert aumentar en sensibilidad? REIRE, Revista d’Innovació i Recerca en Educació, 8(2), 129-147. https://doi.org/10.1344/reire2015.8.2.82

Blakemore, S. J., & Mills, K. L. (2014). Is adolescence a sensitive period for sociocultural processing? Annual review of psychology, 65, 187-207. https://doi.org/10.1146/annurev-psych-010213-115202

Boyatzis, R. E., Gaskin, J., & Wei, H. (2015). Emotional and social intelligence and behavior. In Handbook of intelligence (pp. 243-262). Springer. https://doi.org/10.1007/978-1-4939-1562-0_17

Cohen J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37-46. https://doi.org/10.1177/001316446002000104

Ciarrochi, J., Forgas, J.P. & Mayer, J.D. (2006). Emotional Intelligence in everyday life. Psychology Press/Taylor and Francis.

Darwin, Ch. (1872). The Expression of Emotion in Man and Animals. Appleton Century Crofts. https://doi.org/10.1037/10001-000

Extremera, N. (2003). El modelo de inteligencia emocional de Mayer y Salovey y su validez predictiva en muestras españolas. Málaga. https://doi.org/10.21840/siic/159626

Everwijn, S. E. M., Bomers, G. B. J., & Knubben, J. A. (1993). Ability-or competence-based education: bridging the gap between knowledge acquisition and ability to apply. Higher education, 25(4), 425-438. https://doi.org/10.1007/bf01383845

Fariselli, L., Ghini, M., & Freedman, J. (2008). Age and emotional intelligence. Six Seconds: The Emotional Intelligence Network, 1-10.

Rui-Berrocal, P., Cabello, R., Castillo, R., & Extremera, N. (2012). Gender differences in emotional intelligence: The mediating effect of age. Behavioral Psychology, 20(1), 77-89.

Fernández-Berrocal, P., & Extremera, N. (2006). Emotional intelligence: A theoretical and empirical review of its first 15 years of history. Psicothema, 18, 7-12.

Fernández-Berrocal, P., Extremera, N. Y Ramos, N. (2004). Validity and reliability of the Spanish modified version of the Trait Meta-Mood Scale. Psychological Reports, 94, 751-755. https://doi.org/10.2466/pr0.94.3.751-755

Ferrando, P. J., & Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología [Factor analysis as a technique in psychological research]. Papeles del Psicólogo, 31(1), 18–33.

Ferrando, P. J., & Lorenzo-Seva, U. (2000). Unrestricted versus restricted factor analysis of multidimensional test items: Some aspects of the problem and some suggestions. Psicológica, 21(3), 301–323.

Frías-Navarro, D., & Pascual Soler, M. (2012). Exploratory factor Analysis (EFA) in consumer behavior and marketing research. Suma Psicológica, 19(1), 47-58.

Grusec, J. E. (2011). Socialization processes in the family: Social and emotional development. Annual review of psychology, 62, 243-269. https://doi.org/10.1146/annurev.psych.121208.131650

Hernández, M. M., Eisenberg, N., Valiente, C., VanSchyndel, S. K., Spinrad, T. L., Silva, K. M., ... & Southworth, J. (2016). Emotional expression in school context, social relationships, and academic adjustment in kindergarten. Emotion, 16(4), 553. https://doi.org/.1037/emo0000147

Kar, N., & Kar, B. (2017). Social cognition and individual effectiveness in interpersonal scenarios: A conceptual review. Journal of Mental Health and Human Behavior, 22, 27-34. https://doi.org/10.4103/0971-8990.210705

Kvavilashvili, L. & Ellis, J. (2004). Ecological validity and the real-life/laboratory controversy in memory research: A critical and historical review. History & Philosophy of Psychology, 6, 59–80.

Laghi, F., Lonigro, A., Pallini, S., & Baiocco, R. (2018). Emotion regulation and empathy: Which relation with social conduct? The Journal of genetic psychology, 179(2), 62-70. https://doi.org/10.1080/00221325.2018.1424705

Lewis, M.; Sullivan, M.W.; Stanger, C. & Weiss, M. (1989): Self-development and self-conscious emotions. Child Development, 60, 146-156. https://doi.org/10.2307/1131080

Lievens, F. R. O., & Chan, D. (2017). Practical Intelligence, Emotional Intelligence, and Social Intelligence. In Handbook of Employee Selection (pp. 342-364). New York: Routledge. https://doi.org/10.4324/9781315690193-15

Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgment tests: A review of recent research. Personnel Review, 37(4), 426-441. https://doi.org/10.1108/00483480810877598

Lorenzo-Seva, U. y Ferrando, P. (2007). FACTOR: A computer program to fit the exploratory factor analysis model. University Rovira y Virgili. https://doi.org/10.3758/BF03192753

Lorenzo-Seva, U. y Ferrando, P. (2011). Manual of the program FACTOR v. 8.02. https://psico.fcep.urv.cat/utilitats/factor/documentation/Manual_de_Factor_Esp.pdf

MacCann, C. y Roberts, R. D. (2008). New paradigms for assesing emotional intelligence: theory and data. Emotion, 8(4), 540–551. https://doi.org/10.1037/a0012746

MacCann, C., Wang, L., Matthews, G. y Roberts, R. (2010). Emotional intelligence and the eye of the beholeder: comparing self- and parent-rated situational judgments in adolescents. Journal of Research in Personality, 44, 673–676. https://doi.org/10.1016/j.jrp.2010.08.009

Matthews, G., Zeidner, M., & Roberts, R. D. (2017). Emotional intelligence, health, and stress. The handbook of stress and health: A guide to research and practice, 312. https://doi.org/10.1002/9781118993811.ch18

Mayer, J. D., Salovey, P. y Caruso, D. R. (2002a). Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT): item booklet. Multi-Health Systems. https://doi.org/10.1037/t05047-000

Mayer, J. D., Salovey, P. y Caruso, D. R. (2002b). The Mayer-Salovey-Caruso Emotion lntelligence Test SCE T User’s manual. Multi-Health Systems.

Monnier, M. (2015). Difficulties in defining social-emotional intelligence, competences and skills-a theoretical analysis and structural suggestion. International journal for research in vocational education and training, 2(1), 59-84. https://doi.org/10.13152/IJRVET.2.1.4

O'Connor, P. J., Hill, A., Kaya, M., & Martin, B. (2019). The Measurement of Emotional Intelligence: A Critical Review of the Literature and Recommendations for Researchers and Practitioners. Frontiers in Psychology, 10, 1116. https://doi.org/10.3389/fpsyg.2019.01116

Rodrigo, D. (2017). Evaluación de la inteligencia emocional capacidad en adolescentes españoles: adaptación y validación del Situational Test of Emotion Management (STEM). (Tesis doctoral) Universidad Nacional de Educación a Distancia (UNED), España. https://doi.org/10.21134/rpcna.2018.05.2.6

Rodríguez-Ruiz, D. (2017). Evaluación de la inteligencia emocional capacidad en adolescentes españoles: adaptación y validación del Situational Test of Emotion Management (STEM) [Tesis de doctorado, Universidad Nacional de Educación a Distancia (España)] http://e-spacio.uned.es/fez/view/tesisuned:Educacion-Drodrigo

Rothbart, M. K., Ahadi, S. A., & Evans, D. E. (2000). Temperament and personality: origins and outcomes. Journal of personality and social psychology, 78(1), 122. https://doi.org/10.1037/0022-3514.78.1.122

Saarni, C. (1997): Emotional Competence and Self-Regulation in Childhood, 35-64. In Salovey, P. & Sluyter, D. (eds.). Emotional Development and Emotional Inteligance. Educational Implication. BasicBooks.

Saarni, C. (2000). Emotional competence: A developmental perspective. In R. Bar-On & J. D. A. Parker (Eds.), The handbook of emotional intelligence: Theory, development, assessment, and application at home, school, and in the workplace (pp. 68-91). Jossey-Bass.

Saarni, C. (2008). The interface of emotional development with social context. In M. Lewis, J. Haviland-Jones, & L. Feldman Barrett (Eds.), The handbook of emotions (3rd ed., pp. 332–347). Guilford Press.

Sala-Roca, J., Filella, G., Oriol, X., Ros, A., Secanilla, E., Rodríguez, M., Soldevila, A. (2016). Test Situacional de Desarrollo de Competencias Socioemocionales (DCSE-J). Versión revisada por Josefina Sala, Anna Soldevila, Sara Rodríguez Pérez, Aida Urrea-Monclús y Nair Zárate en 2020. Universitat Autònoma de Barcelona. https://ddd.uab.cat/record/212951

Salovey, P., Mayer, J.D., Goldman, S.L., Turvey, C. y Palfai, T.P. (1995). Emotional attention, clarity and repair: exploring emotional intelligence using the trait meta-mood scale. En J. Pennebaker (ed.): Emotion, disclousure and health. Washington, D.C.: American Psychological Association. https://doi.org/10.1037/10182-006

Sánchez-Nunez, M., Fernández-Berrocal, P., Montañés, J., & Latorre, J. M. (2008). Does emotional intelligence depend on gender? The socialization of emotional competencies in men and women and its implications.

Sánchez-Teruel, D. y Robles-Bello, M.A. (2018). Instrumentos de evaluación en inteligencia emocional: una revisión sistemática cuantitativa. Perspectiva educacional. Formación de profesores, 57(2), 27-50. https://doi.org/10.4151/07189729-Vol.57-Iss.2-Art.712

Sharma, S.; Gangopadhyay, M.; Austin, E. y Manas, K.M. (2013). Development and Validation of a Situational Judgment Test of Emotional Intelligence. International Journal of Selection and Assessment, 21(1), 57-73. https://doi.org/10.1111/ijsa.12017

Sheppes, G., Suri, G., & Gross, J. J. (2015). Emotion regulation and psychopathology. Annual review of clinical psychology, 11, 379-405. https://doi.org/10.1146/annurev-clinpsy-032814-112739

Sorrel, M. A., Olea, J., Abad, F. J., de la Torre, J., Aguado, D., & Lievens, F. (2016). Validity and Reliability of Situational Judgement Test Scores A New Approach Based on Cognitive Diagnosis Models. Organizational Research Methods, 19(3), 506-532. https://doi.org/10.1177/1094428116630065

Steinberg, L. (2005). Cognitive and affective development in adolescence. Trends in cognitive sciences, 9(2), 69-74. https://doi.org/10.1016/j.tics.2004.12.005