The QELtLCUS questionnaire. An instrument for evaluating the learning to learn competence in university students

Authors

  • Bernardo Gargallo López University of Valencia
  • Jesús M. Suárez Rodríguez University of Valencia
  • Cruz Pérez Pérez University of Valencia
  • Gonzalo Almerich Cerveró University of Valencia
  • Fran J. Garcia-Garcia University of Valencia

DOI:

https://doi.org/10.30827/relieve.v27i1.20760

Keywords:

Learning to learn competence, Assessment, University students, Self-regulated learning

Abstract

Learning to learn is one of the key competences identified by the European Commission (EC, 2005 and 2006) for education systems. Rigorous evaluation instruments are necessary for this competence to be included in curriculum design and teaching–learning processes. Currently available questionnaires are limited and so the present work focuses on the design and validation of a standardised quantitative questionnaire to evaluate the way in which university students manage this competence. A test validation design was employed with a sample of 1237 university students from three universities in Valencia. Confirmatory factor analysis revealed good internal consistency and construct validity outcomes. A final questionnaire was produced which addressed five dimensions/scales (cognitive, metacognitive, affective-motivational, social-relational and ethical) through twenty-one subdimensions/subscales composed of 85 items. This questionnaire was found to be more robust and comprehensive than those that were previously available. The instrument will help to advance knowledge in this area. It is useful for researchers as it can be used for diagnosing and evaluating the competence in question, whilst also comparing results obtained in large population samples.

Downloads

Author Biographies

Bernardo Gargallo López, University of Valencia

He is a professor of Educational Theory at the University of Valencia. He won the First National Prize of Educational Research from the Ministry of Education and Science in 2000 with a research on learning strategies and also in 2002, with a work on ICT and education. He is director of the GIPU-EA research group, working on university pedagogy and teaching and learning processes. His main line of research today and the competitive projects he has led in recent years focus on teaching and learning at the university and learning-centered methods. He is currently leading a research project on the competence learning to learn in college (EDU2017-83284-R).

Jesús M. Suárez Rodríguez, University of Valencia

He is a professor in the Department of Research Methods and Educational Diagnosis in Education at the University of Valencia. He is the coordinator of the Research Group on Research Methods in Education and ICT (MIETIC). His work focuses on the methodological, analytical and measurement elements in the fields of Social Sciences and Health. In recent years, his priority line of research focuses on the impact of ICT at different educational levels. He won the First National Prize of Educational Research, together with the first author, in 2002, for a work related to the modeling of the influence of ICT in educational centers.

Cruz Pérez Pérez, University of Valencia

He is a professor of Educational Theory at the University of Valencia. His research has focused on the learning of values, attitudes and norms, prevention of gender violence, entrepreneurship and Service Learning at the university. In recent years he has participated in several R + D + i projects on learning and teaching at the university. He is currently co-directing a project on the competence of learning to learn in university students.

Gonzalo Almerich Cerveró, University of Valencia

He is a full professor in the Department of Research Methods and Educational Diagnosis in Education at the University of Valencia. His research career focuses on the integration of information and communication technologies (ICTS) in education, 21st century skills, student learning processes, educational measurement and educational research methodology. He won the First National Prize for Educational Research from the Ministry of Education and Science in 2004 with a research on the integration of ICTS in education.

Fran J. Garcia-Garcia, University of Valencia

He is a research personnel in training in the Department of Theory of Education at the University of Valencia. His research interests focus on inclusive education, with special emphasis on the education of deaf children, and on teaching-learning at the university. He is developing his doctoral thesis within the project "Operational design of the ‘learning to learn’ competence for university degrees, Assessment instruments and proposals for teaching."

References

Abad, F.J., Olea, J., Ponsoda, V., & García, C. (2011). Medición en Ciencias Sociales y de la Salud. Síntesis.

Almerich, G., Díaz-García, I., Cebrián Cifuentes, S., & Suárez-Rodríguez, J. (2018). Estructura dimensional de las competencias del siglo XXI en alumnado universitario de educación. RELIEVE, 24 (1). art. 5. https://doi.org/10.7203/relieve.24.1.12548

Bandalos, D.L. (2018). Measurement Theory and Applications for the Social Sciences. The Guilford Press.

Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. En G. R. Hancock, L. M. Stapleton, y R. O. Mueller (Ed.), The reviewer’s guide to quantitative methods in the social sciences (Second edition, pp. 98-122). Routledge. https://doi.org/10.4324/9781315755649-8

Biggs, J. (2005). Calidad del aprendizaje universitario. Narcea.

Brown, T. (2015). Confirmatory factor analysis for applied research (Second Edition). The Guilford Press.

CE. (2006). Recomendación del Parlamento Europeo y del Consejo de 18 de diciembre de 2006 sobre competencias clave para el aprendizaje permanente. Recuperado el 29 de julio de 2020 de https://goo.gl/6ayK8K

CE. (2018). Anexo de la Propuesta de Recomendación del Consejo relativa a las competencias clave para el aprendizaje permanente. Recuperado el 29 de julio de 2020 de https://goo.gl/YD9pDw

Caena, F. (2019). Developing a European Framework for the Personal, Social & Learning lo Learn Key Competence. Luxemboug: Publicatons Office of the European Union. https://bit.ly/2vBzK8A

Deakin Crick, R., Haigney, D., Huang, S., Coburn, T., & Goldspink, C.H. (2013) Learning power in the workplace: the effective lifelong learning inventory and its reliability and validity and implications for learning and development. The International Journal of Human Resource Management, 24(11), 2255-2272. https://www.tandfonline.com/doi/abs/10.1080/09585192.2012.725075

Elshout-Mohr, M., Meijer, J., Oostdam, R., & van Gelderen, A. (2004). CCST: A Test for CrossCurricular Skills. Amsterdam: SCO – Kohnstamm Institution, University of Amsterdam.

Finney, S. J., & DiStefano, C. (2013). Nonnormal and categorical data in structural equation modeling. En G. R. Hancock & R. O. Mueller (Eds.), Quantitative methods in education and the behavioral sciences: Issues, research, and teaching. Structural equation modeling: A second course (pp. 439–492). IAP Information Age Publishing.

Fraile, J., Gil-Izquierdo, M., Zamorano-Sande, D., & Sánchez-Iglesias, I. (2020). Autorregulación del aprendizaje y procesos de evaluación formativa en los trabajos de grupo. RELIEVE, 26(1), art. M5. http://doi.org/10.7203/relieve.26.1.17402

García Bellido, M. R. (2015). Diseño y validación de un instrumento para evaluar la competencia “aprender a aprender” en profesionales de la educación. Tesis doctoral. Universidad de Valencia.

Gargallo, B., Campos, C., & Almerich, G. (2016) Learning to learn at university. The effects of an instrumental subject on learning strategies and academic achievement. Cultura y Educación, 28 (4), 771-810. https://doi.org/11356405.2016.1230293

Gargallo López, B., Pérez-Pérez, C., García-García, F.J., Giménez Beut, J.A., y Portillo Poblador, N. (2020). La competencia aprender a aprender en la universidad: propuesta de modelo teórico. Educación XX1, 23(1), 19-44, https://www.readcube.com/articles/10.5944/educxx1.23367

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis (Seventh edition). Upper Saddle River.

Hautamäki, J., Arinen, P., Eronen, S., Hautamäki, A., Kupianien, S., Lindblom, B., Niemivirta, M., Pakaslahti, L., Rantanen, P., & Scheinin, P. (2002). Assessing Lear-ning-to-Learn: A Framework. Helsinki: Centre for Educational Assessment, Helsinki University/National Board of Education.

Hoskins, B. & Fredriksson, U. (2008). Learning to learn: what is it and can it be measured? Comisión Europea: Joint Research Centre, Institute for the Protection and Security of the Citizen. Centre for Research on Lifelong Learning (CRELL). https://goo.gl/sSijfY

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Jornet Meliá, J.J., García-Bellido, R., & González-Such, J. (2012). Evaluar la competencia aprender a aprender: una propuesta metodológica. Profesorado. Revista de currículum y formación del profesorado, 16 (1), 103-123.

Kline, R. B. (2015). Principles and Practice of Structural Equation Modeling (Fourth Edition). Guilford.

Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada Anales de Psicología, 30 (3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361

Lluch Molins, L., & Portillo Vidiella, M.C. (2018). La competencia de aprender a aprender en el marco de la educación superior. Revista Iberoamericana de Educación, 78 (2), 59-76. https://doi.org/10.35362/rie7823183

McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum Associates, Inc.

Moreno, A. (2002). La evaluación de las habilidades metacognitivas. In A. Marchesi & E. Martín (Eds.), Evaluación de la educación secundaria. Fundación Santa María.

Moreno, A., Cercadillo, L., & Martínez, M. (2008). Learn European Project. Pre-Pilot Study National Report. Ministerio de Educación.

Muñoz-San Roque, I., Martín-Alonso, J. F., Prieto-Navarro, L., & Urosa-Sanz, B. (2016). Autopercepción del nivel de desarrollo de la competencia de aprender a aprender en el contexto universitario: propuesta de un instrumento de evaluación. Revista de Investigación Educativa, 34(2), 369-383. https://doi.org/10.6018/rie.34.2.235881

Panadero, E. (2017). A Review of Self-regulated Learning: Six Models and Four Directions for Research. Frontiers in Psychology, 8, 422. https://doi.org/10.3389/fpsyg.2017.00422

Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385-407. https://doi.org/10.1007/s10648-004-0006-x

Rajaratnam, N., Cronbach, L. J., & Gleser, G. C. (1965). Generalizability of stratified-parallel tests. Psychometrika, 30(1), 39–56. https://doi.org/10.1007/BF02289746

Rosseel, Y. (2012). Lavaan: An R Package for Structural Equation Modeling. Journal of statistical software, 48 (2), 1–36. https://doi.org/10.18637/jss.v048.i02

Ruge, G., Tokede, O., & Tivendale, L. (2019). Implementing constructive alignment in higher education – cross-institutional perspectives from Australia. Higher Education Research & Development, 38 (4), 833-848. https://doi.org/10.1080/07294360.2019.1586842

Säfström, C. A. (2018). Liveable life, educational theory and the imperative of constant change. European Educational Research Journal, 17(5), 621-630. https://doi.org/10.1177/1474904118784480

Stringher, C. (2014). What is learning to learn? A learning to learn process and output model. En R. Deakin Crick, C. Stringher y K. Ren, Learning to learn (9-32). Londres y Nueva York: Routledge.

Viejo, C., & Ortega-Ruiz, R. (2018). Competencias para la investigación: el trabajo de fin de Máster y su potencialidad formativa. Revista de innovación y buenas prácticas docentes, 5, 46-56. https://doi.org/10.21071/ripadoc.v5i.10970

Villardón-Gallego, L., Yániz, C., Achurra, C., Iraurgi, I., & Aguilar, M.C. (2013). Learning competence in university: development and structural validation of a scale to measure. Psicodidáctica, 18 (2), 357-374. https://doi.org /10.1387/RevPsicodidact.6470

Weinstein, C. E. (1988). Assessment and training of student learning strategies. En R. R. Schmeck (Ed.), Learning strategies and learning styles (pp. 291-316). Plenum Press. https://doi.org/10.1007/978-1-4899-2118-5_11

Weinstein, C.E., & Acee, T.W. (2018). Study and learning strategies. En R.F. Flippo y Bean T.W. Handbook of College Reading and Study Strategy Research. (pp. 227-240). Routledge. https://doi.org/10.4324/9781315629810-17

Zhu, J., & Schumacher, D.J. (2016). Learning to Learn and Teaching to Learn. MedEdPublish. doi: https://doi.org/10.15694/mep.2016.000063

Zimmerman, B.J., Schunk, D.H., & DiBenedetto, M.K. (2017). The role of self-efficacy and related beliefs in self-regulation of learning and performance. En A. J. Elliot, C.S. Dweck & D.S. Yeager (Eds.), Handbook of competence and motivation (Second Edition, pp. 313-333). Guilford Press.

Modelo del Constructo Aprender a Aprender

Downloads

Published

2021-06-27

How to Cite

Gargallo López, B., Suárez Rodríguez, J. M. ., Pérez Pérez, C., Almerich Cerveró, G., & Garcia-Garcia, F. J. (2021). The QELtLCUS questionnaire. An instrument for evaluating the learning to learn competence in university students. RELIEVE – Electronic Journal of Educational Research and Evaluation, 27(1). https://doi.org/10.30827/relieve.v27i1.20760

Issue

Vol. 27 No. 1 (2021)

Section

Research Articles

License

Copyright (c) 2021 RELIEVE-Revista Electr´ónica de Investigación y Evaluación Educativa

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

The authors grant non-exclusive rights of exploitation of works published to RELIEVE and consent to be distributed under the Creative Commons Attribution-Noncommercial Use 4.0 International License (CC-BY-NC 4.0), which allows third parties to use the published material whenever the authorship of the work and the source of publication is mentioned, and it is used for non-commercial purposes.

The authors can reach other additional and independent contractual agreements, for the non-exclusive distribution of the version of the work published in this journal (for example, by including it in an institutional repository or publishing it in a book), as long as it is clearly stated that the Original source of publication is this magazine.

Authors are encouraged to disseminate their work after it has been published, through the internet (for example, in institutional archives online or on its website) which can generate interesting exchanges and increase work appointments.

The fact of sending your paper to RELIEVE implies that you accept these conditions.