Formative assessment at university through digital technology tools
DOI:
https://doi.org/10.30827/profesorado.v24i1.9314Keywords:
formative evaluation, self-evaluation, information and communication technologies, teaching method, learning processAbstract
Assessment in its various forms is a key element in any teaching process. This research focuses on how formative assessment can be used to improve the teaching-learning process and provide students with feedback about their progress rather than just grades. The main aim is to analyze how individual formative self-assessment processes—via the Socrative application (SA) and Moodle questionnaires (MQ)—affect the teaching-learning process and whether they improve student performance and satisfaction. The sample studied consisted of 374 students (315 women and 59 men) from the second year of the Teaching degree. Of these, 245 were part of a control group that did not participate in any self-assessment, and 129 were part of the experimental group. Results show that the use of self-assessment tools during the teaching process improved the academic performance by around one point out of ten and generated a good level of satisfaction among students and teachers. Overall, no significant differences were found between MQ and SA in relation to satisfaction level and performance. The results also indicate that the use of a self-assessment tool by itself is not sufficient to bring about a change in the way students learn. Thus, other factors should be investigated for greater insight into the variables involved in the student learning process.
Downloads
References
Awedh, M., Mueen, A., Zafar, B., & Manzoor, U. (2015). Using Socrative and Smartphones for the support of collaborative learning. International Journal on Integrating Technology in Education (IJITE), 3, 17-24. doi: https://doi.org/10.5121/ijite.2014.3402
Alexander, P. A. (2013). Calibration: What is it and why it matters? An introduction to the special issue on calibrating calibration. Learning and Instruction, 24, 1-3. doi: https://doi.org/10.1016/j.learninstruc.2012.10.003
Awwad, F., Ayesh, A., & Awwad, S. (2013). Are Laptops Distracting Educational Tools in Classrooms. Procedia: Social & Behavioral Sciences, 103, 154 -160. doi: https://doi.org/10.1016/j.sbspro.2013.10.320
Beaumont, C., O'Doherty, M., & Shannon, L. (2011). Reconceptualising assessment feedback: a key to improving student learning? Studies in Higher Education, 36, 671-687. doi: https://doi.org/10.1080/03075071003731135
Bloxham, S., & Campbell, L. (2010). Generating dialogue in assessment feedback: exploring the use of interactive cover sheets. Assessment & Evaluation in Higher Education, 35, 291-300. doi: https://doi.org/10.1080/02602931003650045
Broadbent, J., Panadero, E., & Boud, D. (2017). Implementing summative assessment with a formative flavour: a case study in a large class. Assessment & Evaluation in Higher Education, 1-16. doi: https://doi.org/10.1080/02602938.2017.1343455
Buscà, F., Pintor, P., Martínez, L., & Peire, T. (2010). Higher Education Systems and Procedures of Evaluation: Results of 34 Cases Applied During the Academic Course 2007-2008. Estudios sobre Educación, 18, 255-276.
Canabal, C., & Margalef, L. (2017). La retroalimentación: La clave para una evaluación orientada al aprendizaje. Profesorado, Revista de Currículum y Formación del Profesorado 2, Vol. 21 (pp.149-170).
Carless, D. (2017). Scaling up assessment for learning: progress and prospects. In Scaling up assessment for learning in higher education (pp. 3-17). Singapore: Springer.
Carless, D., Joughin, G., & Mok, M. M. C. (2006). Learning-oriented assessment: principles and practice. Assessment & Evaluation in Higher Education, 31, 395-398. doi: https://doi.org/10.1080/14703290601081332
Cheung, W.S., & Hew, K.F. (2009). A review of research methodologies used in studies on mobile handheld devices in K-12 and higher education settings. Australasian Journal of Educational Technology, 25(2), 153-183. doi: https://doi.org/10.14742/ajet.1148
Combrinck, M., & Hatch, M. (2012). Students' experiences of a continuous assessment approach at a higher education institution. Proceedings from INTED2012: the 6th International Conference of Technology, Education and Development (INTED). Valencia: Spain.
Dakka, S. M. (2015). Using Socrative to Enhance In-Class Student Engagement and Collaboration. International Journal on Integrating Technology in Education, 3, 1-7. doi: https://doi.org/10.5121/ijite.2015.4302
De Bruin, A. B., Thiede, K. W., Camp, G., & Redford, J. (2011). Generating keywords improves metacomprehension and self-regulation in elementary and middle school children. Journal of Experimental Child Psychology, 109, 294-310. doi: https://doi.org/10.1016/j.jecp.2011.02.005
Dervan, P. (2014). Enhancing in-class student engagement using Socrative (an online Student Response System): a report. All Ireland Journal of Teaching and Learning in Higher Education, 6, 1801-18013.
Díaz-García, I., Cebrián-Cifuentes, S., & Fuster-Palacios, I. (2016). ICT competences in university students in the field of education and its relationship with learning strategies. Relieve, 22, art. 5. doi: 0.7203/relieve.22.1.8159
Ferguson, P. (2011). Student perceptions of quality feedback in teacher education. Assessment & Evaluation in Higher Education, 36, 51-62. doi: https://doi.org/10.1080/02602930903197883
Gargallo, B., Garfella, P.; Sahuquillo, P., Verde, I., & Jiménez, M. A. (2015). Learning-centered methods, learning strategies and learning approaches in university students. Revista de Educación, 370, 216-241. doi: https://doi.org/10.4438/1988-592X-RE-2015-370-304
Gil-Flores, J., & Padilla, T. (2009). Participation of university students in the learning assessment. Educación XX1, 12, 43-65.
Gil-Flores, J. (2012). Learning Assessment in Higher Education According to Students' Experience. Estudios sobre Educación, 22, 133-153.
Hamodi, C., López-Pastor, V. M., & López-Pastor, A. T. (2017). If I experience formative assessment whilst studying at university, will I put it into practice later as a teacher? Formative and shared assessment in Initial Teacher Education (ITE). European Journal of Teacher Education, 40(2), 171-190. doi: https://doi.org/10.1080/02619768.2017.1281909
Harris, L. R., & Brown, G. T. (2018). Using Self-Assessment to Improve Student Learning. New York, NY: Routledge.
Henderson, M., Selwyn, N., Finger, G., & Aston, R. (2015). Students’ everyday engagement with digital technology in university: exploring patterns of use and ‘usefulness’. Journal of Higher Education Policy and Management, 37, 308-319. doi: https://doi.org/10.1080/1360080X.2015.1034424
Hortigüela-Alcalá, D., Pérez-Pueyo, Á., & López-Pastor, V. (2015). Student involvement and management of students' workload in formative assessment in higher education. Relieve, 21, art. ME6. doi: https://doi.org/10.7203/relieve.21.1.5171
Ibarra, M. S., & Rodríguez, G. (2010). Aproximación al discurso dominante sobre la evaluación del aprendizaje en la universidad. Revista de Educación, 351, 385-407.
Kaya, A., & Balta, N. (2016). Taking Advantages of Technologies: Using the Socrative in English Language Teaching Classes. International Journal of Social Sciences & Educational Studies, 2, 4-12.
Lafuente Martinez, M., Alvarez, I. M., & Remesal Ortiz, V. A. (2015). Making learning more visible through e-assessment: implications for feedback. Journal of Computing in Higher Education, 27, 10-27. doi: https://doi.org/10.1007/s12528-015-9091-8
Lai, K. W. (2011). Digital technology and the culture of teaching and learning in higher education. In Hong, K. S. & Lai, K. W. (Eds), ICT for accessible, effective and efficient higher education: Experiences of Southeast Asia. Australasian Journal of Educational Technology, 27(Special issue, 8), 1263-1275. doi: https://doi.org/10.14742/ajet.892
López_Hernández, F., & Silva_Pérez, M. (2016). Factores que inciden en la aceptación de los dispositivos móviles para el aprendizaje en educación superior. Estudios sobre Educación, 30, 175-195. doi: https://doi.org/10.15581/004.30.175-195
López-Pastor, V. M. (2012). Evaluación formativa y compartida en la universidad: clarificación de conceptos y propuestas de intervención desde la Red Interuniversitaria de Evaluación Formativa. Psychology, Society, & Education, 4, 117-130. doi: https://doi.org/10.25115/psye.v4i1.485
Luppicini, R. (2012). E-Technology Use and Abuse in University Classrooms. Journal of Education Research, 6, 153-163.
Marcelo, C., Yot, C., Mayor, C., Sánchez, M., Murillo, P., Rodríguez, J.M., & Pardo, A. (2014). Learning activities in higher education: Towards autonomous learning of students? Revista de Educación, 363, 334-339. doi: https://doi.org/ 10.4438/1988-592X-RE-2012-363-191
Méndez-Coca, D., & Slisko, J. (2013). Software Socrative and Smartphones as Tools For Implementation of Basic Processes of Active Physics Learning in Classroom: An Initial Feasibility Study With Prospective Teachers. European Journal of Physics Education, 4, 17-24.
Mills, H. (2015). Mobile Devices for Teaching and Learning in Higher Education. In: A. Jefferies & M. Cubric. (Eds.). Proceedings of the 14th European Conference on E-Learning (ECEL 2015). Hatfield: England.
Moreno, A. M., Iglesias, A., & Yáñez, R. (2013). Experiencia docente en base a técnicas de autoevaluación y razonamiento clínico odontológico por medio de las TIC. Pixel-Bit. Revista de Medios y Educación, 42, 37-49.
Nicol, D. (2010). From monologue to dialogue: improving written feedback processes in mass higher education. Assessment & Evaluation in Higher Education, 35, 501-517. doi: https://doi.org/10.1080/02602931003786559
Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 74-98. doi: https://doi.org/10.1016/j.edurev.2017.08.004
Panadero, E., & Romero, M. (2014). To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assessment in Education: Principles, Policy & Practice, 21, 133-148. doi: https://doi.org/10.1080/0969594X.2013.877872
Parker, R. E., Bianchi, A., & Cheah, T. Y. (2008). Perceptions of instructional technology: Factors of influence and anticipated consequences. Educational Technology & Society, 11, 274-293.
Poth, C. (2018). The contributions of mixed insights to advancing technology-enhanced formative assessments within higher education learning environments: an illustrative example. International Journal of Educational Technology in Higher Education, 15:9, 1-19. doi: https://doi.org/10.1186/s41239-018-0090-5
Quiroga, M. A., Fernández-Sánchez, J., Escorial, S., Merino, M. D., & Privado, J. (2015). Uso de móviles y tabletas para la evaluación de los conocimientos adquiridos: hagamos asequible la evaluación continua (2ª Fase). Universidad Complutense de Madrid. Retrieved from: http://eprints.ucm.es/34893/
Rashid, T., & Asghar, H. M. (2016). Technology use, self-directed learning, student engagement and academic performance: Examining the interrelations. Computers in Human Behavior, 63, 604-612. doi: https://doi.org/10.1016/j.chb.2016.05.084
Rivero, C., Chávez, A., Vásquez, A., & Blumen, S. (2016). Information Technology (IT) in college formation: achievements and challenges in Psychology and Education. Revista de Psicología, 34, 185-199. doi: https://doi.org/10.18800/psico.201601.007
Sevillano, M. L., Quicios, M. P., & González, J. L. (2016). The Ubiquitous Possibilities of the Laptop: Spanish University Students' Perceptions. Comunicar, 46, 87-95. doi: https://doi.org/10.3916/C46-2016-09
Teo, T. (2008). Pre-service teachers attitudes towards computer use: A singapore survey. Australasian Journal of Educational Technology, 24(4), 413-424. doi: https://doi.org/10.14742/ajet.1201
Wanner, T., & Palmer, E. (2018). Formative self-and peer assessment for improved student learning: the crucial factors of design, teacher participation and feedback. Assessment & Evaluation in Higher Education, 1-16. doi: https://doi.org/10.1080/02602938.2018.1427698
Yot, C. & Marcelo, C. (2007). University students’ self-regulated learning using digital technologies. International Journal of Educational Technology in Higher Education, 14:38. 1-18. doi: https://doi.org/10.1186/s41239-017-0076-8
