Evaluating Assessment. Validation with PLS-SEM of ATAE Scale for the Analysis of Assessment Tasks

Authors

  • María Soledad Ibarra-Sáiz <p>UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. EVALfor Research Group. University of Cadiz, Spain.</p>
  • Gregorio Rodríguez-Gómez <p>&nbsp;UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. EVALfor Research Group. University of Cadiz, Spain.</p>

DOI:

https://doi.org/10.7203/relieve.26.1.17403

Keywords:

Assessment task, Assessment as learning, Empowerment, PLS-SEM, Partial Least Squares, Structural Equation Modeling, PLSpredict

Abstract

One of the essential functions of university teachers lies in the decision-making process regarding the various components included in assessment process design, where the quality of assessment tasks is a key aspect. This study presents both validation of an instrument for students to evaluate the assessment tasks and the model that upholds the relationships between constructs that characterise the assessment tasks. Working from a review of the literature, a theoretical model has been devised featuring the characteristics of the assessment tasks and the relationships between them. The Analysis of the Assessment and Learning Tasks questionnaire (ATAE) has been designed to check them, based on a formative measurement model. Using a cohort design, a total of 1,166 questionnaires were obtained, completed by students from the Business Administration and Management (BAM) and Finance and Accounting (F&A) degree courses. The measurement model and the structural model were evaluated by means of the Partial Least Squares Structural Equation Modeling (PLS-SEM) technique using SmartPLS_3 software. The results show no collinearity problems plus high levels of absolute and relative importance for each questionnaire item. From the students’ perception, it should be highlighted that the challenging aspect of an assessment task is related to transfer of learning, and that this is measured by use of communication strategies and demonstration of in-depth understanding.

Downloads

Download data is not yet available.

Author Biographies

María Soledad Ibarra-Sáiz, <p>UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. EVALfor Research Group. University of Cadiz, Spain.</p>

María Soledad Ibarra Sáiz. Senior Lecturer in Educational Assessment and Evaluation at University of Cadiz. Director of UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. Director of EVALfor Research Group–SEJ509 Assessment & Evaluation in Training Contexts from the Andalusian Programme on Research, Development and Innovation (PAIDI). She develops her research mainly in the field of assessment and evaluation in higher education. She has been principal researcher of more than 10 European, international and national projects, whose results have been published in various articles, book chapters and contributions to international conferences. She is currently the main co-researcher of the FLOASS Project - Learning outcomes and learning analytics in higher education: An action framework from sustainable assessment (RTI2018-093630-B-I00) in which 6 Spanish universities participate.

Gregorio Rodríguez-Gómez, <p>&nbsp;UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. EVALfor Research Group. University of Cadiz, Spain.</p>

Gregorio Rodríguez Gómez. Professor of Educational Research Methods at the University of Cadiz. He is the coordinator of the strategic area "Studies and research in assessment and evaluation" of the UNESCO Chair on Evaluation and Assessment, Innovation and Excellence in Education. Founding member of the EVALfor Research Group –SEJ509 Assessment and evaluation in training contexts. His research interest is focused on research methods and assessment and evaluation in higher education. He is currently the main co-researcher of the FLOASS Project - Learning outcomes and learning analytics in higher education: A framework for action from sustainable assessment (RTI2018-093630-B-I00). Author of articles, book chapters and contributions to international conferences. He has been President of the Interuniversity Association for Pedagogical Research (AIDIPE). He is currently President of the RED-U Spanish University Teaching Network.

Downloads

Published

2020-10-20

How to Cite

Ibarra-Sáiz, M. S., & Rodríguez-Gómez, G. (2020). Evaluating Assessment. Validation with PLS-SEM of ATAE Scale for the Analysis of Assessment Tasks. RELIEVE – Electronic Journal of Educational Research and Evaluation, 26(1). https://doi.org/10.7203/relieve.26.1.17403

Issue

Vol. 26 No. 1 (2020): EVALUACIÓN EN LA EDUCACIÓN SUPERIOR

Section

Special Section

License

The authors grant non-exclusive rights of exploitation of works published to RELIEVE and consent to be distributed under the Creative Commons Attribution-Noncommercial Use 4.0 International License (CC-BY-NC 4.0), which allows third parties to use the published material whenever the authorship of the work and the source of publication is mentioned, and it is used for non-commercial purposes.

The authors can reach other additional and independent contractual agreements, for the non-exclusive distribution of the version of the work published in this journal (for example, by including it in an institutional repository or publishing it in a book), as long as it is clearly stated that the Original source of publication is this magazine.

Authors are encouraged to disseminate their work after it has been published, through the internet (for example, in institutional archives online or on its website) which can generate interesting exchanges and increase work appointments.

The fact of sending your paper to RELIEVE implies that you accept these conditions.

 

Crossref
Scopus
Google Scholar
Europe PMC