Validation of an instrument to analyze the cognitive strategies activated by young university students in the face of Fake News in the era of Artificial Intelligence

Authors

DOI:

https://doi.org/10.30827/relieve.v30i2.29490

Keywords:

validation, instrument, cognitive strategies, fake news, artificial intelligence

Abstract

The present society faces the challenge and uncertainty generated by the deluge of Fake News (FN) spread on social media. Meanwhile, the emergence of Artificial Intelligence (AI) leads to a state of misinformation that threatens democracies, public health, and the credibility of the media. In this context, the general public, and young people in particular, are not adequately prepared to respond to this issue. Therefore, this research presents the validation of an instrument to understand the cognitive strategies that young people activate when confronted with FN, categorizing them hierarchically according to Bloom's taxonomy. A sample of 543 Spanish university students participated in the validation process. Reliability was calculated using Cronbach's Alpha and McDonald's Omega coefficients. It was validated through exploratory factor analysis with oblique rotation and confirmatory factor analysis using the weighted least squares method. The results demonstrate a high level of internal consistency, ensuring reliability and construct validity. The final instrument consists of 9 variables and 52 items, in accordance with the initial model. Its scientific robustness makes it suitable for understanding the cognitive strategies activated by young people in response to FN. Finally, it should be noted that it can facilitate the design of educational interventions tailored to the identified needs, aiming to provide young people with appropriate strategies to critically respond to FN and the challenges posed by AI in this regard.

Downloads

Download data is not yet available.

Author Biographies

Jonathan Castañeda Fern´ández, University of Oviedo

Lecturer at the University of Oviedo, affiliated with the area of Research Methods and Diagnostic in Education (MIDE). He holds a degree in Pedagogy (awarded the National Prize for University Studies Completion) and a PhD with an international mention from the University of Oviedo, achieved thanks to a University Teaching Staff Training Scholarship (FPU) and a pre-doctoral research stay at the Universidade Lusiada de Lisbon. In teaching, he has primarily delivered courses linked to research and educational assessment. In research, he has participated in various projects (lines: evaluation of training activities, learning approaches, ecosystems for building global citizenship, etc.) and is currently a member of the research group “TECN@: Technology and Learning” at the University of Oviedo.

M. Esther Del Moral Pérez, University of Oviedo

Professor at the University. Teaches ICT applied to Education. Faculty of Teacher Training and Education. University of Oviedo (Spain). She has been recognised with four six-year research periods. She coordinates the TECN@ Research Group: Technology and Learning. Lead researcher of competitive projects, author of impactful articles in prestigious journals. Research areas include: media, digital literacy, TV and childhood, video games, social networks, augmented reality, digital applications, gamification, education in rural areas, etc. She has undertaken research stays in Calgary (Canada), Poitiers (France), Freiburg (Germany), and ITD Genoa (Italy). She has delivered courses at Ibero-American universities (Chile, Mexico, and Peru).

Nerea López-Bouzas, University of Oviedo

PhD in Education and Psychology, awarded a University Teaching Staff Training Scholarship (FPU). Holds a degree in Early Childhood Education and a Master's degree in Research and Innovation in Early Childhood and Primary Education. Collaborates with the Department of Education Sciences and is a member of the TECN@ research group: Technology and Learning at the University of Oviedo. Her research focuses on the integration of technological resources into the teaching-learning process, inclusive education, digital applications, augmented reality, gamification, analysis of audiovisual narratives, etc. She has completed a research stay at L'Istituto Tecnologie Didattiche (CNR-ITD) (Genoa, Italy) and the Centro de Investigação e Intervenção Educativas (CIIE) of the University of Porto (Porto, Portugal).

References

Al-Rawi, A., OʼKeefe, D., Kane, O., & Bizimana, A.J. (2021). Twitter’s fake news discourses around climate change and global warming. Frontiers in Communication, 6, 1-9. https://doi.org/10.3389/fcomm.2021.729818 DOI: https://doi.org/10.3389/fcomm.2021.729818

Batailler, C., Brannon, S.M., Teas, P.E., & Gawronski, B. (2022). A signal detection approach to understanding the identification of fake news. Perspectives on Psychological Science, 17(1), 78-98. https://doi.org/10.1177/1745691620986135 DOI: https://doi.org/10.1177/1745691620986135

Bernal, M.E., Gómez, M., & Iodice, R. (2019). Interacción conceptual entre el pensamiento crítico y metacognición. Latinoamericana de Estudios Educativos, 15(1), 193-217. https://doi.org/10.17151/rlee.2019.15.1.11 DOI: https://doi.org/10.17151/rlee.2019.15.1.11

Bloom, B.S., Engelhart, M.D., Furst, E.J., Hili, W.H. & Krathwohl, D.R. (1956). Taxonomy of educational objectives: Handbook I: Cognitive domain. Nueva York: David McKay.

Borges, T., Tiago, F., Silva, O., Guaita, J.M., & Botella, D. (2020). Online users' attitudes toward fake news: Implications for brand management. Psychology & Marketing, 37(9), 1171-1184. https://doi.org/10.1002/mar.21349 DOI: https://doi.org/10.1002/mar.21349

Bragarnich, R. (2022). Observations on psychic vulnerability to media dissemination of false political‐ideological messages (fake news). Journal of Analytical Psychology, 67(2), 455-467. https://doi.org/10.1111/1468-5922.12807 DOI: https://doi.org/10.1111/1468-5922.12807

Britt, M.A., Rouet, J.F., Blaum, D., & Millis, K. (2019). A reasoned approach to dealing with fake news. Policy Insights from the Behavioral and Brain Sciences, 6(1), 94-101. https://doi.org/10.1177/2372732218814855 DOI: https://doi.org/10.1177/2372732218814855

Bronstein, M.V., Pennycook, G., Buonomano, L., & Cannon, T. D. (2021). Belief in fake news, responsiveness to cognitive conflict, and analytic reasoning engagement. Thinking & Reasoning, 27(4), 510-535. https://doi.org/10.1080/13546783.2020.1847190 DOI: https://doi.org/10.1080/13546783.2020.1847190

Burbach, L., Halbach, P., Ziefle, M., Calero Valdez, A. (2019). Bubble Trouble: Strategies Against Filter Bubbles in Online Social Networks. In V. Duffy (eds). Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Healthcare Applications. HCII 2019. Lecture Notes in Computer Science (vol. 7., pp. 11582). Springer. https://doi.org/10.1007/978-3-030-22219-2_33 DOI: https://doi.org/10.1007/978-3-030-22219-2_33

Cabrera-Nguyen, P. (2010). Author Guidelines for Reporting Scale Development and Validation Results in the Journal of the Society for Social Work and Research. Journal of the Society for Social Work and Research, 1(2), 99–103. https://doi.org/10.5243/jsswr.2010.8 DOI: https://doi.org/10.5243/jsswr.2010.8

Catalina-García, B., Sousa, J.P., & Cristina Silva Sousa, L.C. (2019). Consumo de noticias y percepción de fake news entre estudiantes de Comunicación de Brasil, España y Portugal. Revista de Comunicación, 18(2), 93–115. https://doi.org/10.26441/RC18.2-2019-A5 DOI: https://doi.org/10.26441/RC18.2-2019-A5

De keersmaecker, J., & Roets, A. (2017). ‘Fake news’: Incorrect, but hard to correct. The role of cognitive ability on the impact of false information on social impressions. Intelligence, 65, 107-110. https://doi.org/10.1016/j.intell.2017.10.005 DOI: https://doi.org/10.1016/j.intell.2017.10.005

De Regt, A., Montecchi, M., & Ferguson, S. (2020). A false image of health: How fake news and pseudo-facts spread in the health and beauty industry. Journal of Product & Brand Management, 29(2), 168-179. https://doi.org/10.1108/JPBM-12-2018-2180 DOI: https://doi.org/10.1108/JPBM-12-2018-2180

De Vicente, A.M., Beriain, A., & Sierra, J. (2021). Young Spanish Adults and Disinformation: Do They Identify and Spread Fake News and Are They Literate in It? Publications, 9(1), 2. https://doi.org/10.3390/publications9010002 DOI: https://doi.org/10.3390/publications9010002

Del Moral, M.E., Bellver, M.C., Guzman, A., & López-Bouzas, N. (2021). Concienciación juvenil frente al COVID-19 en España y Latinoamérica: análisis de spots en YouTube. Revista Latina de Comunicación Social, 79, 23-49. https://doi.org/10.4185/RLCS-2021-1510 DOI: https://doi.org/10.4185/RLCS-2021-1510

Egelhofer, J.L., & Lecheler, S. (2019). Fake news as a two-dimensional phenomenon: A framework and research agenda. Annals of the International Communication Association, 43(2), 97-116. https://doi.org/10.1080/23808985.2019.1602782 DOI: https://doi.org/10.1080/23808985.2019.1602782

Greene, C. M., & Murphy, G. (2021). Quantifying the effects of fake news on behavior: Evidence from a study of COVID-19 misinformation. Journal of Experimental Psychology: Applied, 27(4), 773. https://doi.org/10.1037/xap0000371 DOI: https://doi.org/10.1037/xap0000371

Hernández-Sampieri, R., Fernández-Collado, C. & Baptista-Lucio, P. (2014). Metodología de la investigación. McGraw-Hill Education.

Hernández, L. (2020). Desinformación: no es sinónimo de fake news. Comunicación. Estudios Venezolanos de Comunicación, 189, 29-34.

Herrero-Diz, P., Conde, J., & Reyes, S. (2021). Spanish adolescents and fake news: level of awareness and credibility of information (Los adolescentes españoles frente a las fake news: nivel de conciencia y credibilidad de la información). Culture and Education, 33(1), 1-27. https://doi.org/10.1080/11356405.2020.1859739 DOI: https://doi.org/10.1080/11356405.2020.1859739

Herrero-Diz, P., Pérez, M., & Varona, D. (2022). Competencias de verificación de contenidos: una propuesta para los estudios de Comunicación. Revista de Comunicación, 21(1), 231-249. http://dx.doi.org/10.26441/rc21.1-2022-a12 DOI: https://doi.org/10.26441/RC21.1-2022-A12

Horner, C.G., Galletta, D., Crawford, J., & Shirsat, A. (2021). Emotions: The unexplored fuel of fake news on social media. Journal of Management Information Systems, 38(4), 1039-1066. https://doi.org/10.1080/07421222.2021.1990610 DOI: https://doi.org/10.1080/07421222.2021.1990610

Hu, L. & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118 DOI: https://doi.org/10.1080/10705519909540118

Iglesias, M. L., Tapia, A., & Velasco, C.M. (2023). Patologías y dependencias que provocan las redes sociales en los jóvenes nativos digitales. Revista de comunicación y salud, 13, 1-22. https://doi.org/10.35669/rcys.2023.13.e301 DOI: https://doi.org/10.35669/rcys.2023.13.e301

Lim, S., & Tan, K.R. (2020). Front liners fighting fake news: Global perspectives on mobilising young people as media literacy advocates. Journal of Children and Media, 14(4), 529-535. https://doi.org/10.1080/17482798.2020.1827817 DOI: https://doi.org/10.1080/17482798.2020.1827817

Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. http://dx.doi.org/10.6018/analesps.30.3.199361 DOI: https://doi.org/10.6018/analesps.30.3.199361

López-Flamarique, M., & Planillo, S. (2021). El alumnado de educación secundaria frente a las noticias falsas: resultados de una intervención didáctica. RELATEC. Revista Latinoamericana de Tecnología Educativa, 20(1), 39-56. https://doi.org/10.17398/1695-288X.20.1.39 DOI: https://doi.org/10.17398/1695-288X.20.1.39

Luo, M., Hancock, J. T., & Markowitz, D. M. (2022). Credibility perceptions and detection accuracy of fake news headlines on social media: Effects of truth-bias and endorsement cues. Communication Research, 49(2), 171-195. https://doi.org/10.1177/0093650220921321 DOI: https://doi.org/10.1177/0093650220921321

Mateus, J.C., Hernández-Breña, W., & Figueras, M. (2019). Validation of a Self-Perceived Media Competence Instrument for Pre-Service Teachers (Validación de un instrumento de autopercepción de competencia mediática para docentes en formación). Cultura y Educación, 31(2), 436-464. https://doi.org/10.1080/11356405.2019.1597440 DOI: https://doi.org/10.1080/11356405.2019.1597440

McDougall, J., Brites, M.J., Couto, M.J., & Lucas, C. (2019). Digital literacy, fake news and education/Alfabetización digital, fake news y educación. Cultura y Educación, 31(2), 203-212. https://doi.org/10.1080/11356405.2019.1603632 DOI: https://doi.org/10.1080/11356405.2019.1603632

Mendiguren, T., Pérez-Dasilva, J., & Meso, K. (2020). Actitud ante las Fake News: Estudio del caso de los estudiantes de la Universidad del País Vasco. Revista de Comunicación, 19(1), 171-184. https://doi.org/10.26441/RC19.1-2020-A10 DOI: https://doi.org/10.26441/RC19.1-2020-A10

Meza, A. (1979). Psicología del aprendizaje cognoscitivo. Hallazgos empíricos en los enfoques de Piaget y Gagné. NUCICC.

Montero, D., García, A. D., Gómez, Á.H., & Del Río, F.J. (2022). Validación del Cuestionario de Violencia Digital (Digital Violence Questionnaire, DVQ) en la pareja sentimental. RELIEVE. Revista Electrónica de Investigación y Evaluación Educativa, 28(2). https://doi.org/10.30827/relieve.v28i2.26142 DOI: https://doi.org/10.30827/relieve.v28i2.26142

Murciano, A., Gutiérrez, B. M., Martín, J., & Huete, A. (2022). Juventud onlife. Estudio sobre el perfil de uso y comportamiento de los jóvenes a través de las pantallas. RELIEVE. Revista Electrónica De Investigación Y Evaluación Educativa, 28(2). https://doi.org/10.30827/relieve.v28i2.26158 DOI: https://doi.org/10.30827/relieve.v28i2.26158

Orhan, A. (2023). Fake news detection on social media: the predictive role of university students’ critical thinking dispositions and new media literacy. Smart Learning Environments, 10(1), 1-14. https://doi.org/10.1186/s40561-023-00248-8 DOI: https://doi.org/10.1186/s40561-023-00248-8

Otero, I. (2022). Los cimientos de la Inteligencia Artificial en el sistema productivo de contenidos periodísticos automatizados. Redmarka. Revista de Marketing Aplicado, 26(1), 15-35. https://doi.org/10.17979/redma.2022.26.1.9056 DOI: https://doi.org/10.17979/redma.2022.26.1.9056

Pérez-Escoda, A., Ortega, E., & Pedrero, L.M. (2022). Alfabetización digital para combatir las fake news: Estrategias y carencias entre los/as universitarios/as. Revista Prisma Social, 38, 221-243. https://revistaprismasocial.es/article/view/4696

Rath, B., Gao, W., & Srivastava, J. (2019). Evaluating vulnerability to fake news in social networks: A community health assessment model. In F., Spezzano, W., Chen, X., Xiao (eds.), Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (pp. 432-435). https://doi.org/10.1145/3341161.3342920 DOI: https://doi.org/10.1145/3341161.3342920

Román, A., Sánchez N., & Zambrano, R. (2020) Las fake news durante el Estado de Alarma por COVID-19. Análisis desde el punto de vista político en la prensa española. Revista Latina de Comunicación Social, 78, 359-391. https://doi.org/10.4185/RLCS-2020-1481. DOI: https://doi.org/10.4185/RLCS-2020-1481

Ruffo, G., Semeraro, A., Giachanou, A., & Rosso, P. (2023). Studying fake news spreading, polarisation dynamics, and manipulation by bots: A tale of networks and language. Computer science review, 47, 100531. https://doi.org/10.1016/j.cosrev.2022.100531 DOI: https://doi.org/10.1016/j.cosrev.2022.100531

Saltor, J., Barberia, I., & Rodríguez‐Ferreiro, J. (2023). Thinking disposition, thinking style, and susceptibility to causal illusion predict fake news discriminability. Applied Cognitive Psychology, 37(2), 360-368. https://doi.org/10.1002/acp.4008 DOI: https://doi.org/10.1002/acp.4008

Ufarte, M.J., Calvo, L.M., & Murcia, F.J. (2021). Los desafíos éticos del periodismo en la era de la inteligencia artificial. Estudios sobre el Mensaje Periodístico, 27(2), 673-684. https://dx.doi.org/10.5209/esmp.69708 DOI: https://doi.org/10.5209/esmp.69708

Wang, C., & Huang, H. (2021). When “fake news” becomes real: The consequences of false government denials in an authoritarian country. Comparative Political Studies, 54(5), 753-778. https://doi.org/10.1177/0010414020957672 DOI: https://doi.org/10.1177/0010414020957672

Wang, X., Chao, F., Yu, G., & Zhang, K. (2022). Factors influencing fake news rebuttal acceptance during the COVID-19 pandemic and the moderating effect of cognitive ability. Computers in human behavior, 130, 107174. https://doi.org/10.1016/j.chb.2021.107174 DOI: https://doi.org/10.1016/j.chb.2021.107174

Zimmer, F., Scheibe, K., Stock, M., & Stock, W.G. (2019). Fake News in Social Media: Bad Algorithms or Biased Users? Journal of Information Science Theory and Practice, 7(2), 40-53, https://doi.org/10.1633/JISTaP.2019.7.2.4

Published

2024-12-30

How to Cite

Castañeda Fern´ández, J., Del Moral Pérez, M. E., & López-Bouzas, N. (2024). Validation of an instrument to analyze the cognitive strategies activated by young university students in the face of Fake News in the era of Artificial Intelligence. RELIEVE – Electronic Journal of Educational Research and Evaluation, 30(2). https://doi.org/10.30827/relieve.v30i2.29490

Issue

Section

Research Articles