Validation of an instrument for assessing the digital literacy of mexican students
DOI:
https://doi.org/10.21556/edutec.2024.88.3131Keywords:
measuring instrument, digital literacy, asessment, students, secondary educationAbstract
The rapid growth of Information and Communication Technologies has transformed global society, generating the need for digital literacy from an early age; however, in Mexico, the level of digital literacy among students is unknown, because the evidence found is limited. Therefore, the objective of this research was to validate an instrument that measures the level of digital literacy for high school students in Mexico. Using a non-experimental quantitative approach, a sample of 491 students from nineteen schools in Yucatan was selected. The instrument is composed of 39 items, the data collection was done online and descriptive analyses were used on the items, in addition to Internal Consistency Indices, Exploratory and Confirmatory Factor Analysis, to validate the construct. The results show normality in the items, the reliability coefficients indicate adequate internal consistency, the Factor Analyses reveal five dimensions, and all the adjustment indexes in the final model were adequate, confirming the validity of the construct. Therefore, this instrument showed good reliability and validity, although it is suggested to complement it with other evaluations.
Funding
Consejo Nacional de Humanidades Ciencia y Tecnología
Downloads
References
Alejandro, D., Zapata, A. y Reyes, W. (2021). Competencias digitales en estudiantes de educación secundaria. Una revisión sistemática. Revista científica electrónica de Educación y Comunicación en la Sociedad del Conocimiento, 21(2), 366-392. http://doi.org/10.30827/eticanet.v21i2.20959
Beltrán-Sánchez, J., García, R., Ramírez-Montoya, M. y Quintana, J. (2019). Factores que influyen en la integración del Programa de Inclusión y Alfabetización Digital en la docencia en escuelas primarias. Revista electrónica de Investigación Educativa, (21), 1-11. https://doi.org/10.24320/redie.2019.21.e31.2088
Cabero-Almenara, J., Gutiérrez-Castillo, J., Guillén-Gámez, F. y Gaete, A. (2022). Competencias digitales de estudiantes técnico-profesionales: creación de un modelo causal desde un enfoque PLS-SEM. Campus Virtuales, 11(1), 167-179. https://doi.org/10.54988/cv.2022.1.1008
Cammeraat, E. (2021). The Role of Innovation and Human Capital for the productivity of industries. OECD Science, Technology and Industry Policy Papers, 103. OECD, https://doi.org/10.1787/197c6ae9-en
Csilla, W. (2023). Digital literacy as ideological practice, ELT Journal, 77(2), 197–206, https://doi.org/10.1093/elt/ccad001
Digcomp 2.0. (2016). DigComp 2.0: The Digital Competence Framework for Citizens. Update Phase 1: The Conceptual Reference Model. European Commission, https://doi.org/10.2791/11517
European Commission. (2018). DigComp 2.1: the digital competence framework for citizens with eight proficiency levels and examples of use. Luxembourg: Publications Office. https://data.europa.eu/doi/10.2760/38842
García, V., Aquino, S. y Ramírez, N. (2016). Programa de alfabetización digital en México: 1:1. Análisis comparativo de las competencias digitales entre niños de primaria. CPU-e, (23), 24-44. https://doi.org/10.25009/cpue.v0i23.2158
García-Valcárcel, A., Casillas, S., & Basilotta, V. (2020). Validation of an Indicator Model (INCODIES) for Assessing Student Digital Competence in Basic Education. Journal of new approaches in educational research, 9(1), 110-125. https://doi.org/10.7821/naer.2020.1.459
George, C. y Avello, R. (2021). Alfabetización digital en la educación. Revisión sistemática de la producción científica en Scopus. Revista de Educación a Distancia (RED), 21(66). https://doi.org/10.6018/red.444751
González-Quiñones, F., Tarango, F. y Villanueva-Ledezma, A. (2019). Hacia una propuesta para medir capacidades digitales en usuarios de internet. Revista Interamericana de Bibliotecología, 42(3), 197-212. https://doi.org/10.17533/udea.rib.v42n3a01
Hancok, G., & An, J. (2020). A Closed-Form Alternative for Estimating ω Reliability under Unidimensionality. Measurement: Interdisciplinary Research and Perspectives, 18(1), 1-14. https://doi.org/10.1080/15366367.2019.1656049
Hash, P. (2020). Remote Learning in School Bands During the COVID-19 Shutdown. Journal of Research in Music Education, 68(4), 381-397. https://doi.org/10.1177/0022429420967008
Iacobucci, D. (2010). Structural equations modeling: Fit Indices, sample size, and advanced topics. Journal of Consumer Psychology, 20(1), 90-98. https://doi.org/10.1016/j.jcps.2009.09.003
ILO. (2021). Working from home: From invisibility to decent work. Geneva: ILO. https://bit.ly/3zArG6J
INTEF. (2017). Instituto Nacional de Tecnologías Educativas y de Formación del Profesorado. Marco Común de Competencia Digital Docente. Madrid: INTEF. https://bit.ly/2QqmwAw
ISTE. (2016). ISTE standars for students. Sociedad Internacional para la Tecnología en Educación. https://bit.ly/3S6lhra
Kaplan, D. (2004). The SAGE Handbook of Quantitative Methodology for the Social Sciences. Chicago: Sage. http://dx.doi.org/10.4135/9781412986311
Kriscautzky, M. y Ferreiro, E. (2018). Evaluar la confiabilidad de la información en Internet: cómo enfrentan el reto los nuevos lectores de 9 a 12 años. Perfiles Educativos, 40(159), 16-34. https://doi.org/10.22201/iisue.24486167e.2018.159.58306
Lamschtein, S. (2022). Una experiencia de evaluación de las competencias digitales de los docentes en México. Revista de Educación Mediática y TIC, 11(1), 1-19. http://dx.doi.org/10.21071/edmetic.v11i1.13438
Lauricella, A., Herdzina, J. & Robb, M. (2020). Early childhood educators' teaching of digital citizenship competencies. Computers & Education, (158). https://doi.org/10.1016/j.compedu.2020.103989
Luna, M. y Canto, P. (2021). Alfabetización digital en estudiantes de secundaria de Yucatán, México. Ciencia Latina, 5(4), 5466-5478. https://doi.org/10.37811/cl_rcm.v5i4.701
Manzanilla-Granados, H., Navarrete-Cazales, Z. y Ocaña-Pérez, L. (2021). Alfabetización digital en México: una revisión histórico-comparativa de políticas y programas. RECIE, 5(2), 183-197. https://doi.org/10.33010/recie.v5i2.1348
Marín, D., Cuevas, N. y Gabarda, V. (2021). Competencia digital ciudadana: análisis de tendencias en el ámbito educativo. RIED. Revista Iberoamericana de Educación a Distancia, 24(2), 329-349. https://doi.org/10.5944/ried.24.2.30006
Md Hassan, N., Abdul Majid, N. & Abu Hassan, N. (2020). Validation of learning environment inventory for secondary school contexts. International Journal of Evaluation and Research in Education (IJERE), 9(2), 379-384. https://doi.org/10.11591/ijere.v9i2.20444
Montoya, M. y Jaramillo, C. (2021). La alfabetización digital en desafío. Experiencia de un programa de alfabetización digital en jóvenes en Tijuana (México). Revista Alter, Enfoques Críticos, 12(24), 65-79. http://www.alterenfoques.com/alter24
OECD. (2020). Curriculum Overload. A way forward. OECD. https://doi.org/10.1787/3081ceca-en
OECD. (2021). Main Science and Technology Indicators (Vol. 2021). Paris: Publishing, OECD. OECD: https://doi.org/10.1787/2304277x
OECD. (2022). The state of the field of computational thinking in early childhood education. Boston: Tufts University. https://dx.doi.org/10.1787/3354387a-en
OECD/Eurostat. (2018). Oslo Manual 2018: Guidelines for Collecting, Reporting and Using Data on Innovation, 4th Edition, The Measurement of Scientific, Technological and Innovation Activities. Paris: OECD Publishing. https://doi.org/10.1787/9789264304604-en
ONU. (2015). Objetivos de Desarrollo Sostenible. Naciones Unidas. https://bit.ly/2Hycudz
Otzen, T. & Manterola, C. (2017). Sampling Techniques on a Population Study. International Journal of Morphology, 35(1), 227-232. http://dx.doi.org/10.4067/S0717-95022017000100037
P21. (2017). 21ST Century Skills. P21 Partnership for 21ST Century Learning. https://bit.ly/3PFdsXB
P21. (2019). Framework for 21st century learning. Partnership for 21st century learning. https://bit.ly/3PC7bw4
Pamplona, A., Reyes, W. y Pinto, J. (2020). Propuesta de instrumento para medir la alfabetización digital en estudiantes de secundaria en Yucatán, México. En M. Prieto, S. Pech y J. Angulo, Tecnología, innovación y práctica educativa, (págs. 142-148). Ciudad Real: CIATA.org. https://bit.ly/3zztHzW
Paños-Castro, J., Bilbao, E., Arruti, A. y Carballedo, R. (2022). Autopercepción de la competencia digital del alumnado del grado en Educación Social con Ikanos. Campus Virtuales, 11(1), 51-61. https://doi.org/10.54988/cv.2022.1.886
Peled, Y., Kurtz, G. & Avidov-Ungar, O. (2021). Pathways to a Knowledge Society: A Proposal for a Hierarchical Model for Measuring Digital Literacy Among Israeli pre-service Teachers. The Electronic Journal of e-Learning, 19(3), 118-133. https://doi.org/10.34190/ejel.19.3.2217
Porat, E., Blau, I. & Azy, B. (2018). Measuring digital literacies: Junior high-school students' perceived competencies versus actual performance. Computers & Education, 126, 23-36. https://doi.org/10.1016/j.compedu.2018.06.030
Prada, Gamboa-Suarez & Avendaño-Castro (2022). Development of digital competencies in latin american university students. Journal of Language and Linguistic Studies, 18(2), 39-51, https://www.jlls.org/index.php/jlls/article/view/4262/1241
Reyes, W. (2021). Alfabetización digital en la educación básica en México: análisis documental del plan de estudios. IE Revista de Investigación Educativa de la REDIECH, 12, e1155. https://doi.org/10.33010/ie_rie_rediech.v12i0.1155
Roco, A., Hernández, M. y Silva, O. (2021). ¿Cuál es el tamaño muestral adecuado para validar un cuestionario? Nutrición Hospitalaria, 4, 877-878. http://dx.doi.org/10.20960/nh.03633
Rojas-Torres, L. (2020). Robustness of Confirmatory Factor Analysis Fit Indices to Outliers. Revista de matemática: teoría y aplicaciones, 27(2), 383-404. https://doi.org/10.15517/rmta.v27i2.33677
Ruiz del Hoyo, E., Quiñonez, S. y Reyes, W. (2021). Competencia digital del docente de nivel secundaria. Revista Publicando, 8(28), 92-92. https://doi.org/10.51528/rp.vol8.id2160
Samaniego, J. (2023). A Cartography of Digital Literacy: Conceptual Categories and Main Issues in the Theorization and Study of Digital Literacies. Digital Education Review, 43, 68-86, https://doi.org/10.1344/der.2023.43.66-84
Sales, D. (2020). Definition of Information Literacy 2018. Anales de Documentación, 23(1), 1-5. https://doi.org/10.6018/analesdoc.373811
Salinas, J. y de Benito, B. (2020). Competencia digital y apropiación de las TIC: claves para la inclusión. Campus Virtuales, 9(2), 99-111. http://www.revistacampusvirtuales.es/
SEGEY. (2017). Sistema de Estadística Educativa de Yucatán. Secretaría de Educación del Estado de Yucatán: https://bit.ly/3zcBfXT
SEP. (2016). Programa @aprende 2.0. México. https://bit.ly/3S2HxlC
SEP. (2017). Aprendizajes Clave para la Educación Integral. Secretaría de Educación Pública. https://bit.ly/2lIf7m5
SEP. (2020). Acuerdo DOF 12/06/20 para la finalización del plan de estudios de educación básica. Diario Oficial de la Federación. https://bit.ly/3S3r3d1
Shi, D. & Maydeu, A. (2020). The effect of estimation methods on SEM fit Indices. Educational and Psychological Measurement, 80(3), 421-445. https://doi.org/10.1177/0013164419885164
Sloan, L. & Quan-Haase, A. (2017). The SAGE Handbook of Social Media Research Methods. Thousand Oaks: SAGE. https://doi.org/10.4135/9781473983847
Stockemer, D. (2017). Quantitative Methods for the Social Sciences. Otawa: Springer.
Supardi, S., Juhji, J., Azkiyah, I., Muqdamien, B., Ansori, A., Kurniawan, I. & Fitriadi, A. (2021). The ICT basic skills: Contribution to student social media utilization activities. International Journal of Evaluation and Research in Education (IJERE), 10(1), 222-229. http://doi.org/10.11591/ijere.v10i1.20598
Szczytko, R., Stevenson, K., Peterson, M., Nietfeld, J. & Strnad, R. (2018). Development and validation of the environmental literacy instrument for adolescents. Environmental Education Research, 25(2), 193-210. https://doi.org/10.1080/13504622.2018.1487035
Tondeur, J., Howard, S., Van Zanten, M., Gorissen, P., Van der Neu, I., Uerz, D., Kral, M. (2023). The HeDiCom framework: Higher Education teachers' digital competencies for the future. Education Tech Research Dev, 71:33-53, https://doi.org/10.1007/s11423-023-10193-5
UNESCO. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4.2. Susteainable Development Goals. https://bit.ly/2N5jbVB
UNESCO. (2021a). Global education monitoring report, 2021/2: non-state actors in education: who chooses? who loses? Paris: United Nations. https://bit.ly/3S1A5Hx
UNESCO. (2021b). Guidelines to strengthen the right to education in national frameworks. Paris: UNESCO. https://bit.ly/3rHEiCk
World Bank. (2020). The COVID-19 Pandemic: Shocks to Education and Policy Responses. Washington DC.: World Bank. https://doi.org/10.1596/33696
Zenda, R., Dlamini, R. (2023) Examining factors that influence teachers to adopt information and Communication Technology in rural secondary schools: an empirical study. Educ Inf Technol 28, 815–832. https://doi.org/10.1007/s10639-022-11198-y
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Edutec. Revista Electrónica de Tecnología Educativa
This work is licensed under a Creative Commons Attribution 4.0 International License.
By submitting the paper, the authors assign the publication rights to the journal Edutec. For its part, Edutec authorises its distribution as long as its content is not altered and its origin is indicated. At the end of each article published in Edutec, the citation procedure is indicated.
The management and editorial board of Edutec Revista Electrónica de Tecnología Educativa do not accept any responsibility for the statements and ideas expressed by the authors in their work.
Translated with www.DeepL.com/Translator (free version)
