Scale development on university students’ digital and online competencies
DOI:
https://doi.org/10.21556/edutec.2024.90.3265Keywords:
Digital and online competence (DOC), distance education, students' DOCs, online learning, DOC instrumentAbstract
This study aims to develop a self-assessment tool to help university students independently evaluate their digital and online competencies (DOCs). A quantitative methodology was employed, focusing on instrument validation and its ability to measure DOCs effectively. The development process was conducted in four structured phases, combining theoretical foundations with empirical testing. Data were collected from 945 students in the initial survey to test the instrument’s reliability and validity, followed by a larger sample of 2954 students for confirmatory analysis using Structural Equation Modelling–Partial Least Squares (SEM-PLS). The results confirmed that the tool provides a robust, scientific scale capable of measuring DOCs accurately. Additionally, this tool allows students to assess their readiness and improve their competencies in alignment with the increasing demands of digital learning environments in higher education. The research highlights the importance of developing scalable, adaptable self-assessment instruments to support lifelong learning and digital literacy among students. This validated scale offers significant potential for broader implementation and research in educational technology contexts.
Downloads
References
Alaaraj, H., & Ibrahim, F. W. (2014). An overview and classification of e-readiness assessment models. International Journal of Scientific and Research Publications, 4(12), 1–5.
Ala-Mutka, K. (2011). Mapping digital competence: Towards a conceptual understanding. Institute for Prospective Technological Studies. https://doi.org/10.13140/RG.2.2.18046.00322
Al-Araibi, A. A. M., Mahrin, M. N. B., & Yusoff, R. C. M. (2016). A systematic literature review of technological factors for e-learning readiness in higher education. Journal of Theoretical and Applied Information Technology, 93(2), 500–521.
Alem, F., Plaisent, M., Zuccaro, C., & Bernard, P. (2016). Measuring e-learning readiness concept: Scale development and validation using structural equation modeling. International Journal of E-Education, e-Business, e-Management and e-Learning, 6(4), 193–207. https://doi.org/10.17706/ijeeee.2016.6.4.193-207 DOI: https://doi.org/10.17706/ijeeee.2016.6.4.193-207
Alhassan, R. (2016). Mobile learning as a method of ubiquitous learning: Students’ attitudes, readiness, and possible barriers to implementation in higher education. Journal of Education and Learning, 5(1), 176–189. https://doi.org/10.5539/jel.v5n1p176 DOI: https://doi.org/10.5539/jel.v5n1p176
Anderson, T., & Dron, J. (2011). Three generations of distance education pedagogy. The International Review of Research in Open and Distributed Learning, 12(3), 80–97. https://doi.org/10.19173/irrodl.v12i3.890 DOI: https://doi.org/10.19173/irrodl.v12i3.890
Beetham, H., & Sharpe, R. (Eds.). (2013). Rethinking pedagogy for a digital age: Designing for 21st century learning. Routledge. https://doi.org/10.4324/9780203078952 DOI: https://doi.org/10.4324/9780203078952
Berita Satu Research. (2021). Indonesia digital infrastructure report 2021 (issue November). https://research.beritasatu.com/download/indonesia-digital-infrastructure-report-2021
Blayone, T. J. B. (2018). Reexamining digital-learning readiness in higher education: Positioning digital competencies as key factors and a profile application as a readiness tool. International Journal on E-Learning: Corporate, Government, Healthcare, and Higher Education, 17(4), 425–451.
Blayone, T. J. B., van Oostveen, R., Barber, W., DiGiuseppe, M., & Childs, E. (2017). Democratizing digital learning: Theorizing the fully online learning community model. International Journal of Educational Technology in Higher Education, 14(1), 13. https://doi.org/10.1186/s41239-017-0051-4 DOI: https://doi.org/10.1186/s41239-017-0051-4
Blayone, T. J. B., Mykhailenko, O., Kavtaradze, M., Kokhan, M., vanOostveen, R., & Barber, W. (2018). Profiling the digital readiness of higher education students for transformative online learning in the post-soviet nations of Georgia and Ukraine. International Journal of Educational Technology in Higher Education, 15(1), 37. https://doi.org/10.1186/s41239-018-0119-9 DOI: https://doi.org/10.1186/s41239-018-0119-9
Bocconi, S., Chioccariello, A., Dettori, G., Ferrari, A., Engelhardt, K., Kampylis, P., & Punie, Y. (2016). Exploring the field of computational thinking as a 21st century skill. Edulearn16 Proceedings, 1(7), 4725–4733. https://doi.org/10.21125/edulearn.2016.2136 DOI: https://doi.org/10.21125/edulearn.2016.2136
Bond, M., Marín, V. I., Dolch, C., Bedenlier, S., & Zawacki-Richter, O. (2018). Digital transformation in German higher education: Student and teacher perceptions and usage of digital media. International Journal of Educational Technology in Higher Education, 15(1), 48. https://doi.org/10.1186/s41239-018-0130-1 DOI: https://doi.org/10.1186/s41239-018-0130-1
Borg, W. R., & Gall, M. D. (1983). Educational research: An introduction (4th ed.). Pearson International Edition.
Bui, T. X., Sankaran, S., & Sebastian, I. M. (2003). A framework for measuring national e-readiness. International Journal of Electronic Business, 1(1), 3. https://doi.org/10.1504/IJEB.2003.002162 DOI: https://doi.org/10.1504/IJEB.2003.002162
Cleveland-Innes, M., & Garrison, D. R. (2012). Higher education and postindustrial society: New ideas about teaching, learning, and technology. In L. Moller & J. B. Huett (Eds.), The next generation of distance education (pp. 221–233). Springer US. https://doi.org/10.1007/978-1-4614-1785-9_15 DOI: https://doi.org/10.1007/978-1-4614-1785-9_15
Chaw, L. Y., & Tang, C. M. (2024). Exploring the relationship between digital competence proficiency and student learning performance. European Journal of Education, 59(1), e12593. https://doi.org/https://doi.org/10.1111/ejed.12593 DOI: https://doi.org/10.1111/ejed.12593
Cooper, J. M., & Allen, D. W. (1971). Microteaching: History and present status. ERIC Clearinghouse on Teacher Education.
Dalsgaard, C., & Paulsen, M. F. (2009). Transparency in cooperative online education. The International Review of Research in Open and Distributed Learning, 10(3), 1–22. https://doi.org/10.19173/irrodl.v10i3.671 DOI: https://doi.org/10.19173/irrodl.v10i3.671
Garrison, D. R., & Archer, W. (2000). A Transactional Perspective on Teaching and Learning: A framework for adult and higher education. Advances in Learning and Instruction Series (1st ed.). Elsevier Science, Inc.
Gay, G. H. E. (2016). An assessment of online instructor e-learning readiness before, during, and after course delivery. Journal of Computing in Higher Education, 28(2), 199–220. https://doi.org/10.1007/s12528-016-9115-z DOI: https://doi.org/10.1007/s12528-016-9115-z
Geng, S., Law, K. M. Y., & Niu, B. (2019). Investigating self-directed learning and technology readiness in blending learning environment. International Journal of Educational Technology in Higher Education, 16(1), 17. https://doi.org/10.1186/s41239-019-0147-0 DOI: https://doi.org/10.1186/s41239-019-0147-0
Ghomi, M., & Redecker, C. (2019). Digital competence of educators (DigCompEdu): development and evaluation of a self-assessment instrument for teachers’ digital competence. Proceedings of the 11th International Conference on Computer Supported Education, 541–548. https://doi.org/10.5220/0007679005410548 DOI: https://doi.org/10.5220/0007679005410548
Ghozali, I. (2008). Structural equation modeling: Metode alternatif dengan SEM-PLS [Pemodelan persamaan struktural: Metode alternatif dengan SEM-PLS] (1st ed.). Badan Penerbit Universitas Diponegoro.
Gumelar, G., Martadi, M., Rosalinda, I., Yudhaningrum, L., & Warju, W. (2022). Computer Self-Efficacy, Task Value, Digital Literacy, Online Learning Perceptions on Indonesian University Students’ Learning Satisfaction. Proceedings of the 1st World Conference on Social and Humanities Research (W-SHARE 2021), 654, 94–99. https://doi.org/10.2991/assehr.k.220402.021 DOI: https://doi.org/10.2991/assehr.k.220402.021
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). An introduction to structural equation modeling. In J. F. Hair, G. T. M. Hult, C. M. Ringle, M. Sarstedt, N. P. Danks, & S. Ray (Eds.), Partial least squares structural equation modeling (PLS-SEM) using R (pp. 1–29). Springer International Publishing. https://doi.org/10.1007/978-3-030-80519-7_1 DOI: https://doi.org/10.1007/978-3-030-80519-7_1
Hashim, M. A. M., Tlemsani, I., & Matthews, R. (2021). Higher education strategy in digital transformation. Education and Information Technologies, 27(3), 3171–3195. https://doi.org/10.1007/s10639-021-10739-1 DOI: https://doi.org/10.1007/s10639-021-10739-1
Hidayat, A. (2012, August 17). Membuat R tabel dalam excel (Tabel R) [Create an R table in excel (R Table)]. Uji Statistik. https://www.statistikian.com/2012/08/membuat-r-tabel-dalam-excel.html
Hung, M.-L. (2016). Teacher readiness for online learning: Scale development and teacher perceptions. Computers & Education, 94, 120–133. https://doi.org/10.1016/j.compedu.2015.11.012 DOI: https://doi.org/10.1016/j.compedu.2015.11.012
Hung, M.-L., Chou, C., Chen, C.-H., & Own, Z.-Y. (2010). Learner readiness for online learning: Scale development and student perceptions. Computers & Education, 55(3), 1080–1090. https://doi.org/10.1016/j.compedu.2010.05.004 DOI: https://doi.org/10.1016/j.compedu.2010.05.004
Ikaningrum, R. E., & Sarwanti, S. (2021). Students’ Digital Literacy in Online Reading Class: a Critical Reflection on English Language Learners. Leksema: Jurnal Bahasa Dan Sastra, 6(1), 1–12. https://doi.org/10.22515/ljbs.v6i1.2939 DOI: https://doi.org/10.22515/ljbs.v6i1.2939
Islam, A. T., Flint, J., Jaecks, P., & Cap, C. H. (2017). A proficient and versatile online student-teacher collaboration platform for large classroom lectures. International Journal of Educational Technology in Higher Education, 14(1), 29. https://doi.org/10.1186/s41239-017-0067-9 DOI: https://doi.org/10.1186/s41239-017-0067-9
Kusmawan, U. (2017a). Online microteaching: A multifaceted approach to teacher professional development. Journal of Interactive Online Learning, 15(1), 42–56.
Kusmawan, U. (2017b). Kesiapan belajar mandiri guru sekolah dasar: Studi kasus pada program studi PGSD pada FKIP Universitas Terbuka [Readiness for independent learning of elementary school teachers: A case study in the PGSD study program at the Open University FKIP]. Jurnal Pendidikan Dan Kebudayaan, 1(3), 279–293. https://doi.org/10.24832/jpnk.v1i3.406 DOI: https://doi.org/10.24832/jpnk.v1i3.406
Kusmawan, U. (2018a). Model instruksional DDFK [DDFK instructional model]. Jurnal Pendidikan.
Kusmawan, U. (2018b, May 16). Analyses of teachers’ attitudes towards online learning at Universitas Terbuka. International Conference Early Childhood Care and Education (ECCE), Moscow.
Kusmawan, U. (2020). A rationale for student digital and online competencies. International Conference on Innovation in Education and Pedagogy (ICIEP) 2020.
Kusmawan, U. (2022). A virtual lab as a vehicle for active learning through distance education. International Journal on Research in STEM Education, 4(2), 18–38. https://doi.org/10.31098/ijrse.v4i2.1188 DOI: https://doi.org/10.33830/ijrse.v4i2.1188
Kusmawan, U., Reynolds, R., & O’Toole, M. (2006). Environmental beliefs and attitudes: An analysis of ecological affinity in secondary science students in Indonesia [Conference presentation] (pp. 1–19). The AARE Annual International Education Research Conference, Adelaide.
Larasati, D. A., & Widyastuti, T. (2020). Pengembangan skala pemaafan diri (self-forgiveness) [Development of self-forgiveness scale]. Acta Psychologia, 2(1), Article 1. https://doi.org/10.21831/ap.v1i1.34121 DOI: https://doi.org/10.21831/ap.v1i1.34121
Lin, H.-H., Lin, S., Yeh, C.-H., & Wang, Y.-S. (2016). Measuring mobile learning readiness: Scale development and validation. Internet Research, 26(1), 265–287. https://doi.org/10.1108/IntR-10-2014-0241 DOI: https://doi.org/10.1108/IntR-10-2014-0241
López-Meneses, E., Sirignano, F. M., Vázquez-Cano, E., & Ramírez-Hurtado, J. M. (2020). University students’ digital competence in three areas of the DigCom 2.1 model: A comparative study at three European universities. Australasian Journal of Educational Technology, 36(3), 69–88. https://doi.org/10.14742/ajet.5583 DOI: https://doi.org/10.14742/ajet.5583
Luenendonk, M. (2019). Research and development (R&D): Overview & process. Cleverism. https://www.cleverism.com/rd-research-and-development-overview-process/
Lusianai, W. O., Rachim, M. D., Muliati, & Astin. (2022). Digital Literacy of Open Access Services to Support Online Learning During The Covid-19 Pandemic. Jurnal Pemberdayaan Masyarakat Madani (JPMM), 6(2), 325–350. https://doi.org/10.21009/jpmm.006.2.09 DOI: https://doi.org/10.21009/JPMM.006.2.09
Monecke, A., & Leisch, F. (2012). semPLS: Structural equation modeling using partial least squares. Journal of Statistical Software, 48(3). https://doi.org/10.18637/jss.v048.i03 DOI: https://doi.org/10.18637/jss.v048.i03
Nora, A., & Snyder, B. P. (2009). Developing an instrument to assess student readiness for online learning: A validation study. Journal of College Student Retention: Research, Theory & Practice, 7(1), 19.
Novella-García, C., & Cloquell-Lozano, A. (2021). The ethical dimension of digital competence in teacher training. Education and Information Technologies, 26(3), 3529–3541. https://doi.org/10.1007/s10639-021-10436-z DOI: https://doi.org/10.1007/s10639-021-10436-z
Palalas, A., Berezin, N., Gunawardena, C., & Kramer, G. (2015). A design based research framework for implementing a transnational mobile and blended learning solution. International Journal of Mobile and Blended Learning (IJMBL), 7(4), 57–74. https://doi.org/10.4018/IJMBL.2015100104 DOI: https://doi.org/10.4018/IJMBL.2015100104
Paulsen, M. F. (2008). Cooperative online education. Seminar.Net, 4(2), Article 2. https://doi.org/10.7577/seminar.2482 DOI: https://doi.org/10.7577/seminar.2482
Pettersson, F. (2018). On the issues of digital competence in educational contexts – a review of literature. Education and Information Technologies, 23(3), 1005–1021. https://doi.org/10.1007/s10639-017-9649-3 DOI: https://doi.org/10.1007/s10639-017-9649-3
Ramos, F., Tajú, G., & Canuto, L. (2011). Promoting distance education in higher education in Cape Verde and Mozambique. Distance Education, 32(2), 159–175. https://doi.org/10.1080/01587919.2011.584845 DOI: https://doi.org/10.1080/01587919.2011.584845
Reyna, J., Hanham, J., Vlachopoulos, P., & Meier, P. (2019). Using factor analysis to validate a questionnaire to explore self-regulation in learner-generated digital media (LGDM) assignments in science education. Australasian Journal of Educational Technology, 35(5), 128–152. https://doi.org/10.14742/ajet.4514 DOI: https://doi.org/10.14742/ajet.4514
Risnita. (2012). Pengembangan skala model Likert [Likert model scale development]. Edu-Bio, 3, 86–99.
Sappaile, B. I. (2007). Pembobotan butir pernyataan dalam bentuk skala likert dengan pendekatan distribusi Z [Weighting of statement items in the form of a Likert scale with a Z distribution approach]. Jurnal Pendidikan Dan Kebudayaan, 13(64), 1–8.
Siemens, G., Skrypnyk, O., Joksimovic, S., Kovanovic, V., Dawson, S., & Gasevic, D. (2015). The history and state of blended learning. Preparing for the digital university: A review of the history and current state of distance, blended, and online learning, 234. Link Research Lab. http://linkresearchlab.org/PreparingDigitalUniversity.pdf
Subban, M., Soni, S., & Padayachee, I. (2022). Students’ Digital Readiness for – and Satisfaction with – Online Learning: A Case Study of the University of KwaZulu-Natal, South Africa. Progressio, 42. https://doi.org/10.25159/2663-5895/10299 DOI: https://doi.org/10.25159/2663-5895/10299
Sudjana, N. (2006). Penilaian hasil proses belajar mengajar [Assessment of the results of the teaching and learning process]. Remaja Rosdakarya.
Suryabrata, S. (2000). Pengembangan alat ukur psikologis [Development of psychological measurement tools].
Tan, X., Lin, X., & Zhuang, R. (2024). Development and validation of a secondary vocational school students’ digital learning competence scale. Smart Learning Environments, 11(1), 37. https://doi.org/10.1186/s40561-024-00325-6 DOI: https://doi.org/10.1186/s40561-024-00325-6
Truong, Y., & McColl, R. (2011). Intrinsic motivations, self-esteem, and luxury goods consumption. Journal of Retailing and Consumer Services, 18(6), 555–561. https://doi.org/10.1016/j.jretconser.2011.08.004 DOI: https://doi.org/10.1016/j.jretconser.2011.08.004
Wicaksono, R. B., & Prasetiyo, W. H. (2023). Digital competence for students in the networking society 5.0: A systematic review. Jurnal Civics: Media Kajian Kewarganegaraan, 20(2), 412–425. https://doi.org/10.21831/jc.v20i2.51673 DOI: https://doi.org/10.21831/jc.v20i2.51673
Wijaya, T., & Ediyono, S. (2022). Pembelajaran Sejarah Berbasis Media Online dalam Meningkatkan Kemampuan Literasi Digital Siswa di Era Revolusi Industri 4.0. Social, Humanities, and Educational Studies (SHEs): Conference Series, 5(3), 196. https://doi.org/10.20961/shes.v5i3.59322 DOI: https://doi.org/10.20961/shes.v5i3.59322
Yuan, L. (2015). MOOCs and open education timeline (updated). Li Yuan CETIS Blog. http://blogs.cetis.org.uk/cetisli/2015/05/11/moocs-and-open-education-timeline-updated.
Zakharevych, M., & Hryhorenko, V. (2024). Digital Competence and Digital Literacy of Higher Education Acquires. Collection of Scientific Papers of Uman State Pedagogical University, 1, 119–129. https://doi.org/10.31499/2307-4906.1.2024.302215 DOI: https://doi.org/10.31499/2307-4906.1.2024.302215
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Edutec. Revista Electrónica de Tecnología Educativa
This work is licensed under a Creative Commons Attribution 4.0 International License.
By submitting the paper, the authors assign the publication rights to the journal Edutec. For its part, Edutec authorises its distribution as long as its content is not altered and its origin is indicated. At the end of each article published in Edutec, the citation procedure is indicated.
The management and editorial board of Edutec Revista Electrónica de Tecnología Educativa do not accept any responsibility for the statements and ideas expressed by the authors in their work.
Translated with www.DeepL.com/Translator (free version)
