Skip to main content

Advertisement

SpringerLink
Log in

Design and validation of an instrument of self-perception regarding the lecturers’ use of ICT resources: to teach, evaluate and research

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

This study is part of a research about the use of ICT resources by Higher Education teachers to teach, evaluate and research (UICT-TER). The aim, in this case, is the creation and validation of a measuring instrument on the use of ICT resources based on the UICT-TER model. After the preparation and application of the instrument to a sample of 867 Higher Education teachers in the Spanish territory, the reliability, content validity, comprehension and construct validity were analyzed. In the initial creation of the instrument, three dimensions corresponding to a total of 24 items were established, achieving a final version of 16 items. Regarding content validity, the experts (n = 4) positively assessed the construct, dimensions and items of the questionnaire. The reliability analysis through Cronbach’s alpha were highly satisfactory and in relation to the Confirmatory Factor Analysis, the results found a good fit of the model. In addition, the instrument had external evidence of validity through different descriptive analyses with the variables gender, type of university (public-private), employment relationship (full-part-time), area of knowledge of the teaching staff (Science and Engineering-Architecture, Health Sciences, Art-Humanities and Social-Legal Sciences). Taking into account all the results obtained, the instrument created meets the psychometric properties required to be considered a valid and reliable instrument to measure the use of ICT resources according to the UICT-TER model in the Higher Education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Agreda, M., Hinojo, M.A., y Sola, J.M. (2017). Diseño y validación de un instrumento para evaluar la competencia digital de los docentes en la educación superior española. Pixel-Bit. Revista de Medios y Educación, 49, 39-56. https://doi.org/10.12795/pixelbit.2016.i49.03.

  • Almeraya, J. M. C., & Tobón, S. (2019). Validez de una rúbrica para medir competencias investigativas en pedagogía desde la socioformación. Atenas, 3(47), 1–17 https://atenas.reduniv.edu.cu/index.php/atenas/article/view/486.

    Google Scholar 

  • Bentler, P. M. (1989). EQS structural equations program manual. Los Angeles: BMDP Statistical Software.

    Google Scholar 

  • Biggs, J. (2005). Calidad del aprendizaje universitario. Madrid: Narcea.

    Google Scholar 

  • Bozu, Z. y Canto, P.J. (2009). El profesorado universitario en la sociedad del conocimiento: competencias profesionales docentes. Revista de Formación e Innovación Educativa en la Universidad, 2 (2), 87–97.

  • Buela-Casal, G., Guillén-Riquelme, A., Ramiro-Sánchez, T., y Quevedo-Blasco, R. (2017). Ranking de investigación de las universidades públicas españolas. Revista Iberoamericana de Psicología y Salud, 8, 21-35. https://doi.org/10.23923/j.rips.2017.08.003.

  • Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. https://doi.org/10.1037/0033-2909.105.3.456.

    Article  Google Scholar 

  • Cabero, J., Marín, V. y Llorente, C. (2010). Hacia el diseño de un instrumento de diagnóstico de competencias tecnológicas del profesorado universitario. Revista Iberoamericana de Educación, 52 (7), 1-12https://doi.org/10.35362/rie5271761.

  • Cabezas González, M., Casillas Martín, S., Sanches-Ferreira, M., Diogo, T., & Luís, F. (2017). Validación de un instrumento para medir la competencia digital de estudiantes universitarios (CODIEU). Revista de estudios e investigación en Psicología y Educación. (13): 21-24. https://doi.org/10.17979/reipe.2017.0.13.2180.

  • Calvo, M. B., Abad, F. M., & Conde, M. J. R. (2017). Validación psicométrica de un instrumento de evaluación de competencias informacionales en la educación secundaria. Bordón. Revista de pedagogía, 69(1), 27–43. https://doi.org/10.13042/Bordon.2016.48593.

    Article  Google Scholar 

  • Carretero-Dios, H. y Pérez, C. (2005). Normas para el desarrollo y revisión de estudios instrumentales. International Journal of Clinical and Health Psychology, 5(3), 521–551.

  • Castro, L., Carvajar, C. y Ugarte, J. (2004). La cultura de la investigación científica en la educación superior en Colombia. Una aproximación desde seis universidades del país. Bogotá. Universidad de los Adres. Progama de Maestría en Dirección Universitaria.

  • Comisión Europea (2012). Comunicación de la comisión al parlamento europeo, al consejo, al comité económico y social europeo y al comité de las regiones. COM/2018/029 final. Estrasburgo.https://eur-lex.europa.eu/legal-content/BG/TXT/PDF/?uri=CELEX:52018DC0029&from=ES

  • Correa, M. R., & Rivadulla-López, J. C. (2017). The training of university teachers and students in the use of ICT and Moodle. Educational Contexts: Revista de Educación, (2), 65–81. https://doi.org/10.18172/con.2966.

  • Cortada de Kohan, N. (1999). Teorías psicométricas y Construcción de Tests. Buenos Aires: Editorial Lugar.

    Google Scholar 

  • Cunha, M. I. (2015). Investigación y docencia: escenarios y senderos epistemológicos para la evaluación de la educación superior. REDU. Revista de Docencia Universitaria, 13(1), 79–94.

    Article  Google Scholar 

  • Dauda, M., Ayanda, M., & Jibrin, A. (2018). Analysis of students’ attitude towards the use of information and communication Technology in Nigerian Tertiary Institutions. ATBU Journal of Science, Technology and Education, 6(1), 100–105 Available on line at: http://www.atbuftejoste.com/index.php/joste/article/view/487.

    Google Scholar 

  • Dellit, J. (2001). Using ICT for quality in teaching-learning evaluation processes. Learning federation secretariat Australian education systems officials committee [EN]. http://ictliteracy.info/rf.pdf/UsingICTQuality.pdf

  • De-Moya-Anegón, F., Herrán-Páez, E., Bustos-González, A., CoreraÁlvarez, E., Tibaná-Herrera, G., y Rivadeneyra, F. (2019). Ranking Iberoamericano de instituciones de educación superior 2019 (SIR Iber). Recuperado de http://www.elprofesionaldelainformacion.com/documentos/SIR_Iber_2019.pdf

  • Díaz, W. (2016). Formación del profesorado universitario, evaluación de la actividad docente, recursos y promoción profesional. Estudios Pedagógicos, 42(1), 65–85. https://doi.org/10.4067/S0718-07052016000100005.

    Article  Google Scholar 

  • Durán, M., Gutiérrez, I. y Prendes, M. (2016). Certificación de la competencia Tic del profesorado universitario. Diseño y validación de un instrumento. Consejo Mexicano de Investigación Educativa, 21(69), 527–556.

  • Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 56–83. https://doi.org/10.1080/10705519909540119.

    Article  Google Scholar 

  • Fernández-Márquez, E., Leiva-Olivencia, J. J., & López-Meneses, E. (2018). Competencias digitales en docentes de Educación Superior. Revista Digital de Investigación en Docencia Universitaria, 12(1), 213–231.

    Article  Google Scholar 

  • Flores-Lueg, C., & Vila, R. R. (2016). Diseño y validación de una escala de autoevaluación de competencias digitales para estudiantes de pedagogía. Píxel-Bit. Revista de Medios y Educación. (48): 209-224.

  • From, J. (2017). Pedagogical digital competence--between values, knowledge and skills. Higher Education Studies, 7(2), 43–50. https://doi.org/10.5539/hes.v7n2p43.

    Article  Google Scholar 

  • Ge, W., Han, X., & Shen, X. (2018). Developing a validated instrument to measure Teachers' ICT competencies for university teaching in a digital age. In 2018 seventh international conference of educational innovation through technology (EITT) (pp. 101-105). IEEE. https://doi.org/10.1109/EITT.2018.00028.

  • Ghomi, M., & Redecker, C. (2018). Digital competence of educators (DigCompEdu): Development and evaluation of a self-assessment instrument for teachers’ digital competence. In proceedings of the 11th international conference on computer supported education - volume 1: CSEDU, pages 541–548. https://doi.org/10.5220/0007679005410548.

  • González Jaimes, E.I., López Chau, A., Trujillo Mora, V. y Bautista López, J. (2019). Instrumento certificador de tecnologías de la información y la comunicación y tecnologías del aprendizaje y el conocimiento para docentes universitarios. Revista Iberoamericana para la investigación y el desarrollo educativo, 10(19), 1-27. Doi: https://doi.org/10.23913/ride.v10i19.516.

  • Gudmundsdottir, G. B., & Hatlevik, O. E. (2018). Newly qualified teachers’ professional digital competence: Implications for teacher education. European Journal of Teacher Education, 41(2), 214–231. https://doi.org/10.1080/02619768.2017.1416085.

    Article  Google Scholar 

  • Guillén-Gámez, F. D., Lugones, A., Mayorga-Fernández, M. J., & Wang, S. (2019). ICT use by pre-service foreign languages teachers according to gender, age and motivation. Cogent Education, 6(1), 1574693. https://doi.org/10.1080/2331186X.2019.1574693.

    Article  Google Scholar 

  • Guillén-Gámez, F. D., Ruiz-Palmero, J., Sánchez-Rivas, E., & Colomo-Magaña, E. (2020). ICT resources for research: An ANOVA analysis on the digital research skills of higher education teachers comparing the areas of knowledge within each gender. Education and information technologies. 1-15. https://doi.org/10.1007/s10639-020-10176-6.

  • Gutiérrez Castillo, J. J., Cabero Almenara, J., & Estrada Vidal, L. I. (2017). Diseño y validación de un instrumento de evaluación de la competencia digital del estudiante universitario. Revista Espacios, 38(10), 1–27 http://revistaespacios.com/a17v38n10/17381018.html.

    Google Scholar 

  • Hair, J., Anderson, R., Tathan, R. y Black, W. (2009). Análisis multivariante. Madrid: Pearson.

  • Helleve, I., Grov Almås, A., & Bjørkelo, B. (2019). Becoming a professional digital competent teacher. Professional development in education, 1–13. https://doi.org/10.1080/19415257.2019.1585381.

  • Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416. https://doi.org/10.1177/0013164405282485.

    Article  MathSciNet  Google Scholar 

  • Hernández, I. (2009). El docente investigador en la formación de profesionales. Revista Virtual Universidad Católica del Norte, 27, 1–21 https://www.redalyc.org/pdf/1942/194215432011.pdf.

    Google Scholar 

  • Hernández, R. M. (2017). Impacto de las TIC en la educación: Retos y Perspectivas. Propósitos y representaciones, 5(1), 325–347.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure 17 analysis: Conventional criteria versus new alternatives. Structural Equation 18 Modeling: A Multidisciplinary J, 6(1), 1–55.

    Article  Google Scholar 

  • Kelentrić, M., Helland, K., & Arstorp, A. T. (2018). Professional digital competence framework for teachers. Accessed On, 15, 1–74.

    Google Scholar 

  • Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: Guilford.

    MATH  Google Scholar 

  • Lagoa-Varela, D., Álvarez-García, B., y Boedo, L. (2018). Recent changes in the role of Spanish lecturers in economics and business: An empirical analysis based on their own perspectives. Studies in Higher Education, 43, 1321–1333. https://doi.org/10.1080/03075079.2016.1250738.

  • Lawrence, J. E., & Tar, U. A. (2018). Factors that influence teachers’ adoption and integration of ICT in teaching/learning process. Educational Media International, 55(1), 79–105. https://doi.org/10.1080/09523987.2018.1439712.

    Article  Google Scholar 

  • Lazaro, L. M. (2018). Enseñar e investigar hoy en educación comparada: la perspectiva de tres décadas de dedicación académica en ese campo. RBEC. Revista Brasileña de Educación Comparada, 1(1), 1–7 https://econtents.bc.unicamp.br/inpec/index.php/rbec/article/view/9387.

    Article  Google Scholar 

  • Lázaro-Cantabrana, J., Usart-Rodríguez, M., & Gisbert-Cervera, M. (2019). Assessing teacher digital competence: The construction of an instrument for measuring the knowledge of pre-service teachers. Journal of New Approaches in Educational Research (NAER Journal), 8(1), 73–78. https://doi.org/10.7821/naer.2019.1.370.

    Article  Google Scholar 

  • Marsh, H. W. (1993). The multidimensional structure of physical fitness: Invariance over gender and age. Research Quarterly for Exercise and Sport, 64(3), 256–273. https://doi.org/10.1080/02701367.1993.10608810.

    Article  Google Scholar 

  • Martínez-Serrano, M. D. C. D. (2018). Diseño y validación de un cuestionario sobre la competencia digital del alumnado de educación primaria. Eduser-Revista de Educação, 10(2), 35–49. https://doi.org/10.34620/eduser.v10i2.113.

    Article  Google Scholar 

  • Medina-Rebollo, D., Grimaldi-Puyana, M., Del Río-Rama, M., & Sánchez-Oliver, A. (2019). Elaboración y validación de un cuestionario para evaluar el uso didáctico de la plataforma de teleformación Moodle en el contexto universitario. Revista ESPACIOS, 40(09), 1–9.

    Google Scholar 

  • Ministerio de Educación, C. y D. (MECD) (2019). Datos y cifras del sistema universitario español. http://www.educacionyfp.gob.es/dam/jcr:2af709c9-9532-414e-9bad-c390d32998d4/datos-y-cifras-sue-2018-19.pdf

  • Nordén, L. Å., Mannila, L., & Pears, A. (2017). Development of a self-efficacy scale for digital competences in schools. In 2017 IEEE Frontiers in education conference (FIE) (pp. 1-7). IEEE. https://doi.org/10.1109/FIE.2017.8190673.

  • Pérez, F., y Aldás, J. (Dirs.) (2018). U-Ranking 2018. Indicadores sintéticos de las universidades españolas (6ª ed.). Madrid: Fundación BBVA. Recuperado de https://www.fbbva.es/wp-content/uploads/2018/06/ Informe-U-Ranking-FBBVA-Ivie-2018.pdf.

  • Rivera-Laylle, L. I., Fernández-Morales, K., Guzmán-Games, F. J. y Eduardo-Pulido, J. (2017). ICT acceptance by university professors: Knowledge, attitude, and practicality. Revista Electrónica Educare, 21(3), 99-116. DOI: https://doi.org/10.15359/ree.21-3.

  • Salajan, F. D. (2018). An analysis of rhetorical devices in policy narratives on the European Institute of Innovation and Technology: Implications for European higher education. European Educational Research Journal, 17, 555–583. https://doi.org/10.1177/1474904117720793.

    Article  Google Scholar 

  • Sánchez, A., Lagunes, A., Torres, C. A., Judikis, J. C., & López, F. (2019). Exploratory factor analysis of a digital competency questionnaire for research. In Iberoamerican workshop on human-computer interaction (pp. 189-210). Springer, Cham. https://doi.org/10.1007/978-3-030-37386-3_15.

  • Sánchez-Mena, A., Martí-Parreño, J., & Aldás-Manzano, J. (2018). Teachers’ intention to use educational video games: The moderating role of gender and age. Innovations in education and teaching international, 1–12. https://doi.org/10.1080/14703297.2018.1433547.

  • Sevillano-García, M., & Vázquez-Cano, E. (2015). The impact of digital Mobile devices in higher education. Journal of Educational Technology & Society, 18(1), 106–118 Retrieved from http://www.jstor.org/stable/jeductechsoci.18.1.106.

    Google Scholar 

  • Suwanroj, T., Leekitchwatana, P., & Pimdee, P. (2019). Confirmatory factor analysis of the essential digital competencies for undergraduate students in Thai higher education institutions. Journal of Technology and Science Education, 9(3), 340–356. https://doi.org/10.3926/jotse.645.

    Article  Google Scholar 

  • Tapasco, O. A., & Giraldo, J. A. (2017). Estudio Comparativo sobre Percepción y uso de las TIC entre Profesores de Universidades Públicas y Privadas. Formación universitaria, 10(2), 03–12. https://doi.org/10.4067/S0718-50062017000200002.

    Article  Google Scholar 

  • Taquez, H., Rengifo, D., & Mejía, D. (2017). Diseño de un instrumento para evaluar el nivel de uso y apropiación de las TIC en una institución de educación superior. Repositorio Digital Universidad Nacional Autónoma de México, 1–30. Cali, Colombia: Universidad Icesi http://recursos.portaleducoas.org/sites/default/files/5030.pdf.

    Google Scholar 

  • Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington: American Psychological Association.

    Book  Google Scholar 

  • Tondeur, J., Aesaert, K., Prestridge, S., & Consuegra, E. (2018). A multilevel analysis of what matters in the training of pre-service teacher’s ICT competencies. Computers & Education, 122, 32–42. https://doi.org/10.1016/j.compedu.2018.03.002.

    Article  Google Scholar 

  • Tondeur, J., Aesaert, K., Pynoo, B., van Braak, J., Fraeyman, N., & Erstad, O. (2017). Developing a validated instrument to measure preservice teachers’ ICT competencies: Meeting the demands of the 21st century. British Journal of Educational Technology, 48(2), 462–472. https://doi.org/10.1111.bjet.12380.

  • Tourón, J., Martín, D., Navarro, E., Pradas, S., & e Iñigo, V. (2018). Construct validation of a questionnaire to measure teachers’digital competence (CDD). Revista Española de Pedagogía, 76(269), 25–54. https://doi.org/10.22550/REP76-1-2018-02.

    Article  Google Scholar 

  • Trejo, R. M. (2017). Diseño Y Validación De Un Instrumento De Evaluación De La Competencia Digital Docente. (Doctoral dissertation, Universitat de les Illes Balears).

  • Uriel, E., & Aldás, J. (2005). Análisis multivariante aplicado. 1ª. Edición. Thomson. Madrid.

  • Vázquez-Cano, E., Meneses, E. L., & García-Garzón, E. (2017). Differences in basic digital competences between male and female university students of social sciences in Spain. International Journal of Educational Technology in Higher Education, 14(1), 14–27. https://doi.org/10.1186/s41239-017-0065-y.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Research and Diagnostic Methods in Education, Faculty of Education, University of Zaragoza, Zaragoza, Spain

    Francisco D. Guillén-Gámez

  2. Department of Didactics and School Organization, Faculty of Education Sciences, University of Malaga (UMA), 29071, Málaga, Spain

    María J. Mayorga-Fernández

Authors
  1. Francisco D. Guillén-Gámez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. María J. Mayorga-Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francisco D. Guillén-Gámez.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table 12 Self-perception questionnaire regarding the use of ICT resources by university teachers to teach, assess and research. For each of the following items, indicate their degree of use. This is a 5-point Likert scale, where the value 5 is the maximum score to achieve
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guillén-Gámez, F.D., Mayorga-Fernández, M.J. Design and validation of an instrument of self-perception regarding the lecturers’ use of ICT resources: to teach, evaluate and research. Educ Inf Technol 26, 1627–1646 (2021). https://doi.org/10.1007/s10639-020-10321-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-020-10321-1

Keywords

Search

Navigation