Development and Psychometric Validation of an E-Learning Competency Survey for Educators

Educational Point, 2(2), 2025, e133, https://doi.org/10.71176/edup/17424
Publication date: Nov 17, 2025

ABSTRACT

Amid the post‑COVID‑19 expansion of e‑learning, this study developed and validated a survey instrument to assess e‑learning competencies among science and mathematics supervisors in Kuwait. After expert review using the Lawshe–Tristan method, an exploratory factor analysis on data from 345 supervisors confirmed an eight‑factor structure encompassing computer literacy, computer skills, educational planning, program design, pedagogical practice, assessment, professional development, and ethical/legal awareness. Confirmatory factor analysis produced an acceptable fit for teachers but a weaker fit for students, underscoring the need for further refinement. Cronbach’s alpha and McDonald’s omega coefficients indicated excellent internal consistency. Descriptive analyses revealed that male supervisors, those with advanced technology expertise and higher English proficiency, and those at intermediate or secondary levels scored higher across domains. The validated instrument is a valuable tool for diagnosing training needs and guiding e‑learning professional development in Kuwait and similar contexts. The instrument thus provides a psychometrically robust tool for assessing readiness to learn and highlights demographic differences that can be used to target professional development. The study concludes with a recommendation to conduct larger sample sizes and additional validation phases to refine the instrument further and improve its applicability in different educational contexts.

KEYWORDS

e‑learning competencies instrument validation content validity ratio reliability analysis confirmatory factor analysis science and mathematics supervisors Kuwait

CITATION (APA)

Alhashem, F. (2025). Development and Psychometric Validation of an E-Learning Competency Survey for Educators. Educational Point, 2(2), e133. https://doi.org/10.71176/edup/17424
Harvard
Alhashem, F. (2025). Development and Psychometric Validation of an E-Learning Competency Survey for Educators. Educational Point, 2(2), e133. https://doi.org/10.71176/edup/17424
Vancouver
Alhashem F. Development and Psychometric Validation of an E-Learning Competency Survey for Educators. Educational Point. 2025;2(2):e133. https://doi.org/10.71176/edup/17424
AMA
Alhashem F. Development and Psychometric Validation of an E-Learning Competency Survey for Educators. Educational Point. 2025;2(2), e133. https://doi.org/10.71176/edup/17424
Chicago
Alhashem, Fatimah. "Development and Psychometric Validation of an E-Learning Competency Survey for Educators". Educational Point 2025 2 no. 2 (2025): e133. https://doi.org/10.71176/edup/17424
MLA
Alhashem, Fatimah "Development and Psychometric Validation of an E-Learning Competency Survey for Educators". Educational Point, vol. 2, no. 2, 2025, e133. https://doi.org/10.71176/edup/17424

REFERENCES

  1. Alhashem, F., Agha, N., & Mohammad, A. (2022). Required competencies for e-learning among science and mathematics supervisors: Post-pandemic features of education. The International Journal of Information and Learning Technology, 39(3), 240–255. https://doi.org/10.1108/IJILT-07-2021-0108
  2. Akyol, Z. and Garrison, D. (2011). Understanding cognitive presence in an online and blended community of inquiry: assessing outcomes and processes for deep approaches to learning. British Journal of Educational Technology, 42(2), 233-250. https://doi.org/10.1111/j.1467-8535.2009.01029.x
  3. Bürkner, P. C., Gabry, J., & Vehtari, A. (2021). Efficient leave-one-out cross-validation for Bayesian non-factorized normal and Student-t models. Computational Statistics, 36(2), 1243-1261. https://doi.org/10.1007/s00180-020-01045-4
  4. Chang, C. and Cheng, S. (2015, June 6-8). Implementing an SCORM-based e-learning system for a multinational enterprise [Conference session]. IEEE International Conference on Consumer Electronics, Taipei, Taiwan, 472-473. https://doi.org/10.1109/icce-tw.2015.7217005
  5. De Leeuw R, de Soet A, van der Horst S, Walsh K, Westerman M, Scheele F. (2019). How We Evaluate Postgraduate Medical E-Learning: Systematic Review. JMIR Medical Education, 5(1), Article 13128. https://doi.org/10.2196/13128
  6. Firwana, A., Shouqer, M., & Aqel, M. (2021). Effectiveness of e-learning environments in developing skills for designing e-tivities based on gamification for teachers of technology in Gaza. Education in the Knowledge Society, 22, Article e23907. https://doi.org/10.14201/eks.23907
  7. Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: making sense of consensus. Practical Assessment, Research, and Evaluation, 12(10), 1-8. https://doi.org/10.7275/pdz9-th90
  8. Nurrahman, A. (2023). Developing the instrument of e-learning evaluation: Study at vocational school. Journal of Office Administration Education and Practice, 3(3), 163-174. https://doi.org/10.26740/joaep.v3n3.p163-174
  9. Karaksha, A., Grant, G., Nirthanan, S. N., Davey, A. K., & Anoopkumar-Dukie, S. (2014). A comparative study to evaluate the educational impact of e‐learning tools on Griffith University pharmacy students’ level of understanding using Bloom’s and SOLO taxonomies. Education Research International, 5, Article 934854. https://doi.org/10.1155%2F2014%2F934854
  10. Jafari, F., Azadi, H., Abdi, A., Salari, N., & Faraji, A. (2021). Cultural validation of the competence in evidence-based practice questionnaire (ebp-coq) for nursing students. Journal of Education and Health Promotion, 10(1), 464. https://doi.org/10.4103/jehp.jehp_1534_20
  11. Palvalin, M., Vuolle, M., Jääskeläinen, A., Laihonen, H., & Lönnqvist, A. (2015). Smartwow – constructing a tool for knowledge work performance analysis. International Journal of Productivity and Performance Management, 64(4), 479-498. https://doi.org/10.1108/IJPPM-06-2013-0122
  12. Palvalin, M. (2017). How to measure impacts of work environment changes on knowledge work productivity – validation and improvement of the SmartWow tool. Measuring Business Excellence, 21(2), 175-190. https://doi.org/10.1108/MBE-05-2016-0025
  13. Paz-Baruch, N. (2024). The role of gender and cognitive mechanisms in mathematical and reading performance. Educational Studies, 50(6), 1406-1423. https://doi.org/10.1080/03055698.2022.2091406
  14. Romero-Sacoto, L. A., Yambay-Bautista, X. R., Ramírez-Coronel, A. A., Andrade-Molina, M. C., Cordero-Zumba, N. B., & Magdalena-Sarmiento, M. (2021). Validation of the questionnaire of perception of the importance, usefulness and structure of the syllabus in microcurricular planning. Archivos Venezolanos de Farmacología y Terapéutica, 40(6), 596-604. https://doi.org/10.5281/zenodo.5557285
  15. Sierevelt, I., Zwiers, R., Schats, W., Haverkamp, D., Terwee, C., Nolte, P., … & Kerkhoffs, G. (2017). Measurement properties of the most commonly used foot- and ankle-specific questionnaires: The ffi, faos and faam. a systematic review. Knee Surgery Sports Traumatology Arthroscopy, 26(7), 2059-2073. https://doi.org/10.1007/s00167-017-4748-7
  16. Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4dfb.8dfd
  17. Van Nuland, S. E., Eagleson, R., & Rogers, K. A. (2017). Educational software usability: Artifact or Design? Anatomical Sciences Education, 10(2), 190-199. https://doi.org/10.1002/ase.1636
  18. Van Nuland, S. E., & Rogers, K. A. (2017). The skeletons in our closet: E‐learning tools and what happens when one side does not fit all. Anatomical Sciences Education, 10(6), 570-588. https://doi.org/10.1002/ase.1708
  19. Yandı, A., & Koç, N. (2023). Comparison of the methods of examining measurement equivalence under different conditions in terms of statistical power ratios. Bartın University Journal of Faculty of Education, 12(1), 146-166. https://doi.org/10.14686/buefad.996949

LICENSE

Creative Commons License
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.