The relationship between students' e-skills competencies and the usability problems they experience when using a learning management system in an open distance learning environment

Abstract

Computer literacy or e-Skills is one of the recommended competencies for graduateness besides analytical, problem solving, writing, social awareness and responsibility skills. As Learning Management Systems become ubiquitous at universities around the world, electronic skills are increasingly becoming more important for students. Identifying usability problems experienced by students with varying e-Skills in an Open Distance Learning (ODL) higher education institution can contribute to an understanding of the learning challenges that students face. This research used a simulated, competence-based assessment to evaluate the e-Skills competencies of first year university students at a South African open distance learning university, the University of South Africa. Based on their performance in the assessment, students were categorised according to an e-Skills proficiency framework consisting of four levels: Digital Awareness, Digital Literacy, Digital Competence and Digital Expertise. The research then investigated the relationship between the usability problems experienced by participants with varying e-Skills competence levels when using a Learning Management System, and their e-Skills proficiency through usability testing and eye tracking. Eye tracking visualisations, heat maps and gaze plots, used with usability testing showed differences in the search patterns and the efficiency with which students with different e-Skills levels use the learning management system. Although more usability problems were encountered by students with lower levels of e-Skills proficiency, some usability problems were faced by students across all four levels. The study shows that it is necessary to consider the differences in learners’ digital proficiency levels when designing learning management systems in order to minimise usability problems. This is very critical in a distance learning environment where there is very little physical contact, if any, between the institution and the student.