Edinburgh Research Archive >
Moray House School of Education >
Moray House PhD thesis collection >
Please use this identifier to cite or link to this item:
|Title: ||From learning to e-learning: mining educational data. A novel, data-driven approach to evaluate individual differences in students’ interaction with learning technology|
|Authors: ||Vigentini, Lorenzo|
|Supervisor(s): ||Macleod, Hamish|
|Issue Date: ||25-Nov-2010|
|Publisher: ||The University of Edinburgh|
|Abstract: ||In recent years, learning technology has become a very important addition to the toolkit of
instructors at any level of education and training. Not only offered as a substitute in distance
education, but often complementing traditional delivery methods, e-learning is considered an
important component of modern pedagogy. Particularly in the last decade, learning technology has
seen a very rapid growth following the large-scale development and deployment of e-learning
financed by both Governments and commercial enterprises. These turned e-learning into one of the
most profitable sectors of the new century, especially in recession times when education and retraining
have become even more important and a need to maximise resources is forced by the need
Interestingly, however, evaluation of e-learning has been primarily based on the consideration of
users’ satisfaction and usability metrics (i.e. system engineering perspective) or on the outcomes of
learning (i.e. gains in grades/task performance). Both of these are too narrow to provide a reliable
effect of the real impact of learning technology on the learning processes and lead to inconsistent
The key purpose of this thesis is to propose a novel, data-driven framework and methodology to
understand the effect of e-learning by evaluating the utility and effectiveness of e-learning systems
in the context of higher education, and specifically, in the teaching of psychology courses. The
concept of learning is limited to its relevance for students’ learning in courses taught using a
mixture of traditional methods and online tools tailored to enhance teaching. The scope of elearning
is intended in a blended method of delivery of teaching.
A large sample of over 2000 students taking psychology courses in year 1 and year 2 was
considered over a span of 5 five years, also providing the scope for the analysis of some
The analysis is accomplished using a psychologically grounded approach to evaluation, partially
informed by a cognitive/ behavioural perspective (online usage) and a differential perspective
(measures of cognitive and learning styles). Relations between behaviours, styles and academic
performance are also considered, giving an insight and a direct comparison with existing literature. The methodology adopted draws heavily from data mining techniques to provide a rich
characterisation of students/users in this particular context from the combination of three types of
metrics: cognitive and learning styles, online usage and academic performance.
Four different instruments are used to characterise styles: ASSIST (Approaches to learning,
Entwistle), CSI (Cognitive Styles Inventory, Allinson & Hayes), TSI (Thinking Styles Inventory
and the mental self-government theory, Sternberg) and VICS-WA (Verbal/Imager and
Wholistc/Analytic Cognitive style, Riding, Peterson) which were intentionally selected to provide a
varied set of tools.
Online usage, spanning over the entire academic year for each student, is analysed applying web
usage mining (WUM) techniques and is observed through different layers of interpretation
accounting for behaviours from the single clicks to a student’s intentions in a single session.
Academic performance was collated from the students’ records giving an insight in the end-of-year
grades, but also into specific coursework submissions during the whole academic year allowing for
a temporal matching of online use and assessment.
The varied metrics used and data mining techniques applied provide a novel evaluation framework
based on a rich profile of the learner, which in turn offers a valuable alternative to regression
methods as a mean to interpret relations between metrics. Patterns emerging from styles and the
way online material is used over time, proved to be valuable in discriminating differences in
academic performance and useful in this context to identify significant group differences in both
usage and academic performance.
As a result, the understanding of the relations between e-learning usage, styles and academic
performance has important practical implications to enhance students’ learning experience, in the
automation of learning systems and to inform policymakers of the effects of learning technology
has from a user and learner-centred approach to learning and studying.
The success of the application of data mining methods offers an excellent starting point to explore
further a data-driven approach to evaluation, support informed design processes of e-learning and
to deliver suitable interventions to ensure better learning outcomes and provide an efficient system
for institutions and organization to maximise the impact of learning technology for teaching and
|Appears in Collections:||Moray House PhD thesis collection|
Items in ERA are protected by copyright, with all rights reserved, unless otherwise indicated.