VAST: a practical validation framework for e-assessment solutions

The influx of technology in education has made it increasingly difficult to assess the validity of educational assessments. The field of information systems often ignores the social dimension during validation, whereas educational research neglects the technical dimensions of designed instruments. T...

Full description

Saved in:
Bibliographic Details
Published in:Information systems and e-business management 2023-09, Vol.21 (3), p.603-627
Main Authors: van Haastrecht, Max, Brinkhuis, Matthieu, Wools, Saskia, Spruit, Marco
Format: Article
Language:English
Subjects:
Bedrock
Business and Management
Cybersecurity
Education
Educational evaluation
Educational tests & measurements
Formative evaluation
Information systems
Information Systems Applications (incl.Internet)
IT in Business
Management
Original Article
Research methodology
Risk assessment
Social factors
Validity
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The influx of technology in education has made it increasingly difficult to assess the validity of educational assessments. The field of information systems often ignores the social dimension during validation, whereas educational research neglects the technical dimensions of designed instruments. The inseparability of social and technical elements forms the bedrock of socio-technical systems. Therefore, the current lack of validation approaches that address both dimensions is a significant gap. We address this gap by introducing VAST: a validation framework for e-assessment solutions. Examples of such solutions are technology-enhanced learning systems and e-health applications. Using multi-grounded action research as our methodology, we investigate how we can synthesise existing knowledge from information systems and educational measurement to construct our validation framework. We develop an extensive user guideline complementing our framework and find through expert interviews that VAST facilitates a comprehensive, practical approach to validating e-assessment solutions.
ISSN:1617-9846
1617-9854
DOI:10.1007/s10257-023-00641-3