The ISC Creator: Human-Centered Design of Learning Analytics Interactive Indicator Specification Cards
Shoeb Joarder, Mohamed Amine Chatti
TL;DR
The ISC Creator addresses the gap in end-user aligned learning analytics by offering a human-centered, interactive tool for co-designing indicators through Indicator Specification Cards. Built via iterative observation, ideation, prototyping, and testing, and supported by three flexible design approaches (task-, data-, visualization-driven), it demonstrates enhanced usability and acceptance among non-experts in learning analytics. A TAM-based qualitative evaluation with 10 stakeholders shows positive usefulness, ease of use, and satisfaction, while highlighting areas for improvement in customization, export, and data privacy. The work provides practical guidance for designing interactive, user-centered LA tools and sets the stage for quantitative validation of its impact on adoption and trust in LA dashboards.
Abstract
Emerging research on human-centered learning analytics (HCLA) has demonstrated the importance of involving diverse stakeholders in co-designing learning analytics (LA) systems. However, there is still a demand for effective and efficient methods to co-design LA dashboards and indicators. Indicator Specification Cards (ISCs) have been introduced recently to facilitate the systematic co-design of indicators by different LA stakeholders. In this paper, we strive to enhance the user experience and usefulness of the ISC-based indicator design process. Towards this end, we present the systematic design, implementation, and evaluation details of the ISC Creator, an interactive LA tool that allows low-cost and flexible design of LA indicators. Our findings demonstrate the importance of carefully considered interactivity and recommendations for orienting and supporting non-expert LA stakeholders to design custom LA indicators.