Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

To be FAIR or RIGHT? Methodological [R]esearch [I]ntegrity [G]iven [H]uman-facing [T]echnologies using the example of Learning Technologies

Julian Dehne

Abstract

Quality assessment of Research Software Engineering (RSE) plays an important role in all scientific fields. From the canonical three criteria (reliability, validity, and objectivity) previous research has focussed on reliability and the FAIR principles. The RIGHT framework is introduced to fill the gap of existing frameworks for the validity aspect. The framework is constructed using the methods of theory transfer and process modelling. It is based on existing models of simulation research, design-based research, software engineering and empirical social sciences. The paper concludes with two case studies drawn from the field of learning technologies to illustrate the practical relevance of the framework for human-facing RSE.

To be FAIR or RIGHT? Methodological [R]esearch [I]ntegrity [G]iven [H]uman-facing [T]echnologies using the example of Learning Technologies

Abstract

Quality assessment of Research Software Engineering (RSE) plays an important role in all scientific fields. From the canonical three criteria (reliability, validity, and objectivity) previous research has focussed on reliability and the FAIR principles. The RIGHT framework is introduced to fill the gap of existing frameworks for the validity aspect. The framework is constructed using the methods of theory transfer and process modelling. It is based on existing models of simulation research, design-based research, software engineering and empirical social sciences. The paper concludes with two case studies drawn from the field of learning technologies to illustrate the practical relevance of the framework for human-facing RSE.
Paper Structure (22 sections, 6 equations, 6 figures, 1 table)

This paper contains 22 sections, 6 equations, 6 figures, 1 table.

Table of Contents

  1. Introduction
  2. Related Work
  3. Definitions
  4. Unit of Analysis
  5. Definition of (Research) Software
  6. Definition of Research (Software)
  7. Definition of (Research Software) Engineering
  8. Quality Criteria for Research (Software)
  9. Related Process Models
  10. Simulation
  11. Design-based Research
  12. Software Engineering
  13. Empirical Research (Social Sciences)
  14. A Model for Research Software Development with Humans-In-The-Loop
  15. Case 1: Research software influences relationships between variables.
  16. ...and 7 more sections

Figures (6)

  • Figure 1: The logic of simulation as a method. Diagram designed by drogoulMultiagentBasedSimulation2003
  • Figure 2: The logic of design-based research as a method. Diagram and process model adapted from reinmann2005innovation
  • Figure 3: The research process in the empirical social sciences based on schnell1999methoden
  • Figure 4: Case 1 (App). Variables: $RS$ (app), $U$ (traits), $T$ (training), $Y$ (outcome).
  • Figure 5: Case 2 (Grouping). Variables: $RS$ (algorithm), $X$ (composition), $A$ (assignment), $G$ (dynamics), $Y'$ (outcome), $U$ (traits).
  • ...and 1 more figures