Towards a Domain-Specific Modelling Environment for Reinforcement Learning

TL;DR

This paper targeted reinforcement learning from the machine learning domain, and evaluated the proposed language, reinforcement learning modelling language (RLML), with multiple applications, and proposed model-driven engineering (MDE) methods and tools for developing a domain-specific modelling environment.

Abstract

In recent years, machine learning technologies have gained immense popularity and are being used in a wide range of domains. However, due to the complexity associated with machine learning algorithms, it is a challenge to make it user-friendly, easy to understand and apply. Machine learning applications are especially challenging for users who do not have proficiency in this area. In this paper, we use model-driven engineering (MDE) methods and tools for developing a domain-specific modelling environment to contribute towards providing a solution for this problem. We targeted reinforcement learning from the machine learning domain, and evaluated the proposed language, reinforcement learning modelling language (RLML), with multiple applications. The tool supports syntax-directed editing, constraint checking, and automatic generation of code from RLML models. The environment also provides support for comparing results generated with multiple RL algorithms. With our proposed MDE approach, we were able to help in abstracting reinforcement learning technologies and improve the learning curve for RL users.

Figures (13)

• Figure 1: Reinforcement Learning (RL) Classification (Adapted from Brunton2019)
• Figure 2: RLML Metamodel
• Figure 3: RLML Environment: Code Completion
• Figure 4: Sample RLML Model
• Figure 7: Path Finding Environment