Table of Contents
Fetching ...

Finding Sets of Pareto Sets in Real-World Scenarios -- A Multitask Multiobjective Perspective

Jiao Liu, Yew Soon Ong, Melvin Wong

Abstract

Recently, evolutionary multitasking has been employed to generate a ``set of Pareto sets" (SOS) for machine learning models, addressing diverse task settings across heterogeneous environments. This involves creating a repository of compact, specialized solution models that are collectively tailored to each specific task setting and environment, enabling users to select the most suitable model based on particular specifications and preferences. In this paper, we further demonstrate the versatility and applicability of the SOS concept across diverse domains, focusing on three real-world problems: engineering design problems, inventory management problems, and hyperparameter optimization problems. Additionally, as evolutionary multitasking has proven effective in generating the SOS, we investigate the performance of current evolutionary multitasking methods on these real-world problems. Subsequently, we present visualizations of the generated SOS in both decision and objective spaces, complemented by the development of a measurement to gauge the similarity between different Pareto sets corresponding to diverse tasks. Finally, we show that by systematically examining the shifts in Pareto optimal designs across different task settings though the SOS solutions, users can gain deeper understandings on the dynamic interplay between design solutions and their performance in different settings or contexts.

Finding Sets of Pareto Sets in Real-World Scenarios -- A Multitask Multiobjective Perspective

Abstract

Recently, evolutionary multitasking has been employed to generate a ``set of Pareto sets" (SOS) for machine learning models, addressing diverse task settings across heterogeneous environments. This involves creating a repository of compact, specialized solution models that are collectively tailored to each specific task setting and environment, enabling users to select the most suitable model based on particular specifications and preferences. In this paper, we further demonstrate the versatility and applicability of the SOS concept across diverse domains, focusing on three real-world problems: engineering design problems, inventory management problems, and hyperparameter optimization problems. Additionally, as evolutionary multitasking has proven effective in generating the SOS, we investigate the performance of current evolutionary multitasking methods on these real-world problems. Subsequently, we present visualizations of the generated SOS in both decision and objective spaces, complemented by the development of a measurement to gauge the similarity between different Pareto sets corresponding to diverse tasks. Finally, we show that by systematically examining the shifts in Pareto optimal designs across different task settings though the SOS solutions, users can gain deeper understandings on the dynamic interplay between design solutions and their performance in different settings or contexts.

Paper Structure

This paper contains 19 sections, 10 equations, 3 figures, 6 tables.

Figures (3)

  • Figure 1: The SOS shown in the decision space. All of the results are obtained by MO-MFEA. (a) The SOS of EO1. (b) The SOS of EO2. (c) The SOS of EO3. (d) The SOS of IM1. (e) The SOS of IM2. (f) The SOS of IM3. (g) The SOS of HPO.
  • Figure 2: The SOS shown in the objective space. All of the results are obtained by MO-MFEA. (a) The SOS of EO1. (b) The SOS of EO2. (c) The SOS of EO3. (d) The SOS of IM1. (e) The SOS of IM2. (f) The SOS of IM3. (g) The SOS of HPO.
  • Figure 3: The first two variables of the Pareto sets under $P=6000lb$, $P=7000lb$, and $P=8000lb$.