Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

HierLLM: Hierarchical Large Language Model for Question Recommendation

Yuxuan Liu, Haipeng Liu, Ting Long

TL;DR

HierLLM, a hierarchical large language model for question recommendation, which is a LLM-based hierarchical structure, enables HierLLM to tackle the cold start issue with the strong reasoning abilities of LLM.

Abstract

Question recommendation is a task that sequentially recommends questions for students to enhance their learning efficiency. That is, given the learning history and learning target of a student, a question recommender is supposed to select the question that will bring the most improvement for students. Previous methods typically model the question recommendation as a sequential decision-making problem, estimating students' learning state with the learning history, and feeding the learning state with the learning target to a neural network to select the recommended question from a question set. However, previous methods are faced with two challenges: (1) learning history is unavailable in the cold start scenario, which makes the recommender generate inappropriate recommendations; (2) the size of the question set is much large, which makes it difficult for the recommender to select the best question precisely. To address the challenges, we propose a method called hierarchical large language model for question recommendation (HierLLM), which is a LLM-based hierarchical structure. The LLM-based structure enables HierLLM to tackle the cold start issue with the strong reasoning abilities of LLM. The hierarchical structure takes advantage of the fact that the number of concepts is significantly smaller than the number of questions, narrowing the range of selectable questions by first identifying the relevant concept for the to-recommend question, and then selecting the recommended question based on that concept. This hierarchical structure reduces the difficulty of the recommendation.To investigate the performance of HierLLM, we conduct extensive experiments, and the results demonstrate the outstanding performance of HierLLM.

HierLLM: Hierarchical Large Language Model for Question Recommendation

TL;DR

HierLLM, a hierarchical large language model for question recommendation, which is a LLM-based hierarchical structure, enables HierLLM to tackle the cold start issue with the strong reasoning abilities of LLM.

Abstract

Question recommendation is a task that sequentially recommends questions for students to enhance their learning efficiency. That is, given the learning history and learning target of a student, a question recommender is supposed to select the question that will bring the most improvement for students. Previous methods typically model the question recommendation as a sequential decision-making problem, estimating students' learning state with the learning history, and feeding the learning state with the learning target to a neural network to select the recommended question from a question set. However, previous methods are faced with two challenges: (1) learning history is unavailable in the cold start scenario, which makes the recommender generate inappropriate recommendations; (2) the size of the question set is much large, which makes it difficult for the recommender to select the best question precisely. To address the challenges, we propose a method called hierarchical large language model for question recommendation (HierLLM), which is a LLM-based hierarchical structure. The LLM-based structure enables HierLLM to tackle the cold start issue with the strong reasoning abilities of LLM. The hierarchical structure takes advantage of the fact that the number of concepts is significantly smaller than the number of questions, narrowing the range of selectable questions by first identifying the relevant concept for the to-recommend question, and then selecting the recommended question based on that concept. This hierarchical structure reduces the difficulty of the recommendation.To investigate the performance of HierLLM, we conduct extensive experiments, and the results demonstrate the outstanding performance of HierLLM.
Paper Structure (29 sections, 21 equations, 5 figures, 4 tables)

This paper contains 29 sections, 21 equations, 5 figures, 4 tables.

Table of Contents

  1. Introduction
  2. Related Works
  3. Personalized Question Recommendation
  4. Application of LLM in Recommendations
  5. Preliminaries
  6. Terminology
  7. Problem formulation.
  8. Methodology
  9. Overview
  10. The Framework
  11. The High-level Module.
  12. The Low-level Module.
  13. The Encoder
  14. Optimization
  15. Experiment
  16. ...and 14 more sections

Figures (5)

  • Figure 1: Illustration of a recommender recommends questions based on learning history and learning targets.
  • Figure 2: The framework of HierLLM. HierLLM is a LLM-based hierarchical structure, which is composed of a high-level module and a low-level module (right side). The high-level module is responsible for recommending concept to narrow the recommendation space to a question candidate set, dereasing the difficulty of recommendation.The low-level module is responsible for selecting a question from the question candidate set.
  • Figure 3: Ablation Study
  • Figure 4: Further analysis.
  • Figure 5: Case Study