Fine-Tuning LLMs for Reliable Medical Question-Answering Services

TL;DR

This study focuses on optimizing models like LLaMA-2 and Mistral, which have shown great promise in delivering precise, reliable medical answers, by leveraging comprehensive datasets and fine-tuning techniques such as rsDoRA+ and ReRAG.

Abstract

We present an advanced approach to medical question-answering (QA) services, using fine-tuned Large Language Models (LLMs) to improve the accuracy and reliability of healthcare information. Our study focuses on optimizing models like LLaMA-2 and Mistral, which have shown great promise in delivering precise, reliable medical answers. By leveraging comprehensive datasets, we applied fine-tuning techniques such as rsDoRA+ and ReRAG. rsDoRA+ enhances model performance through a combination of decomposed model weights, varied learning rates for low-rank matrices, and rank stabilization, leading to improved efficiency. ReRAG, which integrates retrieval on demand and question rewriting, further refines the accuracy of the responses. This approach enables healthcare providers to access fast, dependable information, aiding in more efficient decision-making and fostering greater patient trust. Our work highlights the potential of fine-tuned LLMs to significantly improve the quality and accessibility of medical information services, ultimately contributing to better healthcare outcomes for all.

Figures (10)

• Figure 1: Reparameterization of rsDoRA+.
• Figure 2: Structure of SelfRAG method.
• Figure 3: Structure of ReRAG method.
• Figure 4: Performance of LLaMA2 with Different $\alpha$ on the Flashcards
• Figure 5: Performance of LLaMA2 with Different $\alpha$ on the MediQA