# TGI Multi-LoRA: Deploy Once, Serve 30 Models

DevFeed: [TGI Multi-LoRA: Deploy Once, Serve 30 Models](<https://devfeed.tech/articles/tgi-multi-lora-deploy-once-serve-30-models-7359.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/multi-lora-serving>)

Author: Derek Thomas; Diego Maniloff; David Holtz

Published: 2024-07-18T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [lora](<https://devfeed.tech/topics/lora.md>), [tgi](<https://devfeed.tech/topics/tgi.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>)

Tags: [cost](<https://devfeed.tech/tags/cost.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [guide](<https://devfeed.tech/tags/guide.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llm](<https://devfeed.tech/tags/llm.md>), [lora](<https://devfeed.tech/tags/lora.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [peft](<https://devfeed.tech/tags/peft.md>), [performance](<https://devfeed.tech/tags/performance.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [tgi](<https://devfeed.tech/tags/tgi.md>)

## AI overview

This article introduces TGI Multi-LoRA serving, a feature that allows organizations to deploy one base model and serve many specialized models. It explains how LoRA efficiently fine-tunes large pre-trained models by adding small adapter parameter sets, reducing storage and memory overhead while preserving model quality. The feature addresses the cost and operational complexity of deploying multiple fine-tuned Large Language Models.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.