# Hugging Face on AMD Instinct MI300 GPU

DevFeed: [Hugging Face on AMD Instinct MI300 GPU](<https://devfeed.tech/articles/hugging-face-on-amd-instinct-mi300-gpu-7245.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/huggingface-amd-mi300>)

Author: Félix Marty; Mohit Sharma; seungrok jung; Morgan Funtowicz

Published: 2024-05-21T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [tgi](<https://devfeed.tech/topics/tgi.md>), [Azure](<https://devfeed.tech/topics/azure.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [text-generation](<https://devfeed.tech/topics/text-generation.md>), [migration](<https://devfeed.tech/topics/migration.md>)

Tags: [ai-models](<https://devfeed.tech/tags/ai-models.md>), [amd](<https://devfeed.tech/tags/amd.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [azure](<https://devfeed.tech/tags/azure.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [instinct](<https://devfeed.tech/tags/instinct.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [migration](<https://devfeed.tech/tags/migration.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimum](<https://devfeed.tech/tags/optimum.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rocm](<https://devfeed.tech/tags/rocm.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

## AI overview

Hugging Face and AMD describe first-class integration for AMD Instinct MI300 GPU servers across the Hugging Face Platform. The article covers deployment from local development to Azure ND MI300x V5 VMs, compatibility with existing libraries and products, and CI/CD testing on managed Kubernetes infrastructure.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.