# Introduction to ggml

DevFeed: [Introduction to ggml](<https://devfeed.tech/articles/introduction-to-ggml-7294.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/introduction-to-ggml>)

Author: Xuan-Son Nguyen; Georgi Gerganov; slaren

Published: 2024-08-13T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [ggml](<https://devfeed.tech/topics/ggml.md>), [Programming](<https://devfeed.tech/topics/programming.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [compression](<https://devfeed.tech/tags/compression.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [ggml](<https://devfeed.tech/tags/ggml.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [programming](<https://devfeed.tech/tags/programming.md>), [whisper](<https://devfeed.tech/tags/whisper.md>)

## AI overview

An introductory developer tutorial on ggml, a low-level library for efficient tensor computation. It explains ggml's minimalism, compilation requirements, small binary size, hardware compatibility, quantized tensors, memory efficiency, limitations, and fundamental concepts, including how to compile it on Ubuntu.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.