# AI Inference now available in Supabase Edge Functions

DevFeed: [AI Inference now available in Supabase Edge Functions](<https://devfeed.tech/articles/ai-inference-now-available-in-supabase-edge-functions-299.md>)

Original publisher: [Read original article](<https://supabase.com/blog/ai-inference-now-available-in-supabase-edge-functions>)

Author: Lakshan Perera

Published: 2024-04-16T07:00:00Z

Content type: article

Language: en

Sources: [Supabase Blog](<https://devfeed.tech/sources/supabase-blog.md>)

Topics: [Supabase](<https://devfeed.tech/topics/supabase.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Ollama](<https://devfeed.tech/topics/ollama.md>), [transformers.js](<https://devfeed.tech/topics/transformers-js.md>), [wasm](<https://devfeed.tech/topics/wasm.md>), [Edge](<https://devfeed.tech/topics/edge.md>), [Rust](<https://devfeed.tech/topics/rust.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [cross-platform](<https://devfeed.tech/tags/cross-platform.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [onnx](<https://devfeed.tech/tags/onnx.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [transformers-js](<https://devfeed.tech/tags/transformers-js.md>), [wasm](<https://devfeed.tech/tags/wasm.md>)

## AI overview

Supabase Edge Functions now provide a built-in API for running AI inference workloads. The article explains embedding generation with pgvector, planned Large Language Model support through Ollama, and architectural improvements using ONNX Runtime through a native Rust extension to reduce cold-start overhead.

## Source excerpt

Use embeddings and large language models on the edge with Supabase Edge Functions.