# llamafile

A framework and single-file executable format for distributing and running open LLMs locally across multiple operating systems.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Structured Output with LangChain and Llamafile

DevFeed: [Structured Output with LangChain and Llamafile](<https://devfeed.tech/articles/structured-output-with-langchain-and-llamafile-25139.md>)

Original publisher: [Read original article](<https://blog.brakmic.com/structured-output-with-langchain-and-llamafile/>)

Author: brakmic

Published: 2025-06-22T16:50:12Z

Content type: tutorial

Language: en

Sources: [Harris Brakmic - Coding](<https://devfeed.tech/sources/harris-brakmic-coding.md>)

Topics: [LangChain](<https://devfeed.tech/topics/langchain.md>), [llamafile](<https://devfeed.tech/topics/llamafile.md>), [JSON](<https://devfeed.tech/topics/json.md>), [llama.cpp](<https://devfeed.tech/topics/llama-cpp.md>), [Parser](<https://devfeed.tech/topics/parser.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [cpp](<https://devfeed.tech/tags/cpp.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [import](<https://devfeed.tech/tags/import.md>), [json](<https://devfeed.tech/tags/json.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [llamafile](<https://devfeed.tech/tags/llamafile.md>), [llm](<https://devfeed.tech/tags/llm.md>), [local](<https://devfeed.tech/tags/local.md>), [local-llm](<https://devfeed.tech/tags/local-llm.md>), [models](<https://devfeed.tech/tags/models.md>), [properties](<https://devfeed.tech/tags/properties.md>), [python](<https://devfeed.tech/tags/python.md>), [structured-output](<https://devfeed.tech/tags/structured-output.md>)

### AI overview

A tutorial on using LangChain with Llamafile to produce structured JSON output from a local large language model. It uses JsonOutputParser, PromptTemplate, and a Pydantic model because Llamafile does not provide a with_structured_output method.

### Source excerpt

Learn how to extend Llamafile with LangChain's JsonParser to produce clean, structured JSON output

## Mozilla Llamafile in Supabase Edge Functions

DevFeed: [Mozilla Llamafile in Supabase Edge Functions](<https://devfeed.tech/articles/mozilla-llamafile-in-supabase-edge-functions-458.md>)

Original publisher: [Read original article](<https://supabase.com/blog/mozilla-llamafile-in-supabase-edge-functions>)

Author: Thor Schaeff

Published: 2024-08-21T07:00:00Z

Content type: tutorial

Language: en

Sources: [Supabase Blog](<https://devfeed.tech/sources/supabase-blog.md>)

Topics: [llamafile](<https://devfeed.tech/topics/llamafile.md>), [Supabase](<https://devfeed.tech/topics/supabase.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [API](<https://devfeed.tech/topics/api.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [fly.io](<https://devfeed.tech/topics/fly-io.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [api](<https://devfeed.tech/tags/api.md>), [cli](<https://devfeed.tech/tags/cli.md>), [docker](<https://devfeed.tech/tags/docker.md>), [fly-io](<https://devfeed.tech/tags/fly-io.md>), [llamafile](<https://devfeed.tech/tags/llamafile.md>), [llms](<https://devfeed.tech/tags/llms.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openai](<https://devfeed.tech/tags/openai.md>), [vs-code](<https://devfeed.tech/tags/vs-code.md>)

### AI overview

This tutorial explains how to run Mozilla Llamafile as an OpenAI API-compatible inference server with Supabase Edge Functions. It covers calling Llamafile through the functions-js interface or the OpenAI Deno SDK, serving functions locally with the Supabase CLI and Docker, and deploying Llamafile and Supabase Edge Functions.

### Source excerpt

Use Mozilla Llamafile OpenAI API compatible server in Supabase Edge Functions.