# Processing embeddings with libSQL, Redpanda Kafka, and Mixedbread

DevFeed: [Processing embeddings with libSQL, Redpanda Kafka, and Mixedbread](<https://devfeed.tech/articles/processing-embeddings-with-libsql-redpanda-kafka-and-mixedbread-6023.md>)

Original publisher: [Read original article](<https://turso.tech/blog/processing-embeddings-with-libsql-redpanda-kafka-and-mixedbread>)

Author: Jamie Barton

Published: 2024-09-19T00:00:00Z

Content type: tutorial

Language: en

Sources: [Turso Blog](<https://devfeed.tech/sources/turso-blog.md>)

Topics: [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Kafka](<https://devfeed.tech/topics/kafka.md>), [Turso](<https://devfeed.tech/topics/turso.md>), [libSQL](<https://devfeed.tech/topics/libsql.md>), [API](<https://devfeed.tech/topics/api.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [SQLite](<https://devfeed.tech/topics/sqlite.md>), [Database](<https://devfeed.tech/topics/database.md>), [CRUD](<https://devfeed.tech/topics/crud.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [async](<https://devfeed.tech/tags/async.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [libsql](<https://devfeed.tech/tags/libsql.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [stream](<https://devfeed.tech/tags/stream.md>), [turso](<https://devfeed.tech/tags/turso.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

## AI overview

This tutorial explains how to build an asynchronous embedding pipeline with libSQL, Turso, Redpanda Kafka, and Mixedbread. It shows how to decouple embedding generation from an API or web application, stream database changes to Kafka, and store and query embeddings using Turso's native vector support.

## Source excerpt

Build an async embedding pipeline using libSQL, Redpanda Kafka, and Mixedbread. Offload embedding generation from your API and stream results into Turso.