# distilabel

Distilabel is a framework for synthetic data and AI-feedback pipelines, installable with pip and designed for engineers.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Introducing the Synthetic Data Generator - Build Datasets with Natural Language

DevFeed: [Introducing the Synthetic Data Generator - Build Datasets with Natural Language](<https://devfeed.tech/articles/introducing-the-synthetic-data-generator-build-datasets-with-natural-language-7497.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/synthetic-data-generator>)

Author: David Berenstein; Sara Han Díaz; Leire Aguirre; Daniel Vila; Ame Vi; ben burtenshaw

Published: 2024-12-16T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [synthetic-data](<https://devfeed.tech/topics/synthetic-data.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [argilla](<https://devfeed.tech/topics/argilla.md>), [distilabel](<https://devfeed.tech/topics/distilabel.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [API](<https://devfeed.tech/topics/api.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [argilla](<https://devfeed.tech/tags/argilla.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [distilabel](<https://devfeed.tech/tags/distilabel.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [llm](<https://devfeed.tech/tags/llm.md>), [rag](<https://devfeed.tech/tags/rag.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>)

### AI overview

Hugging Face introduces a Synthetic Data Generator that creates text classification and chat datasets from natural-language descriptions. The tool uses distilabel and the Hugging Face text-generation API, supports configurable models and providers, and can upload generated datasets after authentication.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Open Preference Dataset for Text-to-Image Generation by the 🤗 Community

DevFeed: [Open Preference Dataset for Text-to-Image Generation by the 🤗 Community](<https://devfeed.tech/articles/open-preference-dataset-for-text-to-image-generation-by-the-community-7274.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/image-preferences>)

Author: David Berenstein; ben burtenshaw; Daniel Vila; Daniel van Strien; Sayak Paul; Ame Vi; Linoy Tsaban

Published: 2024-12-09T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [flux](<https://devfeed.tech/topics/flux.md>), [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>), [argilla](<https://devfeed.tech/topics/argilla.md>), [distilabel](<https://devfeed.tech/topics/distilabel.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>)

Tags: [argilla](<https://devfeed.tech/tags/argilla.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [data](<https://devfeed.tech/tags/data.md>), [data-is-better-together](<https://devfeed.tech/tags/data-is-better-together.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [distilabel](<https://devfeed.tech/tags/distilabel.md>), [flux](<https://devfeed.tech/tags/flux.md>), [generation](<https://devfeed.tech/tags/generation.md>), [github](<https://devfeed.tech/tags/github.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [image](<https://devfeed.tech/tags/image.md>), [open](<https://devfeed.tech/tags/open.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [stable-diffusion](<https://devfeed.tech/tags/stable-diffusion.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [synthetic-data-generation](<https://devfeed.tech/tags/synthetic-data-generation.md>), [text-to-image](<https://devfeed.tech/tags/text-to-image.md>)

### AI overview

The article describes an open community effort to create an image-preference dataset for text-to-image generation. It covers prompt preparation with distilabel, synthetic data generation, image generation with Flux and Stable Diffusion, and filtering with text- and image-based classifiers plus manual review. The resulting dataset and related code are available through the Hugging Face Hub and GitHub.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## How we leveraged distilabel to create an Argilla 2.0 Chatbot

DevFeed: [How we leveraged distilabel to create an Argilla 2.0 Chatbot](<https://devfeed.tech/articles/how-we-leveraged-distilabel-to-create-an-argilla-2-0-chatbot-7101.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/argilla-chatbot>)

Author: Agustín Piqueres Lajarín; Gabriel Martín Blázquez; Sara Han Díaz; Omar Sanseviero; Daniel Vila

Published: 2024-07-16T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [argilla](<https://devfeed.tech/topics/argilla.md>), [Chat Bot](<https://devfeed.tech/topics/chatbot.md>), [distilabel](<https://devfeed.tech/topics/distilabel.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Documentation](<https://devfeed.tech/topics/documentation.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [Markdown](<https://devfeed.tech/topics/markdown.md>), [Python](<https://devfeed.tech/topics/python.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [GitHub](<https://devfeed.tech/topics/github.md>)

Tags: [apps](<https://devfeed.tech/tags/apps.md>), [argilla](<https://devfeed.tech/tags/argilla.md>), [chat](<https://devfeed.tech/tags/chat.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [distilabel](<https://devfeed.tech/tags/distilabel.md>), [docs](<https://devfeed.tech/tags/docs.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [github](<https://devfeed.tech/tags/github.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [libraries](<https://devfeed.tech/tags/libraries.md>), [markdown](<https://devfeed.tech/tags/markdown.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [python](<https://devfeed.tech/tags/python.md>), [rag](<https://devfeed.tech/tags/rag.md>), [spaces](<https://devfeed.tech/tags/spaces.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>)

### AI overview

A tutorial on building a Chatbot for Argilla 2.0 that answers questions about technical documentation. It uses distilabel to create a synthetic dataset, fine-tunes a domain-specific embedding model, stores documentation in a vector database for retrieval, and deploys the Chatbot to a Hugging Face Space for interaction and continuous evaluation.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.