# format Published articles for format. This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## Выпуск Rust Coreutils 0.12.0 DevFeed: [Выпуск Rust Coreutils 0.12.0]() Original publisher: [Read original article]() Author: denis-19 Published: 2026-09-18T03:41:44Z Content type: news Language: ru Sources: [Tagir Valeev]() Topics: [Rust](), [WebAssembly](), [Linux](), [Ubuntu]() Tags: [2026](), [c](), [cat](), [chmod](), [d](), [env-file-security](), [format](), [gnu](), [interface](), [join](), [linux](), [ls](), [rust](), [rust-coreutils](), [rust-coreutils-0-12-0](), [sort](), [stat](), [ubuntu](), [wasi](), [webassembly]() ### AI overview A Russian news report covers the release of Rust Coreutils 0.12.0, an MIT-licensed Rust implementation of GNU Coreutils. It describes platform support, Ubuntu adoption, test compatibility, WebAssembly and WASI improvements, performance and safety work, and fixes across several utilities. ### Source excerpt 17 сентября 2026 года состоялся релиз открытого проекта Rust Coreutils 0.12.0 (uutils), развивающего аналог пакета GNU Coreutils, написанный на языке Rust. В состав coreutils входит более сотни утилит, включая wc, ls, tail, se, sort, cat, chmod, chown, chroot, cp, date, dd, du, install, echo, hostname, id, ln, ls и многие другие. Читать далее ## Preparing Codename One for Android 17 and API 37 Migration DevFeed: [Preparing Codename One for Android 17 and API 37 Migration]() Original publisher: [Read original article]() Author: Shai Almog Published: 2026-09-17T00:00:00Z Content type: article Language: en Sources: [CodeName One]() Topics: [Android](), [migration](), [Security](), [format]() Tags: [android](), [apis](), [format](), [migration](), [security]() ### AI overview Codename One prepares for Android 17 and API 37 by adding platform compatibility checks, fixing API-level parsing and build-tool handling, and testing a new system-rendered location button. The article also describes moving PEM parsing and task removal into shared security-sensitive platform handling. ### Source excerpt API 37 checks and a system location button prepare Android migration. PEM parsing and task-clearing exit put more security-sensitive platform and format handling into Codename One. ## Video Streaming Protocols: 6 Preferred Formats for Professional Broadcasting DevFeed: [Video Streaming Protocols: 6 Preferred Formats for Professional Broadcasting]() Original publisher: [Read original article]() Author: Jon Whitehead Published: 2026-09-02T09:35:50Z Content type: tutorial Language: en Sources: [DaCast]() Topics: [Streaming](), [Protocol (disambiguation)](), [Latency](), [Low Latency](), [WebRTC](), [Playback](), [format](), [data]() Tags: [data](), [format](), [latency](), [low-latency](), [playback](), [protocols](), [streaming](), [the-video-experts-blog](), [video](), [video-streaming](), [webrtc]() ### AI overview This guide explains six video streaming protocols used in professional broadcasting: HLS, RTMP, WebRTC, SRT, RTSP, and MPEG-DASH. It compares their purposes, strengths, limitations, latency, compatibility, and suitable use cases. It presents HLS as a broadly compatible delivery default, RTMP as an ingest standard, WebRTC for real-time two-way interaction, SRT for one-way broadcasting over unreliable networks, RTSP for surveillance and IoT, and MPEG-DASH as an open alternative with limited Apple support. ### Source excerpt By Dacast Editorial Team | Reviewed by Jon Whitehead, COO at Dacast | Updated September 2026 A video streaming protocol is the set of rules that governs how video data moves from your encoder to your streaming host to the video player your audience watches on. Common examples include RTMP, HLS, WebRTC, and SRT, each [...] The post Video Streaming Protocols: 6 Preferred Formats for Professional Broadcasting appeared first on Dacast. ## C++29 -- начало. Встреча ISO C++ в Брно DevFeed: [C++29 -- начало. Встреча ISO C++ в Брно]() Original publisher: [Read original article]() Author: antoshkka (Яндекс) Published: 2026-08-17T07:01:31Z Content type: article Language: ru Sources: [Яндекс - Как мы делаем Яндекс / Статьи]() Topics: [C++](), [floating-point](), [implementation]() Tags: [c-plus-plus](), [c-plus-plus-29](), [floating-point](), [fmt](), [format](), [implementation](), [iso](), [standard](), [standard-library](), [tagged-pointers](), [thread](), [threads](), [undefined-behavior](), [undefined-behaviour]() ### AI overview A report on the ISO C++ committee meeting in Brno, where work on C++29 began. It describes plans to organize and clarify documented undefined behavior and ill-formed-no-diagnostic-required cases, along with changes involving constexpr floating-point evaluation and other language rules. ### Source excerpt Привет! На связи Антон Полухин из Техплатформы Городских сервисов Яндекса. Недавно в Брно состоялась встреча международного комитета по стандартизации языка программирования C++, в которой я принимал активное участие. В этот раз началась работа над C++29 и как раз о новинках и хочется рассказать. Читать далее ## An Update on the FreeBSD Journal: New Editor, New Format DevFeed: [An Update on the FreeBSD Journal: New Editor, New Format]() Original publisher: [Read original article]() Author: Florine Kamdem Published: 2026-07-29T20:16:39Z Content type: news Language: en Sources: [FreeBSD Foundation]() Topics: [Computing](), [browser](), [Website](), [pdf]() Tags: [blog](), [browser](), [editor](), [format](), [freebsd](), [pdf](), [software](), [update](), [website]() ### AI overview The FreeBSD Journal has appointed Matt Slaybaugh as its new editor and is moving to a browser-based-only format without downloadable PDFs. The journal will remain quarterly, free, and guided by its editorial and advisory boards. ### Source excerpt We have a couple of updates to share about the FreeBSD Journal. A New Editor Please join us in welcoming Matt Slaybaugh as the Journal's new editor. Matt brings years of editorial and content management experience, including his ongoing work with the Association for Computing Machinery (ACM), and he's already hard at work on upcoming [...] The post An Update on the FreeBSD Journal: New Editor, New Format first appeared on FreeBSD Foundation. ## RFC 9850: The SSLKEYLOGFILE Format for TLS DevFeed: [RFC 9850: The SSLKEYLOGFILE Format for TLS]() Original publisher: [Read original article]() Published: 2026-07-16T00:00:00Z Content type: article Language: fr Sources: [Blog de Stéphane Bortzmeyer]() Topics: [TLS (Transport Layer Security)](), [Internet Engineering Task Force (IETF)](), [ASCII](), [SSL]() Tags: [ascii](), [communication](), [format](), [rfc](), [ssl](), [tls](), [wireshark]() ### AI overview This French article explains RFC 9850, which specifies the SSLKEYLOGFILE format for exporting TLS session secrets so packet analyzers such as Wireshark can decrypt and inspect network communication. It notes that the legacy name refers to SSL even though the format is used with TLS, and describes the file's text-based structure. ### Source excerpt Déboguer une application réseau qui utilise le chiffrement est difficile. Le but du chiffrement est justement d'empêcher un tiers (par exemple l'analyseur de paquets) de regarder ce qui se passe. Une approche possible est de demander gentiment à l'application d'exporter ses clés de chiffrement dans un fichier que l'analyseur pourra importer pour ensuite déchiffrer la communication. Ce RFC décrit le format le plus répandu pour exporter ses clés, connu sous le nom de SSLKEYLOGFILE et très commun aujourd'hui. ## Exposition sur l'histoire du CD-ROM et conférence Technostalgia DevFeed: [Exposition sur l'histoire du CD-ROM et conférence Technostalgia]() Original publisher: [Read original article]() Published: 2026-07-03T00:00:00Z Content type: article Language: fr Sources: [Blog de Stéphane Bortzmeyer]() Topics: [CD (Disambiguation)](), [format](), [gif](), [Windows](), [pc](), [simulator]() Tags: [2026](), [article](), [cd](), [events](), [format](), [gif](), [images](), [internet](), [pc](), [simulator](), [windows]() ### AI overview A French report covers a 2026 Luxembourg exhibition on CD-ROM history and the Technostalgia conference. It discusses period software on Windows 95 and 98, GIF history, MS-DOS emulation, and the challenges of recreating older computing experiences. ### Source excerpt Du 18 au 20 juin 2026, à Luxembourg, se tenait une exposition scientifique sur l'histoire du CD-ROM et la conférence Technostalgia (https://www.uni.lu/c2dh-en/events/technostalgia/). ## Metal Default, A New Build Cloud, And A New Format DevFeed: [Metal Default, A New Build Cloud, And A New Format]() Original publisher: [Read original article]() Author: Shai Almog Published: 2026-05-29T00:00:00Z Content type: release Language: en Sources: [CodeName One]() Topics: [iOS](), [Cloud](), [dashboards](), [GPU](), [ui]() Tags: [cloud](), [console](), [format](), [gpu](), [ios](), [release]() ### AI overview This release post announces that Metal is now the default renderer for iOS builds, the new Build Cloud console is linked from site dashboards, and weekly release posts will use a shorter index format with separate follow-up articles. ### Source excerpt The iOS Metal renderer is now the default, the new Build Cloud console is wired into every Dashboard link on the site, and the weekly release blog is moving to a shorter format with deeper follow-up posts during the week. ## RFC 9982: JSContact Version 2.0: A JSON Representation of Contact Data DevFeed: [RFC 9982: JSContact Version 2.0: A JSON Representation of Contact Data]() Original publisher: [Read original article]() Published: 2026-05-28T00:00:00Z Content type: article Language: fr Sources: [Blog de Stéphane Bortzmeyer]() Topics: [JSON](), [format](), [version](), [Internet Engineering Task Force (IETF)](), [identifier](), [object]() Tags: [2026](), [article](), [format](), [identifier](), [ietf](), [json](), [rfc](), [version]() ### AI overview This article explains JSContact Version 2.0, a JSON format for representing contact entities. The only change from version 1 is that the previously mandatory uid member is now optional, but that backward-incompatible change requires a new format version. ### Source excerpt Voici la version 2 du format de représentation d'entités (personnes ou organisations) JSContact (RFC 9553). En fait, ce numéro de version est trompeur, il n'y a qu'un seul changement, le membre "uid" qui était obligatoire devient facultatif. Mais ce petit changement, qui casse la compatibilité, oblige à changer de numéro de version. ## Clear Signing: Making Transaction Approvals Safer on Ethereum DevFeed: [Clear Signing: Making Transaction Approvals Safer on Ethereum]() Original publisher: [Read original article]() Author: Hester Bruikman Published: 2026-05-12T00:00:00Z Content type: release Language: en Sources: [Ethereum Foundation Blog]() Topics: [Ethereum](), [Security](), [Blockchain](), [App]() Tags: [blockchain](), [developers](), [ethereum](), [format](), [security](), [signing](), [standard]() ### AI overview An Ethereum Working Group has launched Clear Signing, an open standard intended to help wallets present human-readable, structured descriptions of transaction effects. The approach includes ERC-7730, a descriptor registry, verification through independent reviews and attestations, and tools for wallet and developer adoption. ### Source excerpt An Ethereum Working Group consisting of wallet developers, security firms and the Ethereum Foundation's Trillion Dollar Security Initiative today launched an open standard designed to end blind signing -- a structural flaw that has contributed to billions in user losses, including the Bybit hack. Ethereum Foundation's Trillion Dollar Security Initiative... ## View Operational Insights Within the GraphOS Platform API DevFeed: [View Operational Insights Within the GraphOS Platform API]() Original publisher: [Read original article]() Author: Nick Marsh Published: 2026-04-13T13:34:36Z Content type: tutorial Language: en Sources: [Apollo Blog]() Topics: [GraphOS](), [Platform API](), [GraphQL](), [Data analysis](), [Latency]() Tags: [analysis](), [engineering](), [format](), [graphos](), [graphql](), [latency](), [monitoring](), [platform-api]() ### AI overview The article explains how to use the GraphOS Platform API to analyze GraphQL usage and performance. It covers point-in-time operation reports and time-series insights for operations, subgraphs, and fields, including metrics such as request counts, latency percentiles, and error rates. ### Source excerpt Query GraphQL usage with the GraphOS Platform API: point-in-time operation reports plus timeseries data for operations, subgraphs, and fields. ## Understanding Parquet Format for beginners DevFeed: [Understanding Parquet Format for beginners]() Original publisher: [Read original article]() Author: Zach Wilson Published: 2026-03-03T21:52:56Z Content type: tutorial Language: en Sources: [DataExpert.io Newsletter]() Topics: [parquet]() Tags: [beginners](), [format](), [parquet]() ### AI overview A beginner-oriented walkthrough of the Parquet file format. ### Source excerpt A walk through of the most important file format to ever exist ## Local LLM Inference : llama.cpp, GGUF, Quantizations and GGML Explained DevFeed: [Local LLM Inference : llama.cpp, GGUF, Quantizations and GGML Explained]() Original publisher: [Read original article]() Author: Alex Razvant Published: 2026-03-03T11:31:04Z Content type: tutorial Language: en Sources: [Neural Bits]() Topics: [llama.cpp](), [ggml](), [Inference](), [Large Language Model](), [Local AI](), [quantization]() Tags: [backend](), [cross-platform](), [efficiently](), [embedded](), [format](), [ggml](), [inference](), [llama-cpp](), [llm](), [local-llm](), [model]() ### AI overview A practical guide to local LLM inference with llama.cpp, explaining how the GGUF model format, GGML backend concepts, quantization, and inference workflows fit together for efficient execution on edge devices. ### Source excerpt Learn how the llama.cpp runtime, GGML backend concepts, and GGUF model format fit together for fast local inference across devices. ## Crafting a Perfect Product Catalog DevFeed: [Crafting a Perfect Product Catalog]() Original publisher: [Read original article]() Author: Shashank Khatri Published: 2026-01-29T11:33:26Z Content type: article Language: en Sources: [Bazaarvoice]() Topics: [data](), [clients](), [trust](), [navigation]() Tags: [apis](), [categories](), [conversations-api](), [data](), [file](), [format](), [ids](), [integration](), [navigation](), [product](), [product-catalog](), [reviews](), [source-of-truth](), [ugc]() ### AI overview This Bazaarvoice post presents best practices for maintaining product catalogs used to manage and display user-generated content such as ratings and reviews. It covers precise product names, consistent category information, and naming conventions for product and category identifiers to support integration, content submission, navigation, and accurate review associations. ### Source excerpt Your product catalog is the definitive source of truth for your online presence, especially when managing User-Generated Content (UGC) like ratings and reviews. For Bazaarvoice clients, a meticulously maintained catalog is vital for seamless integration and flawless display. This post explores three key best practices--from precise product naming and consistent category data to optimal naming conventions--that will unlock the full potential of your UGC program, drive trust, and boost conversions. ## How to use Vertex AI Prompt Optimizer with ground truth data DevFeed: [How to use Vertex AI Prompt Optimizer with ground truth data]() Original publisher: [Read original article]() Author: Alexander Nohe; Elena Erbiceanu Tener Published: 2026-01-20T00:00:00Z Content type: tutorial Language: en Sources: [Firebase Blog]() Topics: [Prompt Engineering](), [Artificial Intelligence](), [Ground truth / benchmark quality](), [Google](), [CSV](), [data](), [Firebase]() Tags: [ai](), [cloud-storage](), [data](), [evaluation](), [firebase](), [format](), [gemini](), [google](), [google-cloud](), [how-to](), [learn](), [quality](), [vertex](), [vertex-ai]() ### AI overview This tutorial explains how to use Vertex AI Prompt Optimizer with ground truth data to iteratively tune prompts and evaluate output quality. It describes preparing scripts and target descriptions in a Google Sheet, exporting the data as CSV, uploading it to Google Cloud Storage, and configuring optimization in a Colab Enterprise notebook. ### Source excerpt Learn how to use the Vertex AI Prompt Optimizer to automatically tune your prompts to get better results by iterating on your prompts and then running an evaluation on the outputs assessing their quality to see if it has improved. ## ClickHouse Release 25.8 DevFeed: [ClickHouse Release 25.8]() Original publisher: [Read original article]() Author: ClickHouse Published: 2025-09-05T00:00:00Z Content type: release Language: en Sources: [ClickHouse Blog]() Topics: [clickhouse](), [parquet](), [Flight](), [Apache Iceberg]() Tags: [apache-arrow](), [bug](), [bug-fixes](), [clickhouse](), [data](), [data-lake](), [features](), [files](), [format](), [integration](), [new-features](), [parallelism](), [parquet](), [partitioning](), [performance](), [release](), [storage](), [streaming]() ### AI overview ClickHouse 25.8 introduces 45 new features, 47 performance optimizations, and 119 bug fixes. Highlights include a faster experimental native Parquet reader, Data Lake improvements, Hive-style partitioned writes, initial PromQL support, and Arrow Flight integration. ### Source excerpt ClickHouse 25.8 is available. In this post, you will learn about new features, including a new Parquet reader and Arrow Flight integration. ## Introduction to ESP FOURCC DevFeed: [Introduction to ESP FOURCC]() Original publisher: [Read original article]() Author: John Lee Published: 2025-04-24T00:00:00Z Content type: article Language: en Sources: [Blog on Developer Portal]() Topics: [Embedded Systems](), [Espressif](), [Embedded Software Dev](), [Open Source]() Tags: [article](), [blog](), [embedded](), [embedded-systems](), [esp-gmf](), [espressif](), [format](), [identifier](), [implementation](), [multimedia](), [open-source](), [standard]() ### AI overview This article explains ESP FOURCC, Espressif's standardized 32-bit identifier for multimedia formats. It describes the standard's implementation in ESP-GMF and its use for audio, video, image, container, and pixel formats, with the stated benefits of consistent format identification, lower conversion overhead, and easier debugging in embedded systems. ### Source excerpt This article explores ESP FOURCC standard based on FOURCC (Four Character Code), a standardized 32-bit identifier used in multimedia for format consistency, reducing conversion overhead and debugging complexity. It highlights Espressif implementation in ESP-GMF, where esp_fourcc.h defines FOURCC values for video, audio, container, image, and pixel formats, optimizing efficiency in embedded systems. ## GIMP 3.0 Released With Updated UI, Wayland Support, Improved File Compatibility, and Plugin API Changes DevFeed: [GIMP 3.0 Released With Updated UI, Wayland Support, Improved File Compatibility, and Plugin API Changes]() Original publisher: [Read original article]() Author: Vivek Gite Published: 2025-03-18T03:45:26Z Content type: release Language: en Sources: [nixCraft: Linux Tips, Hacks, Tutorials, And Ideas In Blog Format (RSS/FEED)]() Topics: [Development](), [Linux](), [CSS](), [Wayland](), [API](), [Compression](), [file](), [format](), [export](), [import]() Tags: [api](), [centos](), [compression](), [css](), [debian-linux](), [downloads](), [export](), [file](), [format](), [freebsd](), [gimp](), [import](), [improvements](), [linux](), [linux-news](), [macos](), [new-features](), [open-source](), [plugins](), [release](), [sysadmin](), [unix](), [upgrades](), [version]() ### AI overview GIMP 3.0 was released on March 16, 2025. The release adds a GTK3 interface, HiDPI and tablet improvements, Wayland support, CSS-based themes, updated icons, broader file-format compatibility, painting and text improvements, and updates to the core plugin API. ### Source excerpt Wow! After years of hard work and countless commits, we have finally reached a huge milestone: GIMP 3.0 is officially released! I am excited as I write this and can't wait to share some incredible new features and improvements in this release. GIMP 2.10 was released in 2018, and the first development version of GIMP 3.0 came out in 2020. GIMP 3.0 released on 16/March/2025. Let us explore how to download and install GIMP 3.0, as well as the new features in this version. Love this? sudo share_on: Twitter - Facebook - LinkedIn - Whatsapp - Reddit The post Download of the day: GIMP 3.0 is FINALLY Here! appeared first on nixCraft. ## Demystifying Maestro's UI Testing Implementation DevFeed: [Demystifying Maestro's UI Testing Implementation]() Original publisher: [Read original article]() Author: Sam Edwards Published: 2024-11-18T13:59:04Z Content type: article Language: en Sources: [Handstand Sam]() Topics: [Testing](), [ui-testing](), [Android](), [Code](), [Git]() Tags: [adb](), [android](), [android-testing](), [code](), [format](), [git](), [library](), [maestro](), [on-device](), [open-source](), [server](), [testing](), [ui](), [ui-testing](), [uiautomator](), [updates](), [xml]() ### AI overview This technical post examines how Maestro implements UI testing. It describes its YAML-based test commands, CLI-installed APKs, an on-device Netty gRPC server, UiAutomator view-hierarchy access, XML serialization, and UI interactions. ### Source excerpt I first heard about Maestro when it was released in 2022, but I haven't played with it until now. I'm doing some work with Espresso and UiAutomator for Android testing and was curious how Maestro worked under the hood, so I cloned their git repo and dove into the code. This quick post shares what [...] ## ESP32 bootstrapping in Zephyr DevFeed: [ESP32 bootstrapping in Zephyr]() Original publisher: [Read original article]() Author: John Lee Published: 2024-10-30T00:00:00Z Content type: article Language: en Sources: [Blog on Developer Portal]() Topics: [ESP32](), [Espressif](), [boot](), [Zephyr RTOS](), [SOC](), [Hardware](), [Tooling]() Tags: [blog](), [boot](), [bootloader](), [debugging](), [embedded](), [esp-idf](), [esp32](), [esp32-c3](), [esp32-c6](), [esp32-s2](), [esp32-s3](), [espressif](), [esptool](), [format](), [zephyr]() ### AI overview This article explains how Espressif SoCs, including ESP32 devices up to ESP32-C6, boot in Zephyr RTOS. It covers the ROM loader, second-stage loader, image formats, build and memory considerations, and related tooling. ### Source excerpt This article explains the booting process of Espressif devices up to ESP32-C6 (and probably newer devices). ## Releasing Outlines-core 0.1.0: structured generation in Rust and Python DevFeed: [Releasing Outlines-core 0.1.0: structured generation in Rust and Python]() Original publisher: [Read original article]() Author: bwillard; David Holtz; Erik Kaunismäki; Kaustubh Chaudhari; Remi Louf; Umut Şahin; Will Kurt Published: 2024-10-22T00:00:00Z Content type: release Language: en Sources: [Hugging Face - Blog]() Topics: [Rust](), [Python](), [Large Language Model](), [Artificial Intelligence](), [Open Source]() Tags: [chain-of-thought](), [format](), [function-calling](), [generation](), [llm](), [llms](), [open-source](), [python](), [rust](), [structured-generation](), [synthetic-data]() ### AI overview The article announces Outlines-core 0.1.0, a lightweight Rust core with Python bindings for structured generation. It describes performance, portability, and integration improvements, and explains how constrained generation makes LLM outputs conform to formats such as JSON, Pydantic models, regular expressions, and context-free grammars. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Exploring JSON Encoding and Data Handling in Go - Ep.2 DevFeed: [Exploring JSON Encoding and Data Handling in Go - Ep.2]() Original publisher: [Read original article]() Published: 2024-10-17T00:00:00Z Content type: tutorial Language: en Sources: [William Kennedy]() Topics: [JSON](), [Go Language](), [Structured-data](), [web applications]() Tags: [debug](), [decoding](), [efficient-data-encoding-in-go](), [encoding-json-in-go-with-type-assertions](), [format](), [go](), [go-encoding-json-package-tutorial](), [go-interface-with-json](), [go-json-handling](), [go-programming-json-tips](), [go-strongly-typed-system-and-json](), [handling-json-null-values-in-go](), [json](), [json-decoding-in-go-examples](), [json-encoding-in-go](), [json-for-engineers](), [json-marshalling-and-unmarshalling-in-go](), [json-schema-less-format-benefits-and-challenges](), [json-vs-binary-formats-in-go](), [mapping-json-to-go-types](), [pitfalls](), [working-with-json-in-go]() ### AI overview Episode 2 explains JSON as a schema-less, human-readable format and examines its benefits and pitfalls. It focuses on mapping JSON data to Go's strongly typed system, handling nullable and numeric values, comparing JSON with binary formats, and using Go's encoding and decoding tools. ### Source excerpt Introduction: Welcome to Episode 2 of JSON for Engineers! In this episode, we explore the unique characteristics of JSON as a schema-less format, discussing both its benefits and challenges. You'll learn how JSON's flexibility, while enabling rapid development, can create issues when working with strongly-typed languages like Go. Additionally, we'll cover the differences between JSON and more compact binary formats, and how to handle JSON's broader use in web applications. ## Improving Parquet Dedupe on Hugging Face Hub DevFeed: [Improving Parquet Dedupe on Hugging Face Hub]() Original publisher: [Read original article]() Author: yuchenglow; Di Xiao Published: 2024-10-05T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [parquet](), [content defined chunking](), [datasets](), [hugging face](), [Data analysis](), [Databases]() Tags: [analysis](), [content-defined-chunking](), [data](), [data-analysis](), [datasets](), [dedupe](), [format](), [hugging-face](), [parquet](), [storage](), [xet]() ### AI overview This article examines how Parquet file layout affects byte-level Content-Defined Chunking deduplication on Hugging Face Hub. Experiments show that appending rows deduplicates 99.1% of a 2GB file, while modifying one row achieves 89% deduplication because rewritten column headers contain absolute file offsets. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## How and when to use btree\_gist DevFeed: [How and when to use btree\_gist]() Original publisher: [Read original article]() Author: George MacKerron Published: 2024-07-08T13:29:31Z Content type: tutorial Language: en Sources: [Blog -- Neon Docs]() Topics: [SQL](), [Databases](), [CSV](), [data](), [DateTime]() Tags: [data](), [extension](), [files](), [format](), [index](), [monitor](), [numbers](), [postgres](), [schema](), [sql](), [time]() ### AI overview This tutorial explains how to use PostgreSQL indexes for queries combining one-dimensional and multidimensional data. It focuses on the btree_gist extension and demonstrates its use with UK crime data containing locations and reporting dates, including loading selected CSV data into PostgreSQL. ### Source excerpt The right indexes make big SQL queries fast. If you've been using Postgres for more than 5 minutes, you're almost certainly familiar with the everyday B-Tree index. This can deal with data that has a one-dimensional ordering: numbers, timestamps, text, and so on. And if you've ha... [Next page]()