# Red Hat Developer

Stories and tutorials on the latest technologies in cloud application development.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## From hours to minutes: Optimizing Red Hat Developer Hub performance testing with immutable LDAP images

DevFeed: [From hours to minutes: Optimizing Red Hat Developer Hub performance testing with immutable LDAP images](<https://devfeed.tech/articles/from-hours-to-minutes-optimizing-red-hat-developer-hub-performance-testing-with-immutable-ldap-images-41393.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/17/optimizing-red-hat-developer-hub-performance-testing-with-immutable-ldap-images>)

Author: Shashank Kestwal

Published: 2026-09-17T13:16:48Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Performance Testing](<https://devfeed.tech/topics/performance-testing.md>), [LDAP](<https://devfeed.tech/topics/ldap.md>), [Keycloak](<https://devfeed.tech/topics/keycloak.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Concurrency](<https://devfeed.tech/topics/concurrency.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [rbac](<https://devfeed.tech/topics/rbac.md>)

Tags: [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [keycloak](<https://devfeed.tech/tags/keycloak.md>), [ldap](<https://devfeed.tech/tags/ldap.md>), [migration](<https://devfeed.tech/tags/migration.md>), [performance-testing](<https://devfeed.tech/tags/performance-testing.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

This Red Hat developer article describes a performance-testing bottleneck in Red Hat Developer Hub caused by generating users and groups at runtime through the Keycloak Admin REST API and synchronizing them over HTTP. It introduces pre-built LDAP container images as immutable infrastructure to reduce environment setup complexity and improve testing feedback loops.

### Source excerpt

At Red Hat, our CI/CD pipelines are the heartbeat of our development process. However, as we scaled the Red Hat Developer Hub performance testing framework, we hit a wall. Our environment setup time was ballooning, turning what should have been a seamless verification step into a long waiting game. For performance engineering in catalog-dependent applications, deployment and catalog population speed directly dictate your feedback loops. The post From hours to minutes: Optimizing Red Hat Developer Hub performance testing with immutable LDAP images appeared first on Red Hat Developer.

## Catching poor LLM performance and accuracy before deployment

DevFeed: [Catching poor LLM performance and accuracy before deployment](<https://devfeed.tech/articles/catching-poor-llm-performance-and-accuracy-before-deployment-41392.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/17/catching-poor-llm-performance-and-accuracy-before-deployment>)

Author: Christopher Miyai

Published: 2026-09-17T13:16:47Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [container](<https://devfeed.tech/topics/container.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [container-images](<https://devfeed.tech/tags/container-images.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [llm](<https://devfeed.tech/tags/llm.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This article describes a regression-testing system for Red Hat AI Inference that compares upstream and midstream vLLM builds. It benchmarks LLM performance and accuracy across hardware variants and uses CI/CD to detect regressions before release.

### Source excerpt

vLLM is the leading open source inference and serving engine for LLMs. Averaging 64 commits a day with bi-weekly releases, the open source project goes through a significant amount of code changes rapidly. Red Hat AI Inference offers an integrated inference platform powered by vLLM, llm-d and vLLM's llm-compressor. The post Catching poor LLM performance and accuracy before deployment appeared first on Red Hat Developer.

## Build a unified CI/CD control plane with Red Hat Developer Hub

DevFeed: [Build a unified CI/CD control plane with Red Hat Developer Hub](<https://devfeed.tech/articles/build-a-unified-ci-cd-control-plane-with-red-hat-developer-hub-41391.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/17/build-unified-cicd-control-plane-red-hat-developer-hub>)

Author: Rishabh Singh

Published: 2026-09-17T13:16:44Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [internal developer portal](<https://devfeed.tech/topics/internal-developer-portal.md>), [Backstage](<https://devfeed.tech/topics/backstage.md>), [argo-cd](<https://devfeed.tech/topics/argo-cd.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Platform Engineering](<https://devfeed.tech/topics/platform-engineering.md>)

Tags: [argo-cd](<https://devfeed.tech/tags/argo-cd.md>), [backstage](<https://devfeed.tech/tags/backstage.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [cognitive-load](<https://devfeed.tech/tags/cognitive-load.md>), [developer-portal](<https://devfeed.tech/tags/developer-portal.md>), [developer-productivity](<https://devfeed.tech/tags/developer-productivity.md>), [guide](<https://devfeed.tech/tags/guide.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [onboarding](<https://devfeed.tech/tags/onboarding.md>), [openshift](<https://devfeed.tech/tags/openshift.md>), [platform](<https://devfeed.tech/tags/platform.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>)

### AI overview

This guide explains how platform engineers can deploy and configure Red Hat Developer Hub as a unified developer portal for Red Hat OpenShift, Argo CD, Tekton, Quay, and related deployment information. It describes aggregating pipeline runs, deployment health, and container image tags in one view, along with software templates for self-service project bootstrapping.

### Source excerpt

If your engineering teams waste time context-switching between Red Hat OpenShift, Argo CD, Tekton, and Quay, your platform needs a unified developer portal. The post Build a unified CI/CD control plane with Red Hat Developer Hub appeared first on Red Hat Developer.

## Why Kafka retention.ms can delay message deletion

DevFeed: [Why Kafka retention.ms can delay message deletion](<https://devfeed.tech/articles/why-your-kafka-topic-ignores-retention-ms-and-how-to-fix-it-31403.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/16/why-your-kafka-topic-ignores-retentionms-and-how-fix-it>)

Author: Rogerio Santos

Published: 2026-09-16T13:05:06Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [Apache-Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [file](<https://devfeed.tech/topics/file.md>), [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>)

Tags: [broker](<https://devfeed.tech/tags/broker.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [diagnose](<https://devfeed.tech/tags/diagnose.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>), [retention](<https://devfeed.tech/tags/retention.md>), [storage](<https://devfeed.tech/tags/storage.md>), [stream-processing](<https://devfeed.tech/tags/stream-processing.md>)

### AI overview

This guide explains why Kafka messages can remain readable beyond a topic's retention.ms setting. Kafka deletes closed log segments rather than individual messages, and the active segment and continuous writes can delay removal of older records.

### Source excerpt

A customer opened a support case with a deceptively simple complaint: a Kafka topic was configured with a 12-hour retention (retention.ms), yet messages produced on July 24 were still readable 4 days later, on July 28. Nothing was broken. The broker logged no errors. The retention policy was working as designed, but the segment layout and continuous write pattern delayed when the old records could actually be removed. The post Why your Kafka topic ignores retention.ms (and how to fix it) appeared first on Red Hat Developer.

## Constraining AI agents with Red Hat AI: Containment, identity, and governance

DevFeed: [Constraining AI agents with Red Hat AI: Containment, identity, and governance](<https://devfeed.tech/articles/constraining-ai-agents-with-red-hat-ai-containment-identity-and-governance-31402.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/16/constraining-ai-agents-with-red-hat-ai-containment-identity-and-governance>)

Author: Grace Ableidinger

Published: 2026-09-16T13:01:59Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Security](<https://devfeed.tech/topics/security.md>), [Zero Trust](<https://devfeed.tech/topics/zero-trust.md>), [Containers](<https://devfeed.tech/topics/containers.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [containers](<https://devfeed.tech/tags/containers.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [prompt-injection](<https://devfeed.tech/tags/prompt-injection.md>), [security](<https://devfeed.tech/tags/security.md>), [trust](<https://devfeed.tech/tags/trust.md>)

### AI overview

This tutorial explains how to secure AI agents running on Red Hat OpenShift using containment, verifiable identity, and governance. It covers namespace isolation, quotas, sandboxing, workload identity, and admission control, with OpenClaw used in the demo.

### Source excerpt

When an agent process runs on your laptop, it typically inherits anything your user has access to. Often this includes the full network stack, the file system, and the credentials sitting in memory. When integrating with GitHub, Slack, or a cloud provider, you could be one faulty permission or well-crafted prompt injection away from a security incident. The post Constraining AI agents with Red Hat AI: Containment, identity, and governance appeared first on Red Hat Developer.

## Red Hat Developer Hub: Preventing compliance violations with AI coding agents

DevFeed: [Red Hat Developer Hub: Preventing compliance violations with AI coding agents](<https://devfeed.tech/articles/red-hat-developer-hub-preventing-compliance-violations-with-ai-coding-agents-26750.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/15/red-hat-developer-hub-preventing-compliance-violations-ai-coding-agents>)

Author: Evan Shortiss, Ben Wilcock

Published: 2026-09-15T13:17:13Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [internal developer portal](<https://devfeed.tech/topics/internal-developer-portal.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Backstage](<https://devfeed.tech/topics/backstage.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [backstage](<https://devfeed.tech/tags/backstage.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [cli](<https://devfeed.tech/tags/cli.md>), [developer](<https://devfeed.tech/tags/developer.md>), [developer-productivity](<https://devfeed.tech/tags/developer-productivity.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

This tutorial demonstrates how an AI coding agent connected to Red Hat Developer Hub can query a Backstage software catalog, TechDocs, and software templates before making architectural decisions. Using a simulated insurance-company catalog, the demo shows how this context can help avoid PCI-DSS compliance violations, resolve governance conflicts, and create a traceable decision record.

### Source excerpt

AI coding agents can generate entire services, reason about architectures, and scaffold applications in minutes. But ask one to build a service for your organization and you'll quickly notice the gap: it doesn't know your rules. It doesn't know which messaging broker your compliance team mandates, which services already exist in adjacent domains, or which project template is the golden path for your team. The post Red Hat Developer Hub: Preventing compliance violations with AI coding agents appeared first on Red Hat Developer.

## Understanding W8A8 INT8 LLM quantization: Accuracy and performance results

DevFeed: [Understanding W8A8 INT8 LLM quantization: Accuracy and performance results](<https://devfeed.tech/articles/understanding-w8a8-int8-llm-quantization-accuracy-and-performance-results-17433.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/14/understanding-w8a8-int8-llm-quantization-accuracy-and-performance-results>)

Author: Sana Fayyaz

Published: 2026-09-14T13:01:43Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [compression](<https://devfeed.tech/tags/compression.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [performance](<https://devfeed.tech/tags/performance.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

The article evaluates W8A8 INT8 quantization of a Llama 3.1 8B Instruct model. It describes reducing the model from 14.9 GB to 8.0 GB with SmoothQuant and GPTQ, then compares the base and compressed models on four benchmarks to assess accuracy and performance.

### Source excerpt

In Understanding W8A8 INT8 LLM quantization: Half the size, better performance, same accuracy, we compressed a Llama 3.1 8B Instruct model from 14.9 GB to 8.0 GB using 8-bit integer (INT8) W8A8 quantization with SmoothQuant and Generative Pre-trained Transformer Quantization (GPTQ). The post Understanding W8A8 INT8 LLM quantization: Accuracy and performance results appeared first on Red Hat Developer.

## Python 3.14 free-threaded build is now available in RHEL

DevFeed: [Python 3.14 free-threaded build is now available in RHEL](<https://devfeed.tech/articles/python-3-14-free-threaded-build-is-now-available-in-rhel-17432.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/14/python-314-free-threaded-build-now-available-rhel>)

Author: Lumír Balhar

Published: 2026-09-14T13:01:41Z

Content type: release

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Python 3.14](<https://devfeed.tech/topics/python-3-14.md>), [Python](<https://devfeed.tech/topics/python.md>), [Concurrency](<https://devfeed.tech/topics/concurrency.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>), [cpu](<https://devfeed.tech/topics/cpu.md>)

Tags: [cpu](<https://devfeed.tech/tags/cpu.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [developers](<https://devfeed.tech/tags/developers.md>), [linux](<https://devfeed.tech/tags/linux.md>), [performance](<https://devfeed.tech/tags/performance.md>), [programming-languages-frameworks](<https://devfeed.tech/tags/programming-languages-frameworks.md>), [python](<https://devfeed.tech/tags/python.md>), [python-3-14](<https://devfeed.tech/tags/python-3-14.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [release](<https://devfeed.tech/tags/release.md>), [rhel](<https://devfeed.tech/tags/rhel.md>), [thread](<https://devfeed.tech/tags/thread.md>), [upstream-release](<https://devfeed.tech/tags/upstream-release.md>)

### AI overview

Red Hat Enterprise Linux 9.8 and 10.2 now provide a free-threaded Python 3.14 build through the Red Hat CodeReady Linux Builder repositories. With the GIL disabled, CPU-bound Python threads can execute in parallel across multiple CPU cores within a single process. The article explains expected performance benefits, installation, verification, and possible thread-safety issues in existing code.

### Source excerpt

Developers on Red Hat Enterprise Linux 9.8 and 10.2 can now test full parallel CPU execution in Python using the new free-threaded Python 3.14 build. In addition to the regular Python 3.14 interpreter, we also provide the free-threaded variant in the Red Hat CodeReady Linux Builder repositories. Python 3.14 is the first upstream release where the free-threaded build is officially supported rather than experimental. The post Python 3.14 free-threaded build is now available in RHEL appeared first on Red Hat Developer.

## Unlock a LUKS root over SSH on Fedora and Red Hat Enterprise Linux

DevFeed: [Unlock a LUKS root over SSH on Fedora and Red Hat Enterprise Linux](<https://devfeed.tech/articles/unlock-a-luks-root-over-ssh-on-fedora-and-red-hat-enterprise-linux-12355.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/11/unlock-a-luks-root-over-ssh-on-fedora-and-red-hat-enterprise-linux>)

Author: Josephine Pfeiffer

Published: 2026-09-11T13:01:51Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Fedora](<https://devfeed.tech/topics/fedora.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [OpenSSH](<https://devfeed.tech/topics/openssh.md>), [ssh](<https://devfeed.tech/topics/ssh.md>), [systemd](<https://devfeed.tech/topics/systemd.md>), [datacenter](<https://devfeed.tech/topics/datacenter.md>), [Network](<https://devfeed.tech/topics/network.md>), [Server](<https://devfeed.tech/topics/server.md>)

Tags: [config](<https://devfeed.tech/tags/config.md>), [datacenter](<https://devfeed.tech/tags/datacenter.md>), [developer](<https://devfeed.tech/tags/developer.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [linux](<https://devfeed.tech/tags/linux.md>), [network](<https://devfeed.tech/tags/network.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [remote](<https://devfeed.tech/tags/remote.md>), [rhel](<https://devfeed.tech/tags/rhel.md>), [server](<https://devfeed.tech/tags/server.md>), [ssh](<https://devfeed.tech/tags/ssh.md>), [systemd](<https://devfeed.tech/tags/systemd.md>)

### AI overview

This tutorial explains how to unlock an encrypted LUKS root remotely over SSH on Fedora and Red Hat Enterprise Linux. It describes adding NetworkManager and an SSH server to the dracut initramfs, configuring networking, rebuilding the initramfs, and using the rd.neednet=1 kernel argument.

### Source excerpt

An encrypted server in a datacenter reboots and stops in the initramfs, waiting for a passphrase at a console nobody is sitting at. 3 commands and a kernel argument get NetworkManager and sshd into a Fedora or Red Hat Enterprise Linux (RHEL) initramfs, so a remote server with an encrypted root can be unlocked over the network. The post Unlock a LUKS root over SSH on Fedora and Red Hat Enterprise Linux appeared first on Red Hat Developer.

## Bringing custom knowledge to agents with AutoRAG

DevFeed: [Bringing custom knowledge to agents with AutoRAG](<https://devfeed.tech/articles/bringing-custom-knowledge-to-agents-with-autorag-12353.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/11/bringing-custom-knowledge-agents-autorag>)

Author: Diego Alvarez Ponce, Diego Garcia Perez

Published: 2026-09-11T13:01:50Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Model Context Protocol (MCP)](<https://devfeed.tech/topics/model-context-protocol-mcp.md>), [Databases](<https://devfeed.tech/topics/databases.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [database](<https://devfeed.tech/tags/database.md>), [developer](<https://devfeed.tech/tags/developer.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [model-context-protocol-mcp](<https://devfeed.tech/tags/model-context-protocol-mcp.md>), [rag](<https://devfeed.tech/tags/rag.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [terminal](<https://devfeed.tech/tags/terminal.md>)

### AI overview

This guide explains how to use AutoRAG in Red Hat OpenShift AI to optimize retrieval-augmented generation for enterprise, domain-specific data. It also shows how to integrate a Model Context Protocol server that retrieves customer information from an internal database, using a fictional banking scenario.

### Source excerpt

The large language models (LLMs) that power generative AI work by drawing upon the patterns and information present in their training data. Without access to the right data, LLMs struggle to comprehend context--like our internal corporate vocabulary--and as a result, start to hallucinate. The post Bringing custom knowledge to agents with AutoRAG appeared first on Red Hat Developer.

## Red Hat edge platforms: Choosing the right one for your use case

DevFeed: [Red Hat edge platforms: Choosing the right one for your use case](<https://devfeed.tech/articles/red-hat-edge-platforms-choosing-the-right-one-for-your-use-case-12354.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/11/red-hat-edge-platforms-choosing-right-one-your-use-case>)

Author: Daniel Froehlich

Published: 2026-09-11T13:01:48Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Edge](<https://devfeed.tech/topics/edge.md>), [Containers](<https://devfeed.tech/topics/containers.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [Microservice](<https://devfeed.tech/topics/microservice.md>)

Tags: [containers](<https://devfeed.tech/tags/containers.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [edge](<https://devfeed.tech/tags/edge.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [high-availability](<https://devfeed.tech/tags/high-availability.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [management-tools](<https://devfeed.tech/tags/management-tools.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>)

### AI overview

This article introduces a series about choosing Red Hat edge platforms for specific deployment needs. It compares Red Hat Enterprise Linux and Red Hat OpenShift across workload types, platform sizes, hardware requirements, Kubernetes use cases, availability, storage, and management needs.

### Source excerpt

Choosing the right platform for an edge deployment is one of the most consequential decisions an organization makes--and one of the most confusing. The options range from a single-board computer running a handful of containers to a full Kubernetes cluster with high availability, software-defined storage, and centralized management. Pick too small, and you hit a wall when requirements grow. The post Red Hat edge platforms: Choosing the right one for your use case appeared first on Red Hat Developer.

## From token consumer to token provider: Building your org's AI API

DevFeed: [From token consumer to token provider: Building your org's AI API](<https://devfeed.tech/articles/from-token-consumer-to-token-provider-building-your-org-s-ai-api-12352.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/10/from-token-consumer-to-token-provider-building-your-orgs-ai-api>)

Author: Markell Rawls

Published: 2026-09-10T13:01:50Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [API](<https://devfeed.tech/topics/api.md>), [API keys](<https://devfeed.tech/topics/api-keys.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Security](<https://devfeed.tech/topics/security.md>), [NVIDIA DGX](<https://devfeed.tech/topics/nvidia-dgx.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [api](<https://devfeed.tech/tags/api.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [developer](<https://devfeed.tech/tags/developer.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [openai](<https://devfeed.tech/tags/openai.md>), [security](<https://devfeed.tech/tags/security.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

The article describes how organizations can move from independently purchasing AI-provider access and distributing API keys toward centrally managing AI infrastructure and providing internal AI APIs. It highlights rising token costs, fragmented workloads, limited visibility, and security-audit difficulties.

### Source excerpt

One of the biggest problems with AI right now is that it's expensive. If you've been anywhere near an enterprise IT budget in the last 2 years, then you already know that. Most companies that wanted to get AI into their workflows did the same thing: They signed up for a business account with an AI provider, handed out API keys, and started building. It made sense at the time because the models were good, the APIs were simple, and the alternative was standing up your own inference infrastructure, which nobody had bandwidth for. But then the bills started coming in. The post From token consumer to token provider: Building your org's AI API appeared first on Red Hat Developer.

## Deploy NeMo Guardrails on Red Hat OpenShift AI

DevFeed: [Deploy NeMo Guardrails on Red Hat OpenShift AI](<https://devfeed.tech/articles/deploy-nemo-guardrails-on-red-hat-openshift-ai-12349.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/09/deploy-nemo-guardrails-on-red-hat-openshift-ai>)

Author: Rob Geada

Published: 2026-09-09T15:05:01Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [NeMo](<https://devfeed.tech/topics/nemo.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [prompt injection](<https://devfeed.tech/topics/prompt-injection.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [developer](<https://devfeed.tech/tags/developer.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [operator](<https://devfeed.tech/tags/operator.md>), [platform](<https://devfeed.tech/tags/platform.md>), [prompt-injection](<https://devfeed.tech/tags/prompt-injection.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [safety](<https://devfeed.tech/tags/safety.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

This tutorial explains how to deploy an evaluated NeMo Guardrails configuration on a Red Hat OpenShift AI cluster. It covers prerequisites, creating a ConfigMap from the configuration files, and creating a NeMoGuardrails custom resource for a managed deployment.

### Source excerpt

This is part 3 in a 3-part series on local guardrail development and evaluation. In the 1st article, I looked at how to design and develop a guardrail configuration on a local machine, and then tried some manual testing. In the 2nd article, I explored how to rigorously test a guardrail against popular large-scale risk datasets. The post Deploy NeMo Guardrails on Red Hat OpenShift AI appeared first on Red Hat Developer.

## Use a local and open source code assistant

DevFeed: [Use a local and open source code assistant](<https://devfeed.tech/articles/use-a-local-and-open-source-code-assistant-12351.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/09/use-local-and-open-source-code-assistant>)

Author: Seth Kenlon

Published: 2026-09-09T14:01:45Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [ai-coding](<https://devfeed.tech/topics/ai-coding.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [ide](<https://devfeed.tech/topics/ide.md>), [Security, Privacy and Abuse Prevention](<https://devfeed.tech/topics/security-privacy-and-abuse-prevention.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Homebrew](<https://devfeed.tech/topics/homebrew.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [macOS](<https://devfeed.tech/topics/macos.md>)

Tags: [ai-coding](<https://devfeed.tech/tags/ai-coding.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [command-line](<https://devfeed.tech/tags/command-line.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [ide](<https://devfeed.tech/tags/ide.md>), [linux](<https://devfeed.tech/tags/linux.md>), [llm](<https://devfeed.tech/tags/llm.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [macos](<https://devfeed.tech/tags/macos.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [privacy](<https://devfeed.tech/tags/privacy.md>)

### AI overview

This Red Hat Developer article explains how to use OpenCode as a local, open source AI coding assistant. It covers OpenCode's terminal, desktop, and IDE extension interfaces, its use of the Model Context Protocol, installation requirements, and the need to configure an LLM. For privacy-conscious local development, it recommends open source local AI tools such as Ollama or OpenVINO.

### Source excerpt

There's a lot of excitement about AI coding assistants, but many of the available options either aren't open source, or don't respect your data privacy by sending what you're working on to the cloud for processing. If you're looking for an alternative to closed AI, then you need an open coding assistant and an open source IDE. The post Use a local and open source code assistant appeared first on Red Hat Developer.

## Personalize your product's text-to-speech voice for any language: Fine-tuning with Kubeflow Trainer on Red Hat OpenShift AI

DevFeed: [Personalize your product's text-to-speech voice for any language: Fine-tuning with Kubeflow Trainer on Red Hat OpenShift AI](<https://devfeed.tech/articles/personalize-your-product-s-text-to-speech-voice-for-any-language-fine-tuning-with-kubeflow-trainer-on-red-hat-openshift-ai-12350.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/09/text-to-speech-for-any-language-fine-tuning-with-kubeflow-trainer-on-red-hat-openshift-ai>)

Author: Dmytro Hryshchenko, Abhijeet Dhumal

Published: 2026-09-09T03:32:28Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [voice ai](<https://devfeed.tech/topics/voice-ai.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [distributed-training](<https://devfeed.tech/topics/distributed-training.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [lora](<https://devfeed.tech/topics/lora.md>), [data](<https://devfeed.tech/topics/data.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [lora](<https://devfeed.tech/tags/lora.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [speech](<https://devfeed.tech/tags/speech.md>), [text-to-speech](<https://devfeed.tech/tags/text-to-speech.md>), [training](<https://devfeed.tech/tags/training.md>), [voice](<https://devfeed.tech/tags/voice.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

This tutorial explains how to fine-tune the open source Orpheus-3B text-to-speech model for Turkish using Red Hat OpenShift AI and Kubeflow Trainer. It describes packaging distributed training in a TrainJob, scaling across nodes and GPUs, and using LoRA to keep memory usage below 16 GB. The reported result reduces speech errors by more than 90% compared with the base model.

### Source excerpt

Can't Read, Won't Buy. That is the title CSA Research gave its survey of 8,709 consumers across 29 countries, and the numbers justify it: 76% prefer to buy in their own language, and 40% will never buy in another. The same rule governs what your product says out loud. The post Personalize your product's text-to-speech voice for any language: Fine-tuning with Kubeflow Trainer on Red Hat OpenShift AI appeared first on Red Hat Developer.

## Optimize vLLM speculative decoding with FastMTP heads

DevFeed: [Optimize vLLM speculative decoding with FastMTP heads](<https://devfeed.tech/articles/optimize-vllm-speculative-decoding-with-fastmtp-heads-12348.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/08/optimize-vllm-speculative-decoding-fastmtp-heads>)

Author: Rahul Tuli

Published: 2026-09-08T14:20:16Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [data](<https://devfeed.tech/tags/data.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [production](<https://devfeed.tech/tags/production.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

This article explains how FastMTP-style fine-tuning improves vLLM speculative decoding. It describes using native multi-token prediction heads as speculators, adapting a single head for recursive multi-step drafting, extracting weights from verifier checkpoints, and producing vLLM-ready checkpoints without training from scratch.

### Source excerpt

Autoregressive decoding makes large language model (LLM) inference memory-bandwidth bound: every token needs 1 full forward pass over billions of parameters, so the hardware spends most of its time moving weights rather than computing. MTP is a training objective: models like the DeepSeek and Qwen families learn to predict several future tokens at each position, which improves their data efficiency and quality. The post Optimize vLLM speculative decoding with FastMTP heads appeared first on Red Hat Developer.

## Understanding W8A8 INT8 LLM quantization: Half the size, better performance, same accuracy

DevFeed: [Understanding W8A8 INT8 LLM quantization: Half the size, better performance, same accuracy](<https://devfeed.tech/articles/understanding-w8a8-int8-llm-quantization-half-the-size-better-performance-same-accuracy-12347.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/07/understanding-w8a8-int8-llm-quantization>)

Author: Sana Fayyaz

Published: 2026-09-07T07:01:34Z

Content type: article

Language: en

Sources: [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [quantization](<https://devfeed.tech/topics/quantization.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [llama](<https://devfeed.tech/topics/llama.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [compression](<https://devfeed.tech/tags/compression.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [memory](<https://devfeed.tech/tags/memory.md>), [performance](<https://devfeed.tech/tags/performance.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [quantization](<https://devfeed.tech/tags/quantization.md>)

### AI overview

This article explains INT8 W8A8 quantization for Llama 3.1 8B using SmoothQuant and GPTQ. It describes how quantization reduces memory requirements and can improve serving performance while preserving model accuracy, including a reported 46% reduction in model size and planned benchmark testing with vLLM and llm-compressor.

### Source excerpt

Large language models are expensive to serve. A model like Llama 3.1 8B in Bfloat16 (BF16) precision occupies roughly 15 GB of GPU memory. In BF16, each of the 8 billion parameters takes 2 bytes to store, which adds up to roughly 15 GB for the weights--and that's not all. The GPU needs memory for the key-value (KV) cache to store context for active requests, alongside intermediate tensor outputs (activations, as we call them) generated during inference. The post Understanding W8A8 INT8 LLM quantization: Half the size, better performance, same accuracy appeared first on Red Hat Developer.

## Red Hat Developer Hub software template authoring with rhdh-templates

DevFeed: [Red Hat Developer Hub software template authoring with rhdh-templates](<https://devfeed.tech/articles/red-hat-developer-hub-software-template-authoring-with-rhdh-templates-12346.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/07/red-hat-developer-hub-software-template-authoring-rhdh-templates>)

Author: Kashish Mittal

Published: 2026-09-07T07:01:32Z

Content type: tutorial

Language: en

Sources: [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Backstage](<https://devfeed.tech/topics/backstage.md>), [internal developer portal](<https://devfeed.tech/topics/internal-developer-portal.md>), [Nunjucks](<https://devfeed.tech/topics/nunjucks.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [YAML](<https://devfeed.tech/topics/yaml.md>)

Tags: [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [backstage](<https://devfeed.tech/tags/backstage.md>), [developer-portal](<https://devfeed.tech/tags/developer-portal.md>), [developer-productivity](<https://devfeed.tech/tags/developer-productivity.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [quick-start](<https://devfeed.tech/tags/quick-start.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [software-templates](<https://devfeed.tech/tags/software-templates.md>), [terminal](<https://devfeed.tech/tags/terminal.md>), [validation](<https://devfeed.tech/tags/validation.md>)

### AI overview

This tutorial introduces the rhdh-templates skill for building Red Hat Developer Hub and Backstage software templates with an AI coding assistant. It covers Nunjucks conventions, YAML schema checking, reference templates, local offline validation, repository templatization, and optional testing against a Red Hat Developer Hub instance.

### Source excerpt

If you are a platform engineer or developer building Red Hat Developer Hub software templates, you know the friction of wrestling with Nunjucks syntax, guessing location.yaml placements, and discovering errors only after rendering in your developer portal. While AI coding agents handle generic YAML, they lack Red Hat Developer Hub and Backstage-specific conventions. The post Red Hat Developer Hub software template authoring with rhdh-templates appeared first on Red Hat Developer.