# Amazon SageMaker

Amazon SageMaker is an AWS platform providing managed infrastructure, tools, and workflows for analytics and for building, training, and deploying machine-learning and foundation models.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints

DevFeed: [Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints](<https://devfeed.tech/articles/amazon-sagemaker-ai-now-detects-latency-drift-idle-gpus-and-missed-optimizations-on-your-inference-endpoints-144471.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/amazon-sagemaker-ai-now-detects-latency-drift-idle-gpus-and-missed-optimizations-on-your-inference-endpoints/>)

Author: Hazim Qudah

Published: 2026-11-19T21:28:18Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [gpu monitoring](<https://devfeed.tech/topics/gpu-monitoring.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [amazon-sagemaker-studio](<https://devfeed.tech/tags/amazon-sagemaker-studio.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws-user-notifications](<https://devfeed.tech/tags/aws-user-notifications.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [drift](<https://devfeed.tech/tags/drift.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [gpu-utilization](<https://devfeed.tech/tags/gpu-utilization.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [inference-endpoints](<https://devfeed.tech/tags/inference-endpoints.md>), [latency](<https://devfeed.tech/tags/latency.md>), [optimizations](<https://devfeed.tech/tags/optimizations.md>), [performance](<https://devfeed.tech/tags/performance.md>), [serving](<https://devfeed.tech/tags/serving.md>), [studio](<https://devfeed.tech/tags/studio.md>)

### AI overview

Amazon SageMaker AI monitors eligible generative AI inference endpoints by default when they use vLLM serving containers and GPU instances. Using aggregated latency, GPU utilization, and serving configuration signals, it can flag week-over-week latency drift, mostly idle GPUs, or supported optimizations and updates that are missing. Monitoring does not read request or response content and has no GPU cost. Findings arrive through AWS Health and email; users can open them in SageMaker Studio and benchmark alternatives on separate compute, comparing response time, throughput, and cost per million tokens. No endpoint change occurs until the user chooses to apply a result, and keeping the current configuration is also an option. Benchmarks incur standard SageMaker charges or use an ML reservation. Monitoring can be disabled by setting OPT_OUT_TRACKING on a model container; doing so prevents telemetry collection and notifications for that endpoint.

### Source excerpt

Amazon SageMaker AI now monitors your generative AI inference endpoints by default and tells you when a change could improve performance or lower cost. It tracks latency, GPU utilization, and serving configuration, then sends a finding through AWS Health with a one-click path to benchmark alternatives in SageMaker Studio before you apply any change.

## From learning to leaderboard: How Cisco upskilled 1,200 engineers in agentic AI with AWS AI League

DevFeed: [From learning to leaderboard: How Cisco upskilled 1,200 engineers in agentic AI with AWS AI League](<https://devfeed.tech/articles/from-learning-to-leaderboard-how-cisco-upskilled-1-200-engineers-in-agentic-ai-with-aws-ai-league-144060.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/from-learning-to-leaderboard-how-cisco-upskilled-1200-engineers-in-agentic-ai-with-aws-ai-league/>)

Author: Rakesh Vangari

Published: 2026-11-19T18:26:22Z

Content type: news

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Agentic AI](<https://devfeed.tech/topics/what-is-agentic-ai.md>), [Amazon Bedrock AgentCore](<https://devfeed.tech/topics/amazon-bedrock-agentcore.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Cisco](<https://devfeed.tech/topics/cisco.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Learning](<https://devfeed.tech/topics/learning.md>)

Tags: [2025](<https://devfeed.tech/tags/2025.md>), [2026](<https://devfeed.tech/tags/2026.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentcore](<https://devfeed.tech/tags/agentcore.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-learning](<https://devfeed.tech/tags/ai-learning.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [aws](<https://devfeed.tech/tags/aws.md>), [bedrock](<https://devfeed.tech/tags/bedrock.md>), [bedrock-agentcore](<https://devfeed.tech/tags/bedrock-agentcore.md>), [building](<https://devfeed.tech/tags/building.md>), [cisco](<https://devfeed.tech/tags/cisco.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [engineers](<https://devfeed.tech/tags/engineers.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [learning](<https://devfeed.tech/tags/learning.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Cisco and AWS used the annual Transformation Fest and AWS AI League to move engineers from AI training into hands-on building: 1,200 Cisco engineers competed in the 2026 agentic AI tournament, following a 2025 Cisco engineer's global win. The league combines a two-hour workshop, self-paced submissions with automated leaderboard feedback, and a live finale. In the 2026 challenge, the winning agent used one agent instead of specialist sub-agents to reduce coordination tokens, put route optimization in an AWS Lambda tool, and prioritized high-value challenges over many low-value coins. The article reports that output tokens--including tool-call arguments--affected scoring, while tool results and the system prompt did not. These are lessons from this competition's scoring setup, not a claim that multi-agent designs are generally inferior.

### Source excerpt

Cisco and AWS used Cisco Transformation Fest and AWS AI League to turn hands-on AI learning into a culture of building. A Cisco engineer won the 2025 AWS AI League global title and 1,200 engineers competed in 2026. This post shares Cisco's journey, lessons from the 2026 winning agent built on Amazon Bedrock AgentCore, and how to host your own league.

## Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization

DevFeed: [Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization](<https://devfeed.tech/articles/full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization-141875.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization/>)

Author: Sandeep Raveesh-Babu

Published: 2026-11-19T00:15:58Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [lora](<https://devfeed.tech/topics/lora.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [peft](<https://devfeed.tech/topics/peft.md>), [Hyperparameter optimization](<https://devfeed.tech/topics/hyperparameter-optimization.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [customization](<https://devfeed.tech/tags/customization.md>), [fft](<https://devfeed.tech/tags/fft.md>), [fine](<https://devfeed.tech/tags/fine.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [full](<https://devfeed.tech/tags/full.md>), [gap](<https://devfeed.tech/tags/gap.md>), [guidelines](<https://devfeed.tech/tags/guidelines.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [key](<https://devfeed.tech/tags/key.md>), [lora](<https://devfeed.tech/tags/lora.md>), [matrices](<https://devfeed.tech/tags/matrices.md>), [model](<https://devfeed.tech/tags/model.md>), [post](<https://devfeed.tech/tags/post.md>), [practical](<https://devfeed.tech/tags/practical.md>), [serverless](<https://devfeed.tech/tags/serverless.md>)

### AI overview

The excerpt reports that Full Fine-Tuning (FFT) can outperform LoRA on complex code-generation tasks with large datasets, while results depend heavily on hyperparameters and FFT can cause catastrophic forgetting. In experiments, Qwen3-4B was fine-tuned on 110,000 Magicoder coding pairs using SageMaker AI Serverless Model Customization. At 100K+ examples, FFT reached 90% LLM-as-Judge correctness; a baseline with 5% warmup, batch size 8, and learning rate 2e-5 best preserved MMLU knowledge. Three epochs yielded the reported correctness peak, while training beyond that degraded tested variants. Aggressive FFT learning rates of 5e-5 or higher sharply reduced MATH and MMLU scores. LoRA slightly exceeded FFT on one LLM-as-Judge comparison (81.5% versus 79.5%), and both methods fell below the base model on MATH exact match. The service handles compute allocation and checkpoints; switching between FFT and LoRA requires changing the training type. These findings reflect the reported coding experiments and do not establish FFT as universally superior.

### Source excerpt

Amazon SageMaker AI Serverless Model Customization now supports Full Fine-Tuning (FFT). This post explores when FFT outperforms LoRA across key benchmarks, examines the spectral properties of model weight matrices behind the quality gap, shares practical hyperparameter tuning guidelines, and shows how to get started.

## How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI

DevFeed: [How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI](<https://devfeed.tech/articles/how-salesforce-is-advancing-global-scale-model-serving-with-cross-region-inference-routing-in-amazon-sagemaker-ai-141212.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/how-salesforce-is-advancing-global-scale-model-serving-with-cross-region-inference-routing-in-amazon-sagemaker-ai/>)

Author: Apoorva Chandra

Published: 2026-11-18T20:13:18Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [call](<https://devfeed.tech/tags/call.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cross](<https://devfeed.tech/tags/cross.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [data](<https://devfeed.tech/tags/data.md>), [data-residency](<https://devfeed.tech/tags/data-residency.md>), [global](<https://devfeed.tech/tags/global.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [model](<https://devfeed.tech/tags/model.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [region](<https://devfeed.tech/tags/region.md>), [regions](<https://devfeed.tech/tags/regions.md>), [routing](<https://devfeed.tech/tags/routing.md>), [salesforce](<https://devfeed.tech/tags/salesforce.md>), [scale](<https://devfeed.tech/tags/scale.md>), [serving](<https://devfeed.tech/tags/serving.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Salesforce replaced its Internal Gateway's basic health checks, retries, and Region switching with an Amazon SageMaker AI inference router that sends calls across its existing endpoints and accounts. The router prefers local capacity, shifts traffic when request errors indicate an unhealthy or unavailable destination, and gradually returns traffic after recovery; high latency alone does not trigger failover. Residency-tagged requests use a target containing only the local endpoint. Endpoint owners authorize cross-account access with resource policies, and response fields identify the serving resource and routing reason for logs and CloudWatch metrics. In a saturation test, traffic stayed local during a latency rise, then shifted after container timeouts; about 78% reached the remote Region, with p50 latency returning to 0.2 seconds and under 100 ms of cross-Region overhead at p50. The router does not deploy models or add capacity, so registered Regions need matching model artifacts and sufficient capacity; a receiving endpoint can cap remote traffic. Salesforce plans further tests of sustained saturation, latency, and cascading failures.

### Source excerpt

Learn how Salesforce uses the cross-Region inference router in Amazon SageMaker AI to turn fragmented Regional capacity into reliable model serving. Salesforce adds capacity securely across Regions and accounts while keeping its data residency commitments, and sees per request where each call was served and why.

## Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference

DevFeed: [Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference](<https://devfeed.tech/articles/managed-nvidia-dynamo-on-amazon-sagemaker-hyperpod-inference-138699.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/managed-nvidia-dynamo-on-amazon-sagemaker-hyperpod-inference/>)

Author: Vinay Arora

Published: 2026-11-17T23:33:26Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker HyperPod](<https://devfeed.tech/topics/amazon-sagemaker-hyperpod.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agent-skills](<https://devfeed.tech/tags/agent-skills.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-hyperpod](<https://devfeed.tech/tags/amazon-sagemaker-hyperpod.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [api](<https://devfeed.tech/tags/api.md>), [aws](<https://devfeed.tech/tags/aws.md>), [benchmark-performance](<https://devfeed.tech/tags/benchmark-performance.md>), [disaggregated-serving](<https://devfeed.tech/tags/disaggregated-serving.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-inference](<https://devfeed.tech/tags/distributed-inference.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [inference](<https://devfeed.tech/tags/inference.md>), [managed](<https://devfeed.tech/tags/managed.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dynamo](<https://devfeed.tech/tags/nvidia-dynamo.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [routing](<https://devfeed.tech/tags/routing.md>), [serving](<https://devfeed.tech/tags/serving.md>)

### AI overview

SageMaker HyperPod adds managed NVIDIA Dynamo deployments for large models that may exceed one instance's GPU memory or benefit from separating prompt processing and token generation. Users can bring an existing DynamoGraphDeployment or configure an InferenceEndpointConfig with dynamoSpec; the latter supports vLLM by default, plus SGLang and TensorRT-LLM. Dynamo provides multi-node and aggregated or disaggregated serving, while HyperPod components coordinate GPU placement, EFA networking, node health, and recovery. In benchmarks described in the source, disaggregated Qwen3-235B serving reached 207 versus 101 output tokens per second per GPU at selected SLA-compliant points. A two-node Qwen3.5-397B aggregated setup retained 99.1% of single-node throughput under the tested workload. The article advises selecting a matching recipe, verifying EFA transport, benchmarking representative traffic against SLAs, and tuning based on measured bottlenecks; results depend on the tested models and workloads.

### Source excerpt

Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.

## Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

DevFeed: [Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows](<https://devfeed.tech/articles/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows-138418.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows/>)

Author: Varun Rajan

Published: 2026-11-17T19:40:01Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [human feedback](<https://devfeed.tech/topics/human-feedback.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skill](<https://devfeed.tech/tags/agent-skill.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data](<https://devfeed.tech/tags/ai-data.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apis](<https://devfeed.tech/tags/apis.md>), [auto-label](<https://devfeed.tech/tags/auto-label.md>), [build](<https://devfeed.tech/tags/build.md>), [data](<https://devfeed.tech/tags/data.md>), [data-preparation](<https://devfeed.tech/tags/data-preparation.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [development](<https://devfeed.tech/tags/development.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [examples](<https://devfeed.tech/tags/examples.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [model](<https://devfeed.tech/tags/model.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [quality](<https://devfeed.tech/tags/quality.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Amazon SageMaker AI adds modular data preparation capabilities that let teams generate synthetic examples, label datasets, review uncertain labels, assess quality, and transform data before training or evaluation. Auto-labeling supports built-in and custom tasks; for tasks with fixed answers, multiple models label each row and their agreement supplies a confidence score, with low-confidence rows routed to human review in SageMaker Studio. Synthetic data can be grounded in seed data and documents, and generated pipelines can be inspected and modified. Teams can chain these steps, for example generating task-specific data, reshaping it for SFT, DPO, or RL, and checking for duplicates, leakage, and rule violations. Work is driven through Python SDK APIs or an AI-ML agent skill, with artifacts open to inspection and editing. Data stays in the team's S3 buckets in its chosen Region under an IAM execution role it controls. The capabilities are generally available in US East (N. Virginia) and US West (Oregon).

### Source excerpt

Amazon SageMaker AI now offers AI data preparation capabilities for building high-quality training and evaluation data. Generate synthetic examples, assess and improve datasets, auto-label at scale, and bring in expert review through Python SDK APIs and an agent skill, all from your own notebook or IDE.

## Reason over time-series data with OpenTSLM on Amazon SageMaker JumpStart

DevFeed: [Reason over time-series data with OpenTSLM on Amazon SageMaker JumpStart](<https://devfeed.tech/articles/reason-over-time-series-data-with-opentslm-on-amazon-sagemaker-jumpstart-138239.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/reason-over-time-series-data-with-opentslm-on-amazon-sagemaker-jumpstart/>)

Author: Martin Maritsch

Published: 2026-11-17T18:06:44Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker JumpStart](<https://devfeed.tech/topics/amazon-sagemaker-jumpstart.md>), [Temporal data](<https://devfeed.tech/topics/temporal-data.md>), [Time Series](<https://devfeed.tech/topics/time-series.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-jumpstart](<https://devfeed.tech/tags/amazon-sagemaker-jumpstart.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [it-support](<https://devfeed.tech/tags/it-support.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [proactive](<https://devfeed.tech/tags/proactive.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [time-series-data](<https://devfeed.tech/tags/time-series-data.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

OpenTSLM-Flamingo, a 5.24-billion-parameter model combining Gemma 3 4B with a time-series encoder and cross-attention, is available through SageMaker JumpStart for deployment to a real-time endpoint in an AWS environment. Requests pair numerical series with questions and optional context; each series can contain up to 32,768 values. A request supports up to four instances and 32 series per instance, but a 60-second invocation limit and sequential processing constrain long answers or batches. The text also recommends testing input windows because evaluated time-series models can lose event-retrieval accuracy on longer histories. For adaptation, a SageMaker training job loads ARFBench through TimeNet, fine-tunes selected model components while freezing the rest of Gemma 3, and stores the resulting artifact in S3. In the reported run, held-out ARFBench accuracy increased from 5.0% to 45.9%; the article says this is an example result, not a model comparison or official leaderboard score. It recommends evaluating representative cases before deciding whether to improve context or fine-tune.

### Source excerpt

OpenTSLM, an open source family of time-series language models, is now available in Amazon SageMaker JumpStart. See how Nexthink and Aionic Labs apply it to proactive IT support, then deploy OpenTSLM to a real-time endpoint and fine-tune it on your own data with TimeNet and a SageMaker training job.

## Production MLOps at GS Caltex with Amazon SageMaker Canvas, part 1

DevFeed: [Production MLOps at GS Caltex with Amazon SageMaker Canvas, part 1](<https://devfeed.tech/articles/production-mlops-at-gs-caltex-with-amazon-sagemaker-canvas-part-1-133425.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/production-mlops-at-gs-caltex-with-amazon-sagemaker-canvas-part-1/>)

Author: WonGu Rho

Published: 2026-11-13T23:22:09Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [MLOps](<https://devfeed.tech/topics/mlops.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Amazon EventBridge](<https://devfeed.tech/topics/amazon-eventbridge.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon CloudWatch](<https://devfeed.tech/topics/amazon-cloudwatch.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-canvas](<https://devfeed.tech/tags/amazon-sagemaker-canvas.md>), [batch](<https://devfeed.tech/tags/batch.md>), [canvas](<https://devfeed.tech/tags/canvas.md>), [code](<https://devfeed.tech/tags/code.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [engineers](<https://devfeed.tech/tags/engineers.md>), [inference](<https://devfeed.tech/tags/inference.md>), [minutes](<https://devfeed.tech/tags/minutes.md>), [ml](<https://devfeed.tech/tags/ml.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [models](<https://devfeed.tech/tags/models.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [post](<https://devfeed.tech/tags/post.md>), [process](<https://devfeed.tech/tags/process.md>), [production](<https://devfeed.tech/tags/production.md>), [reuse](<https://devfeed.tech/tags/reuse.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

GS Caltex connects process engineers' validated SageMaker Canvas models and Data Wrangler flows to SageMaker Pipelines, where ML engineers configure preprocessing, model approval, Batch Transform inference, and scheduling. The handoff reuses validated assets while ML engineers supply production paths, execution order, and deployment configuration. An EventBridge rule can start batch runs every 30 minutes; unlike a continuously running real-time endpoint, Batch Transform releases compute after each job, though full workflow costs and runtime still need measurement. The article highlights practical constraints: inference data may lack a training target column, so a placeholder-and-drop approach is suitable only if the target does not affect features; fixed flow input paths can cause overlapping runs to conflict; and assembled predictions require row-order and count checks. GS Caltex reports deployment time fell from about a week to a few hours, with lower inference costs.

### Source excerpt

GS Caltex connects Amazon SageMaker Canvas to Amazon SageMaker Pipelines so process engineers' no-code models run in production. This post shows how ML engineers reuse validated preprocessing flows and models, cutting deployment from about a week to a few hours and running batch inference every 30 minutes.

## OpenFold3 on Amazon SageMaker JumpStart: Predict biomolecular structures

DevFeed: [OpenFold3 on Amazon SageMaker JumpStart: Predict biomolecular structures](<https://devfeed.tech/articles/openfold3-on-amazon-sagemaker-jumpstart-predict-biomolecular-structures-133424.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/openfold3-on-amazon-sagemaker-jumpstart-predict-biomolecular-structures/>)

Author: Malav Shastri

Published: 2026-11-13T21:53:40Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker JumpStart](<https://devfeed.tech/topics/amazon-sagemaker-jumpstart.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Multi-GPU](<https://devfeed.tech/topics/multi-gpu.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [aws-sns](<https://devfeed.tech/topics/aws-sns.md>), [Amazon CloudWatch](<https://devfeed.tech/topics/amazon-cloudwatch.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [account](<https://devfeed.tech/tags/account.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [amazon-sagemaker-jumpstart](<https://devfeed.tech/tags/amazon-sagemaker-jumpstart.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [aws](<https://devfeed.tech/tags/aws.md>), [cost](<https://devfeed.tech/tags/cost.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [dna](<https://devfeed.tech/tags/dna.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [jumpstart](<https://devfeed.tech/tags/jumpstart.md>), [multi-gpu](<https://devfeed.tech/tags/multi-gpu.md>), [post](<https://devfeed.tech/tags/post.md>), [preview](<https://devfeed.tech/tags/preview.md>), [proteins](<https://devfeed.tech/tags/proteins.md>), [reduce](<https://devfeed.tech/tags/reduce.md>), [rna](<https://devfeed.tech/tags/rna.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

OpenFold3-preview on SageMaker JumpStart serves protein, DNA, RNA, ligand, and complex structure predictions through asynchronous endpoints, which queue jobs and store results or errors in S3. The article outlines deployment prerequisites, request formats, confidence files, and multi-GPU use: a prediction uses one GPU, while a four-GPU ml.g6.12xlarge can process four requests concurrently. Network isolation prevents calls to external MSA servers; users can supply precomputed alignments generated on infrastructure they control. In the article's carbonic anhydrase II example, an MSA recovered the known binding mode while sequence-only prediction misfolded, but the authors caution this well-studied complex is not a novel-target benchmark. Scale-to-zero can reduce idle instance charges, though restarting adds delay; S3 and other charges still apply. The model is described as a research preview, and the post advises meeting organizational security and compliance requirements before using proprietary or regulated data.

### Source excerpt

Deploy OpenFold3-preview from Amazon SageMaker JumpStart to predict 3D structures of proteins, DNA, RNA, and ligand complexes in your own AWS account. The post covers asynchronous inference, multi-GPU parallelism, bringing your own MSAs for accuracy and privacy, and scaling to zero to reduce cost.

## How IGNYTE runs candidate search with Amazon S3 Vectors

DevFeed: [How IGNYTE runs candidate search with Amazon S3 Vectors](<https://devfeed.tech/articles/how-ignyte-runs-candidate-search-with-amazon-s3-vectors-133435.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/storage/how-ignyte-runs-candidate-search-with-amazon-s3-vectors/>)

Author: Saurabh Gupta

Published: 2026-11-13T19:52:38Z

Content type: article

Language: en

Sources: [AWS Storage Blog](<https://devfeed.tech/sources/aws-storage-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon OpenSearch Service](<https://devfeed.tech/topics/amazon-opensearch-service.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [vector embeddings in AI](<https://devfeed.tech/topics/vector-embeddings-in-ai.md>), [Amazon Bedrock AgentCore](<https://devfeed.tech/topics/amazon-bedrock-agentcore.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Parquet files in Amazon S3](<https://devfeed.tech/topics/parquet-files-in-amazon-s3.md>)

Tags: [agentcore](<https://devfeed.tech/tags/agentcore.md>), [amazon-opensearch-service](<https://devfeed.tech/tags/amazon-opensearch-service.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [approximate-nearest-neighbor-search](<https://devfeed.tech/tags/approximate-nearest-neighbor-search.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [layout](<https://devfeed.tech/tags/layout.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [semantic](<https://devfeed.tech/tags/semantic.md>)

### AI overview

IGNYTE moved embeddings for more than 1 billion contacts from OpenSearch Service to Amazon S3 Vectors; more than 800 million contacts are currently embedded. OpenSearch Service retains full profiles and handles structured filters. A scheduled batch pipeline loads company records first, then enriches contact records, generates embeddings, and writes profiles and vectors to their respective stores. Vectors are partitioned by continent, with minimal metadata for query filters. Searches embed the recruiter's query, retrieve the 100 closest contacts from the matching S3 Vectors index, then apply skills, experience, and other structured filters in OpenSearch Service. The article reports that the full agent matching workflow averages under 30 seconds after migration, compared with 3-4 minutes before; this is an end-to-end result, not a single vector query.

### Source excerpt

Ignyte moved the embeddings for more than 1 billion contacts from Amazon OpenSearch Service to Amazon S3 Vectors, keeping OpenSearch Service for structured filtering. See the per-continent index layout, the minimal-metadata design, and the batch pipeline behind its two-hop semantic candidate search.

## Build a model improvement flywheel with Amazon SageMaker HyperPod Data Capture

DevFeed: [Build a model improvement flywheel with Amazon SageMaker HyperPod Data Capture](<https://devfeed.tech/articles/build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture-132650.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture/>)

Author: Shantanu Tripathi

Published: 2026-11-13T18:01:15Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker HyperPod](<https://devfeed.tech/topics/amazon-sagemaker-hyperpod.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [after](<https://devfeed.tech/tags/after.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-hyperpod](<https://devfeed.tech/tags/amazon-sagemaker-hyperpod.md>), [athena](<https://devfeed.tech/tags/athena.md>), [build](<https://devfeed.tech/tags/build.md>), [capture](<https://devfeed.tech/tags/capture.md>), [data](<https://devfeed.tech/tags/data.md>), [example](<https://devfeed.tech/tags/example.md>), [fine](<https://devfeed.tech/tags/fine.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [improvement](<https://devfeed.tech/tags/improvement.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [live](<https://devfeed.tech/tags/live.md>), [measuring](<https://devfeed.tech/tags/measuring.md>), [model](<https://devfeed.tech/tags/model.md>), [new-product](<https://devfeed.tech/tags/new-product.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

SageMaker HyperPod Data Capture records inference inputs and outputs in S3 at three independent tiers. In the example, Tier 3 captures a support router's traffic; Athena reveals that a new air-conditioner line drove "Other" labels from 4.8% before launch to 36.8% afterward. A SQL labeling policy turns captures into training data, and a 60-second LoRA fine-tune on a second GPU raises new-category recall from 0% to full recall without regression on established classes. Held-out probes also expose shortcuts learned from the synthetic, keyword-labeled data. The walkthrough requires two GPUs and appropriate S3, KMS, and Athena permissions; Tier 3 payloads may contain personal information and need safeguards. The post reports no measurable serving-latency impact in its test, while warning that self-reported confidence was unreliable for detecting misroutes.

### Source excerpt

Amazon SageMaker HyperPod Data Capture records live inference inputs and outputs to Amazon S3. This post walks through one end-to-end example: capturing a support router's production traffic, surfacing a new-product blind spot with Amazon Athena, fine-tuning on the captured data with the HyperPod training operator, and measuring the before-and-after lift.

## Detecting and recovering from silent data corruption on Amazon SageMaker HyperPod

DevFeed: [Detecting and recovering from silent data corruption on Amazon SageMaker HyperPod](<https://devfeed.tech/articles/detecting-and-recovering-from-silent-data-corruption-on-amazon-sagemaker-hyperpod-129622.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/detecting-and-recovering-from-silent-data-corruption-on-amazon-sagemaker-hyperpod/>)

Author: Siddharth Senger

Published: 2026-11-11T23:30:03Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker HyperPod](<https://devfeed.tech/topics/amazon-sagemaker-hyperpod.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Error Handling](<https://devfeed.tech/topics/error-handling.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker-hyperpod](<https://devfeed.tech/tags/amazon-sagemaker-hyperpod.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [replacement](<https://devfeed.tech/tags/replacement.md>), [silent-data-corruption](<https://devfeed.tech/tags/silent-data-corruption.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

Silent data corruption can produce plausible GPU results without triggering hardware alarms, so the article adds three checks inside a PyTorch DDP training loop. Before the optimizer update, check each rank's local gradients for NaN or Inf, then check the reduced gradients; ring replay periodically recomputes another node's micro-batch to catch finite errors. Default replay compares loss, while deterministic audits also compare gradient fingerprints and can catch backward-only faults at higher cost. After updates, compare weight fingerprints and always check before checkpointing. A mismatch can identify a suspect only when enough replicas provide a strict majority; fingerprints are strong evidence, not proof. The approach requires at least three GPU nodes, reproducible micro-batches, and shared checkpoint storage. On an alarm, stop and cordon the node, correlate GPU metrics, and replace it after review; resume from a checkpoint saved before the suspect window. The reported tests used software-injected faults on H100 clusters and do not establish precision for other workloads.

### Source excerpt

Silent data corruption is a GPU fault that returns wrong but plausible numbers with no error, quietly poisoning distributed training. This post adds three checks to a PyTorch DDP loop to detect it, localize the faulty node on Amazon SageMaker HyperPod, and hand the node to automatic recovery for replacement.

## The attendee's guide to the AWS re:Invent 2026 AI/ML track

DevFeed: [The attendee's guide to the AWS re:Invent 2026 AI/ML track](<https://devfeed.tech/articles/the-attendee-s-guide-to-the-aws-re-invent-2026-ai-ml-track-129626.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/the-attendees-guide-to-the-aws-reinvent-2026-ai-ml-track/>)

Author: Markus Adhiwiyogo

Published: 2026-11-11T21:05:59Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [AWS AI chips](<https://devfeed.tech/topics/aws-ai-chips.md>), [AWS Trainium](<https://devfeed.tech/topics/aws-trainium.md>), [trust](<https://devfeed.tech/topics/trust.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [neuron](<https://devfeed.tech/topics/neuron.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [human in the loop agent](<https://devfeed.tech/topics/human-in-the-loop-agent.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-chips](<https://devfeed.tech/tags/ai-chips.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-re-invent](<https://devfeed.tech/tags/aws-re-invent.md>), [aws-re-invent-2026](<https://devfeed.tech/tags/aws-re-invent-2026.md>), [build](<https://devfeed.tech/tags/build.md>), [can](<https://devfeed.tech/tags/can.md>), [chips](<https://devfeed.tech/tags/chips.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [goals](<https://devfeed.tech/tags/goals.md>), [guide](<https://devfeed.tech/tags/guide.md>), [helps](<https://devfeed.tech/tags/helps.md>), [inference](<https://devfeed.tech/tags/inference.md>), [ml](<https://devfeed.tech/tags/ml.md>), [models](<https://devfeed.tech/tags/models.md>), [more](<https://devfeed.tech/tags/more.md>), [re-invent](<https://devfeed.tech/tags/re-invent.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

### AI overview

The guide organizes more than 140 AWS re:Invent 2026 AI/ML sessions by topic and experience level, from chips and model training or inference to agent development, trust, sustainability, and deployment locations. It distinguishes recorded 60-minute lecture-style breakouts from interactive, generally non-recorded chalk talks, builder sessions, workshops, and code talks. It maps service choices: Amazon Bedrock provides managed access to models through a unified API, while SageMaker AI supports custom model training, fine-tuning, and deployment; the guide says many customers use both. AgentCore supports agents across model and provider mixes. Session recommendations cover practical tradeoffs such as model quality, speed, cost, capacity, and data residency; governance and observability; and infrastructure factors including latency, sovereignty, compute density, and scale. It also highlights agent safeguards, evaluation, and limits of what can be proven about agent behavior. The article recommends reserving seats early and notes that some sessions may be watched on demand.

### Source excerpt

AWS re:Invent 2026 includes more than 140 AI/ML track sessions. This attendee's guide helps you find the breakouts, chalk talks, workshops, and builders' sessions that fit your role and goals, spanning AI chips, models and inference, agents, agent trust, and sustainability, so you can build a smarter re:Invent schedule.

## Build a multi-team AI and analytics environment on Amazon SageMaker Unified Studio with Terraform

DevFeed: [Build a multi-team AI and analytics environment on Amazon SageMaker Unified Studio with Terraform](<https://devfeed.tech/articles/build-a-multi-team-ai-and-analytics-environment-on-amazon-sagemaker-unified-studio-with-terraform-129559.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/build-a-multi-team-ai-and-analytics-environment-on-amazon-sagemaker-unified-studio-with-terraform/>)

Author: Harshi Surampalli

Published: 2026-11-11T19:58:49Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Terraform](<https://devfeed.tech/topics/terraform.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Cloud Networking](<https://devfeed.tech/topics/cloud-networking.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Amazon Bedrock Knowledge Bases](<https://devfeed.tech/topics/amazon-bedrock-knowledge-bases.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apply](<https://devfeed.tech/tags/apply.md>), [blueprints](<https://devfeed.tech/tags/blueprints.md>), [build](<https://devfeed.tech/tags/build.md>), [code](<https://devfeed.tech/tags/code.md>), [data](<https://devfeed.tech/tags/data.md>), [data-analytics](<https://devfeed.tech/tags/data-analytics.md>), [domains](<https://devfeed.tech/tags/domains.md>), [environment](<https://devfeed.tech/tags/environment.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [governance](<https://devfeed.tech/tags/governance.md>), [studio](<https://devfeed.tech/tags/studio.md>), [team](<https://devfeed.tech/tags/team.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [terraform](<https://devfeed.tech/tags/terraform.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

The Terraform module provisions a shared, governed Amazon SageMaker Unified Studio domain with team-specific project profiles for analytics, machine learning, and generative AI. It combines AWS and AWS Cloud Control providers, enables selected blueprints, and can create least-privilege service roles or use supplied roles; network settings can default to discovery of the default VPC and subnets. The walkthrough requires Terraform 1.7 or later, AWS credentials with resource-management permissions, and Unified Studio in the target Region; IAM Identity Center is needed only for SSO membership. One apply creates the domain, profiles, and an initial project, while further team projects require additional project module blocks or portal creation. Membership supports SSO users and groups plus same-account IAM users and roles. IAM principals need SageMakerStudioUserIAMConsolePolicy or equivalent, which the module does not attach; cross-account role access may be limited and should be verified for the Region. Costs mainly arise from using Redshift Serverless, EMR Serverless, Bedrock, and S3.

### Source excerpt

Learn how to use the Amazon SageMaker Unified Studio Terraform module to provision a multi-team AI and analytics platform (domains, blueprints, project profiles, and projects) for data analytics, machine learning, and generative AI teams in a single terraform apply, with shared governance and least-privilege security defined entirely as code.

## Governance compliance beyond the catalog in Amazon SageMaker Unified Studio

DevFeed: [Governance compliance beyond the catalog in Amazon SageMaker Unified Studio](<https://devfeed.tech/articles/governance-compliance-beyond-the-catalog-in-amazon-sagemaker-unified-studio-129560.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/governance-compliance-beyond-the-catalog-in-amazon-sagemaker-unified-studio/>)

Author: Amom Luiz

Published: 2026-11-11T16:08:47Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data ownership](<https://devfeed.tech/topics/data-ownership.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-eventbridge](<https://devfeed.tech/tags/amazon-eventbridge.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [apis](<https://devfeed.tech/tags/apis.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [forms](<https://devfeed.tech/tags/forms.md>), [glossary](<https://devfeed.tech/tags/glossary.md>), [governance](<https://devfeed.tech/tags/governance.md>), [governance-compliance](<https://devfeed.tech/tags/governance-compliance.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [join](<https://devfeed.tech/tags/join.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [policy](<https://devfeed.tech/tags/policy.md>), [score](<https://devfeed.tech/tags/score.md>), [subscription](<https://devfeed.tech/tags/subscription.md>), [table](<https://devfeed.tech/tags/table.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

The post describes a daily enrichment pipeline that joins SageMaker Unified Studio's asset metadata export with catalog APIs and an S3 policy file, then writes per-asset governance records to an Iceberg table. It combines built-in required-form rules from GetAssetType with organization-defined requirements, and adds glossary associations, data quality signals, descriptions, and active subscription counts. Teams can query weighted compliance scores and trends in Athena, build Quick Sight dashboards, and schedule alerts; subscription counts help prioritize low-scoring assets with wider use. The five score dimensions and weights are configurable examples, not prescribed policy, and organizations must define what compliance means for them. The sample test processed 29 Glue table assets in about 30 seconds; the post suggests parallelization, more Lambda memory, or Step Functions for larger catalogs.

### Source excerpt

Amazon SageMaker provides rich governance signals such as metadata forms, data quality scores, glossary coverage, and subscription data, but they live in separate APIs. This post shows how to join them into a single enriched Iceberg table and build a compliance scorecard you can query, score, and adapt to your governance policy.

## Introducing the Workday Data Cloud integration with AWS

DevFeed: [Introducing the Workday Data Cloud integration with AWS](<https://devfeed.tech/articles/introducing-the-workday-data-cloud-integration-with-aws-126347.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/introducing-the-workday-data-cloud-integration-with-aws/>)

Author: Poornima Chand

Published: 2026-11-09T22:21:40Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-powered](<https://devfeed.tech/tags/ai-powered.md>), [ai-services](<https://devfeed.tech/tags/ai-services.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-integration](<https://devfeed.tech/tags/cloud-integration.md>), [data](<https://devfeed.tech/tags/data.md>), [data-cloud](<https://devfeed.tech/tags/data-cloud.md>), [developers](<https://devfeed.tech/tags/developers.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [money](<https://devfeed.tech/tags/money.md>), [people](<https://devfeed.tech/tags/people.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [services](<https://devfeed.tech/tags/services.md>), [workday](<https://devfeed.tech/tags/workday.md>), [zero-copy](<https://devfeed.tech/tags/zero-copy.md>)

### AI overview

Workday Data Cloud and AWS provide bidirectional, zero-copy access to governed data: Workday can query Iceberg tables in S3 through a federated AWS Glue Data Catalog, while AWS services can query Workday data. For near real-time operational queries, Live Data Query runs SQL within Workday's governed environment and returns results to AWS. For broader analytics, ML training, and exploration, Workday Data Connect exposes data as Apache Iceberg tables; compute runs in AWS while the data stays in Workday. Lake Formation governs AWS-side access, and Workday security controls access to Workday data and federated tables. The article says the integration is generally available and describes setup through SageMaker Unified Studio, Glue, Lake Formation, Athena, EMR, Redshift, and Workday Data Cloud.

### Source excerpt

Workday Data Cloud now integrates with AWS, giving developers bi-directional, zero-copy access to Workday's governed people and money data from the AWS analytics and AI services they already use, without brittle pipelines or data duplication.

## NVIDIA Nemotron 3.5 Super VL is now available in Amazon SageMaker JumpStart

DevFeed: [NVIDIA Nemotron 3.5 Super VL is now available in Amazon SageMaker JumpStart](<https://devfeed.tech/articles/nvidia-nemotron-3-5-super-vl-is-now-available-in-amazon-sagemaker-jumpstart-125097.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/nvidia-nemotron-3-5-super-vl-is-now-available-in-amazon-sagemaker-jumpstart/>)

Author: Venu Kanamatareddy

Published: 2026-11-09T20:01:20Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker JumpStart](<https://devfeed.tech/topics/amazon-sagemaker-jumpstart.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [post-training](<https://devfeed.tech/topics/post-training.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [agents](<https://devfeed.tech/tags/agents.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-jumpstart](<https://devfeed.tech/tags/amazon-sagemaker-jumpstart.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [bf16](<https://devfeed.tech/tags/bf16.md>), [computer-use](<https://devfeed.tech/tags/computer-use.md>), [document-intelligence](<https://devfeed.tech/tags/document-intelligence.md>), [image](<https://devfeed.tech/tags/image.md>), [inference](<https://devfeed.tech/tags/inference.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nemotron-3-5](<https://devfeed.tech/tags/nemotron-3-5.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-nemotron-3-5-super-vl](<https://devfeed.tech/tags/nvidia-nemotron-3-5-super-vl.md>), [text](<https://devfeed.tech/tags/text.md>), [variant](<https://devfeed.tech/tags/variant.md>), [video](<https://devfeed.tech/tags/video.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vision-language-model](<https://devfeed.tech/tags/vision-language-model.md>)

### AI overview

NVIDIA Nemotron 3.5 Super VL is available through SageMaker JumpStart in NVFP4 and BF16 variants. It accepts text, images, and video and generates text; the 120B-parameter model has 12B active parameters and supports configurable reasoning. NVFP4 is the default option for G7 instances, while BF16 reference weights run on P5en with H200 GPUs and can be downloaded for customization. The reported performance measurements use different GPU systems, so they do not isolate the effect of precision. Deployment requires endpoint permissions and instance quota; new accounts start with zero G7 quota, and the SDK path requires SageMaker Python SDK v3.25 or later. For inference, media must be sent inline as base64 because endpoints have network isolation. PDFs must be rendered to images, and requests accept one image and one video. Context limits vary by serving configuration; video frame sampling is fixed at endpoint launch, and reasoning-enabled video requests need at least 8,192 max tokens. The deployed configuration includes an MTP head but does not enable speculative decoding.

### Source excerpt

NVIDIA Nemotron 3.5 Super VL, a 120B-parameter multimodal vision-language model, is now available in Amazon SageMaker JumpStart. Deploy the NVFP4 or BF16 variant in a few steps, then run text, image, and video inference for document intelligence, computer-use agents, and multimodal agentic workloads.

## SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

DevFeed: [SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints](<https://devfeed.tech/articles/sagemaker-inference-now-supports-multi-instance-gpu-to-maximize-gpu-utilization-for-model-endpoints-121744.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/sagemaker-inference-now-supports-multi-instance-gpu-to-maximize-gpu-utilization-for-model-endpoints/>)

Author: Shantanu Tripathi

Published: 2026-11-06T18:01:00Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [api](<https://devfeed.tech/tags/api.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-partitioning](<https://devfeed.tech/tags/gpu-partitioning.md>), [gpu-utilization](<https://devfeed.tech/tags/gpu-utilization.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [mig](<https://devfeed.tech/tags/mig.md>), [model](<https://devfeed.tech/tags/model.md>), [multi-instance-gpu](<https://devfeed.tech/tags/multi-instance-gpu.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [partitions](<https://devfeed.tech/tags/partitions.md>)

### AI overview

SageMaker Inference uses NVIDIA MIG to split GPUs into hardware-isolated partitions, letting inference components run separate models on one endpoint or request a fraction of a newer accelerator. Configure layouts with `AcceleratorPartitionLayouts` on the production variant and select a declared slice with `AcceleratorPartitionType` on each component; invocation stays the same. Layouts are chosen at endpoint creation, and changing a carve or component profile requires new resources. Support is limited to inference component real-time endpoints on P4d, P5, G7, and G7e; serverless, heterogeneous pools, and async invocation are excluded. Models needing multiple GPUs still require whole devices, and billing remains for the full instance. In a test of one H100 `mig-3g.40gb` slice against a whole A100-40GB running Llama-3.1-8B-Instruct, the slice had higher output throughput and lower latency across tested traffic shapes. It was 18-34% cheaper per million output tokens above workload-dependent concurrency crossovers; below them, the A100 was cheaper. The results are workload-specific, so profile choice depends on compute, memory, context length, and concurrency needs.

### Source excerpt

Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator. This post shows how two optional API fields place one model per partition, and what we measured against a whole older GPU.

## How Amazon Marketplace evaluates content quality with Amazon SageMaker AI

DevFeed: [How Amazon Marketplace evaluates content quality with Amazon SageMaker AI](<https://devfeed.tech/articles/how-amazon-marketplace-evaluates-content-quality-with-amazon-sagemaker-ai-119744.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/how-amazon-marketplace-evaluates-content-quality-with-amazon-sagemaker-ai/>)

Author: James Kim

Published: 2026-11-05T18:06:43Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [catboost](<https://devfeed.tech/topics/catboost.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [Amazon SageMaker JumpStart](<https://devfeed.tech/topics/amazon-sagemaker-jumpstart.md>), [lora](<https://devfeed.tech/topics/lora.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-marketplace](<https://devfeed.tech/tags/amazon-marketplace.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [catboost](<https://devfeed.tech/tags/catboost.md>), [content](<https://devfeed.tech/tags/content.md>), [expert-400](<https://devfeed.tech/tags/expert-400.md>), [language](<https://devfeed.tech/tags/language.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [marketplace](<https://devfeed.tech/tags/marketplace.md>), [model](<https://devfeed.tech/tags/model.md>), [ocr](<https://devfeed.tech/tags/ocr.md>), [partners](<https://devfeed.tech/tags/partners.md>), [product](<https://devfeed.tech/tags/product.md>), [quality](<https://devfeed.tech/tags/quality.md>), [readability](<https://devfeed.tech/tags/readability.md>), [recommendations](<https://devfeed.tech/tags/recommendations.md>), [rendering](<https://devfeed.tech/tags/rendering.md>), [scale](<https://devfeed.tech/tags/scale.md>), [shap](<https://devfeed.tech/tags/shap.md>)

### AI overview

Amazon Marketplace evaluates A+ Content holistically by rendering a product detail page as one snapshot and scoring it with a rubric prompted to a fixed vision-language model (VLM). Rather than fine-tune that model, the system feeds its four rubric scores and four OCR readability signals into CatBoost trained on expert labels; OCR adds layout-based measures such as text and character density and spacing, which complement the VLM's broader semantic and visual assessment. On a 20% holdout of 5,478 pages across 10 categories, the fused model reached 0.94 accuracy and 0.95 F1, versus 0.89 and 0.90 for VLM-only CatBoost and 0.80 and 0.84 for the averaged-score baseline. SHAP ranks factors behind each decision, and an LLM uses negative contributions, category context, best practices, and VLM rationales to prioritize seller recommendations. Revisions were associated with a statistically significant average 1.4-point quality-score increase on a 10-point scale. The described SageMaker deployment supports real-time, asynchronous, or batch VLM scoring; the authors note expert labels may not represent every category, language, or marketplace.

### Source excerpt

Learn how Amazon Marketplace evaluates A+ Content quality at scale on Amazon SageMaker AI by rendering each product page as a single snapshot, scoring it with a vision-language model fused with OCR readability signals in a CatBoost classifier, and using SHAP to turn each decision into prioritized, actionable recommendations for selling partners.

## Building ultra-low-latency voice AI applications on AWS

DevFeed: [Building ultra-low-latency voice AI applications on AWS](<https://devfeed.tech/articles/building-ultra-low-latency-voice-ai-applications-on-aws-115498.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/building-ultra-low-latency-voice-ai-applications-on-aws/>)

Author: Nolan Chen

Published: 2026-11-03T16:40:54Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Conversational AI](<https://devfeed.tech/topics/conversational-ai.md>), [Real-time AI interactions](<https://devfeed.tech/topics/real-time-ai-interactions.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Amazon Connect](<https://devfeed.tech/topics/amazon-connect.md>), [Amazon SageMaker JumpStart](<https://devfeed.tech/topics/amazon-sagemaker-jumpstart.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [amazon-connect](<https://devfeed.tech/tags/amazon-connect.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [aws](<https://devfeed.tech/tags/aws.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [has](<https://devfeed.tech/tags/has.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [low-latency-voice-ai](<https://devfeed.tech/tags/low-latency-voice-ai.md>), [sonic](<https://devfeed.tech/tags/sonic.md>), [speech](<https://devfeed.tech/tags/speech.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [text-to-speech](<https://devfeed.tech/tags/text-to-speech.md>), [voice](<https://devfeed.tech/tags/voice.md>), [voice-ai](<https://devfeed.tech/tags/voice-ai.md>)

### AI overview

Cartesia's Sonic and Ink use State Space Models for streaming voice workloads, with the article reporting approximately 90 ms first audio byte for Sonic and sub-100 ms first-byte latency for both models. Sonic generates speech before receiving all the text; Ink streams partial transcripts and provides semantic turn detection without a separate voice activity detection model. Sonic can run as an AWS Marketplace model package on a managed, in-VPC SageMaker AI endpoint, which the article presents as the faster path with less operational overhead. Alternatively, teams can run Cartesia's container on EC2 GPU infrastructure for more control over runtime, networking, and scaling, while taking responsibility for provisioning, updates, monitoring, and capacity tuning. The deployment instructions cover Sonic; Ink is available through the Cartesia API.

### Source excerpt

Learn how Cartesia, an AWS Partner, uses purpose-built State Space Models and AWS infrastructure to deliver sub-100ms text-to-speech and speech-to-text at global scale, and how to deploy its Sonic model on Amazon SageMaker AI or self-managed Amazon EC2 GPU instances.

## Migrate Google BigQuery to an open lakehouse on AWS with Apache Iceberg

DevFeed: [Migrate Google BigQuery to an open lakehouse on AWS with Apache Iceberg](<https://devfeed.tech/articles/migrate-google-bigquery-to-an-open-lakehouse-on-aws-with-apache-iceberg-114202.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/migrate-google-bigquery-to-an-open-lakehouse-on-aws-with-apache-iceberg/>)

Author: Saman Irfan

Published: 2026-11-02T17:21:17Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon Bedrock Knowledge Bases](<https://devfeed.tech/topics/amazon-bedrock-knowledge-bases.md>), [AWS Step Functions](<https://devfeed.tech/topics/aws-step-functions.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Amazon MSK](<https://devfeed.tech/topics/amazon-msk.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [data](<https://devfeed.tech/tags/data.md>), [design](<https://devfeed.tech/tags/design.md>), [future](<https://devfeed.tech/tags/future.md>), [google](<https://devfeed.tech/tags/google.md>), [google-bigquery](<https://devfeed.tech/tags/google-bigquery.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [migrate](<https://devfeed.tech/tags/migrate.md>), [migration](<https://devfeed.tech/tags/migration.md>), [open](<https://devfeed.tech/tags/open.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [over](<https://devfeed.tech/tags/over.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

The article presents a phased path from BigQuery to an AWS lakehouse using Apache Iceberg tables on Amazon S3, with governance through AWS Glue Data Catalog and Lake Formation and engines selected by workload. It recommends assessing tables, query complexity, consumers, volumes, and access controls; designing storage, partitioning, ingestion, and governance; then converting a representative slice and validating results, performance, and cost. For bulk transfer, export BigQuery tables to Parquet in Google Cloud Storage, move them to S3 with AWS DataSync, create or register Iceberg tables, and synchronize incremental changes during transition. Cutover includes parallel validation and deciding whether each consumer will reconnect, be rebuilt, or relay data. The article distinguishes managed S3 Tables, which handle maintenance automatically, from self-managed Iceberg on general-purpose S3, which requires tuning. It also cautions that BigQuery scan-based and Redshift compute-based pricing are not directly comparable, recommending workload-based benchmarks and monthly TCO estimates. Post-migration steps include query and cost optimization.

### Source excerpt

Learn how to migrate Google BigQuery workloads to an open lakehouse on AWS built on Apache Iceberg and Amazon S3. This post explains why an open lakehouse future-proofs your data, presents the target architecture on AWS, and walks through a step-by-step migration: assess, design, convert, migrate, cut over, and optimize.

## Build efficient agents with knowledge distillation on Amazon SageMaker AI

DevFeed: [Build efficient agents with knowledge distillation on Amazon SageMaker AI](<https://devfeed.tech/articles/build-efficient-agents-with-knowledge-distillation-on-amazon-sagemaker-ai-113557.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/build-efficient-agents-with-knowledge-distillation-on-amazon-sagemaker-ai/>)

Author: Giuseppe Zappia

Published: 2026-11-02T17:01:31Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [lora](<https://devfeed.tech/topics/lora.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Loop Engineering](<https://devfeed.tech/topics/loop-engineering.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [build](<https://devfeed.tech/tags/build.md>), [cost](<https://devfeed.tech/tags/cost.md>), [distillation](<https://devfeed.tech/tags/distillation.md>), [frontier](<https://devfeed.tech/tags/frontier.md>), [frontier-models](<https://devfeed.tech/tags/frontier-models.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [knowledge-distillation](<https://devfeed.tech/tags/knowledge-distillation.md>), [models](<https://devfeed.tech/tags/models.md>), [post](<https://devfeed.tech/tags/post.md>), [prices](<https://devfeed.tech/tags/prices.md>), [production](<https://devfeed.tech/tags/production.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Sequence-level knowledge distillation can transfer multi-step agent behavior into a smaller model using only a frontier teacher's text outputs. In the described SageMaker AI workflow, GLM-5.3 generates shopping-agent trajectories; ShoppingBench's scorer filters for solved runs, whose reasoning and tool calls train a Qwen3.5-4B student with serverless supervised fine-tuning. On one held-out run, the student reached 0.541 average success rate, close to the greedy teacher's 0.540; removing reasoning from training targets reduced the student's score to 0.415. Specialization came with lower IFEval scores, and SeqKD can plateau on hard problems where the agent must recover from its own mistakes. The post recommends checking tool selection before costly end-to-end evaluation, testing on held-out tasks against strong references, and considering on-policy training to address the hardest cases. It reports no universal per-task cost or latency: endpoint instance costs are hourly, while API teacher costs accrue per token, so economics depend on workload and pricing.

### Source excerpt

Agentic assistants built on frontier models run a multi-step tool loop, and paying frontier prices on every step is hard to sustain at production scale. This post shows how to use sequence-level knowledge distillation (SeqKD) to transfer a frontier teacher's agentic behavior into a small, lower-cost student on Amazon SageMaker AI.

## Lend and borrow resources across teams with AWS Batch's quota management for SageMaker Training jobs

DevFeed: [Lend and borrow resources across teams with AWS Batch's quota management for SageMaker Training jobs](<https://devfeed.tech/articles/lend-and-borrow-resources-across-teams-with-aws-batch-s-quota-management-for-sagemaker-training-jobs-106876.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/lend-and-borrow-resources-across-teams-with-aws-batchs-quota-management-for-sagemaker-training-jobs/>)

Author: Michelle Goodstein

Published: 2026-10-29T16:58:57Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [scheduling](<https://devfeed.tech/topics/scheduling.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [all](<https://devfeed.tech/tags/all.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [batch](<https://devfeed.tech/tags/batch.md>), [can](<https://devfeed.tech/tags/can.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [first](<https://devfeed.tech/tags/first.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [management](<https://devfeed.tech/tags/management.md>), [priority](<https://devfeed.tech/tags/priority.md>), [project](<https://devfeed.tech/tags/project.md>), [quota](<https://devfeed.tech/tags/quota.md>), [resources](<https://devfeed.tech/tags/resources.md>), [run](<https://devfeed.tech/tags/run.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [teams](<https://devfeed.tech/tags/teams.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [training](<https://devfeed.tech/tags/training.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

AWS Batch quota management lets administrators allocate GPU capacity among teams or projects while sharing idle capacity automatically. Shares can reserve idle capacity (RESERVE), lend it (LEND), or lend and borrow it (LEND_AND_BORROW); when capacity is needed by its owner, AWS Batch can reclaim lent resources through cross-share preemption. Optional in-share preemption lets higher-priority jobs displace lower-priority jobs in SCHEDULED, STARTING, or RUNNING state. The examples show different tradeoffs: a background-work share lends and borrows with preemption enabled; a medium-priority share accepts borrowed-capacity reclamation but disables in-share preemption; and an interruption-sensitive share reserves capacity and neither lends nor borrows. Setup requires a Scheduling Policy with quotaSharePolicy, a Service Environment with instance capacity limits, and a SageMaker Training job queue connected to both. The example uses SageMaker Python SDK v3; AWS account permissions to manage Batch resources are also required.

### Source excerpt

AWS Batch quota management is a new scheduling capability you can use to divide GPU capacity into quota shares per team or project, automatically lend idle capacity across shares, and use preemption to run your highest-priority SageMaker Training jobs first, all without manual coordination.

## Announcing SOCI-indexed images for faster SageMaker AI jobs

DevFeed: [Announcing SOCI-indexed images for faster SageMaker AI jobs](<https://devfeed.tech/articles/announcing-soci-indexed-images-for-faster-sagemaker-ai-jobs-102787.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/announcing-soci-indexed-images-for-faster-sagemaker-ai-jobs/>)

Author: Kanwaljit Khurmi

Published: 2026-10-27T17:00:39Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [container images](<https://devfeed.tech/topics/container-images.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [container-image](<https://devfeed.tech/tags/container-image.md>), [download](<https://devfeed.tech/tags/download.md>), [faster](<https://devfeed.tech/tags/faster.md>), [indexing](<https://devfeed.tech/tags/indexing.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [lazy](<https://devfeed.tech/tags/lazy.md>), [oci](<https://devfeed.tech/tags/oci.md>), [processing](<https://devfeed.tech/tags/processing.md>)

### AI overview

SOCI indexing lets SageMaker AI Training and Processing jobs start from Amazon ECR images before downloading the full image: the runtime fetches startup files first and streams the rest as needed. In the reported benchmarks, lazy loading reduced image startup from minutes to 3-11 seconds across images from 1.8 to 35.4 GB; full jobs finished 1-6 minutes sooner. Later-epoch training speed was unchanged, while the first epoch took 3-16 seconds longer as files were fetched. Savings may be small for images under roughly 4 GB or workloads that read most of the image before training. Adoption requires an indexed image: use a pre-indexed AWS Deep Learning Container with the "-soci" tag or create an index for a custom image. Job definitions and APIs need no changes. Images must be in Amazon ECR private repositories; images from other registries or pulled through a private Docker registry are ineligible.

### Source excerpt

Seekable OCI (SOCI) indexing for Amazon SageMaker AI training and processing jobs takes full container image download off the critical path. SageMaker AI lazy-loads your image to start containers in seconds instead of minutes, with no changes to your job definition. See the benchmarks and how to adopt it.

[Next page](<https://devfeed.tech/topics/amazon-sagemaker.md?cursor=WyIyMDI2LTEwLTI3VDE3OjAwOjM5KzAwOjAwIiwgIjNhNzkxNTljLWE1N2EtNDBkNS05M2QyLWM5MzA2ZjFhZGNmOCJd>)