# AWS HPC Blog

Just another Amazon Web Services site

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## How Regeneron built a multi-executor Omics platform with intelligent resource management on AWS

DevFeed: [How Regeneron built a multi-executor Omics platform with intelligent resource management on AWS](<https://devfeed.tech/articles/how-regeneron-built-a-multi-executor-omics-platform-with-intelligent-resource-management-on-aws-117620.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-regeneron-built-a-multi-executor-omics-platform-with-intelligent-resource-management-on-aws/>)

Author: Siddhesh Salunke

Published: 2026-11-03T20:34:05Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [Amazon Elastic Kubernetes Service](<https://devfeed.tech/topics/amazon-elastic-kubernetes-service.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>), [Amazon VPC](<https://devfeed.tech/topics/amazon-vpc.md>), [Amazon Elastic Block Store (Amazon EBS)](<https://devfeed.tech/topics/amazon-elastic-block-store-amazon-ebs.md>)

Tags: [accessible](<https://devfeed.tech/tags/accessible.md>), [amazon-elastic-kubernetes-service](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service.md>), [amazon-fsx-for-lustre](<https://devfeed.tech/tags/amazon-fsx-for-lustre.md>), [amazon-vpc](<https://devfeed.tech/tags/amazon-vpc.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [core](<https://devfeed.tech/tags/core.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [executor](<https://devfeed.tech/tags/executor.md>), [genomics](<https://devfeed.tech/tags/genomics.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [like](<https://devfeed.tech/tags/like.md>), [managed](<https://devfeed.tech/tags/managed.md>), [management](<https://devfeed.tech/tags/management.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [pharmaceuticals](<https://devfeed.tech/tags/pharmaceuticals.md>), [platform](<https://devfeed.tech/tags/platform.md>), [post](<https://devfeed.tech/tags/post.md>), [processes](<https://devfeed.tech/tags/processes.md>), [resource](<https://devfeed.tech/tags/resource.md>), [resource-management](<https://devfeed.tech/tags/resource-management.md>), [storage](<https://devfeed.tech/tags/storage.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Regeneron runs Nextflow genomics workflows from an AWS ParallelCluster head node and routes individual processes to SLURM, AWS Batch, or EKS using labels, letting workloads use different backends without pipeline code changes. The backends share FSx for Lustre; persistent container and reference caches sit there, while intermediate files use local NVMe. Regeneron's Haizi Bot scores each sample from FASTQ metrics, predicts resource needs from prior executions, and generates per-run Nextflow configurations according to cost, speed, and cluster conditions. Its cost mode favors Spot capacity and reports up to 60% lower cost; its time mode uses On-Demand resources and reports 30% faster completion, both against static allocation in internal benchmarks. The post also reports 95% pre-run cost-prediction accuracy. These figures are Regeneron-reported; the post is an architecture deep-dive, not a step-by-step tutorial.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. Regeneron Pharmaceuticals processes thousands of genomic samples each week, using Nextflow as a core part of its scientific computing infrastructure. When its genomics workloads like ATAC-seq (Assay for Transposase-Accessible [...]

## What's next for Research and Engineering Studio on AWS

DevFeed: [What's next for Research and Engineering Studio on AWS](<https://devfeed.tech/articles/what-s-next-for-research-and-engineering-studio-on-aws-62189.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/whats-next-for-research-and-engineering-studio-on-aws/>)

Author: Charlie Chuang

Published: 2026-09-30T01:11:00Z

Content type: news

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon WorkSpaces](<https://devfeed.tech/topics/amazon-workspaces.md>), [Cloud and systems](<https://devfeed.tech/topics/cloud-and-systems.md>), [ESP-IDF Extension for vs Code](<https://devfeed.tech/topics/esp-idf-extension-for-vs-code.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon-appstream-2-0](<https://devfeed.tech/tags/amazon-appstream-2-0.md>), [amazon-dcv](<https://devfeed.tech/tags/amazon-dcv.md>), [amazon-workspaces](<https://devfeed.tech/tags/amazon-workspaces.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [compute](<https://devfeed.tech/tags/compute.md>), [dcv](<https://devfeed.tech/tags/dcv.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [managed-services](<https://devfeed.tech/tags/managed-services.md>), [ml](<https://devfeed.tech/tags/ml.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-software](<https://devfeed.tech/tags/open-source-software.md>), [partner-solutions](<https://devfeed.tech/tags/partner-solutions.md>), [published](<https://devfeed.tech/tags/published.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [security](<https://devfeed.tech/tags/security.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

AWS is discontinuing development of Research and Engineering Studio on AWS (RES), with release 2026.09 as the final release. RES will remain open source under Apache 2.0, and existing deployments can continue running. After the final release reaches its end-of-support date, AWS will stop providing technical support and security updates. Users can maintain RES themselves, work with a partner, or consider AWS managed services; the listed services are not drop-in replacements.

### Source excerpt

This post was contributed by Charlie Chuang, Madhu Vellakal, and Charunethran Panchalam Govindarajan. Since launching Research and Engineering Studio on AWS (RES), we have helped customers stand up self-service portals for research, engineering, and technical computing on AWS. As this space has matured, with a strong ecosystem of AWS Partners and complementary AWS services, we [...]

## Part 1: Managing Large-Scale LLM Training with AWS ParallelCluster

DevFeed: [Part 1: Managing Large-Scale LLM Training with AWS ParallelCluster](<https://devfeed.tech/articles/part-1-managing-large-scale-llm-training-with-aws-parallelcluster-50154.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/part-1-managing-large-scale-llm-training-with-aws-parallelcluster/>)

Author: Seokjae Jang

Published: 2026-08-25T22:33:54Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Computing](<https://devfeed.tech/topics/computing.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [YAML](<https://devfeed.tech/topics/yaml.md>)

Tags: [ai-research](<https://devfeed.tech/tags/ai-research.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [compute](<https://devfeed.tech/tags/compute.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [experience-based-acceleration](<https://devfeed.tech/tags/experience-based-acceleration.md>), [government](<https://devfeed.tech/tags/government.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-infrastructure](<https://devfeed.tech/tags/gpu-infrastructure.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-training](<https://devfeed.tech/tags/llm-training.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [teams](<https://devfeed.tech/tags/teams.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This post shares operational lessons from building a large-scale GPU cluster for LLM training by using AWS ParallelCluster and FSx for Lustre. It covers resource stability, cluster configuration, storage and networking integration, Slurm scheduling, and practical strategies for managing long-running training workloads.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. Introduction The Korean Government announced a national AI initiative to provide high-performance GPU infrastructure for Korea's national AI research teams. AWS was selected as a supplier of GPU resources [...]

## Resilient HPC and ML on AWS: Running Tightly Coupled Workloads on Spot Instances

DevFeed: [Resilient HPC and ML on AWS: Running Tightly Coupled Workloads on Spot Instances](<https://devfeed.tech/articles/resilient-hpc-and-ml-on-aws-running-tightly-coupled-workloads-on-spot-instances-50156.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/resilient-hpc-and-ml-on-aws-running-tightly-coupled-workloads-on-spot-instances/>)

Author: Santosh Kumar

Published: 2026-08-05T00:00:55Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Computational Fluid Dynamics (CFD)](<https://devfeed.tech/topics/cfd.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>), [GROMACS](<https://devfeed.tech/topics/gromacs.md>), [Molecular Dynamics](<https://devfeed.tech/topics/molecular-dynamics.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>)

Tags: [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-elastic-file-system-efs](<https://devfeed.tech/tags/amazon-elastic-file-system-efs.md>), [amazon-fsx-for-lustre](<https://devfeed.tech/tags/amazon-fsx-for-lustre.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [availability](<https://devfeed.tech/tags/availability.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-fault-injection-service-fis](<https://devfeed.tech/tags/aws-fault-injection-service-fis.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cfd](<https://devfeed.tech/tags/cfd.md>), [computational-fluid-dynamics](<https://devfeed.tech/tags/computational-fluid-dynamics.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [cost](<https://devfeed.tech/tags/cost.md>), [developer-tools](<https://devfeed.tech/tags/developer-tools.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [gromacs](<https://devfeed.tech/tags/gromacs.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [ml](<https://devfeed.tech/tags/ml.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [storage](<https://devfeed.tech/tags/storage.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This AWS post presents an architecture for running tightly coupled, long-running HPC and machine learning workloads on Amazon EC2 Spot Instances. It addresses interruption risk through checkpointing and demonstrates the approach with CFD and GROMACS workloads.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. This post was contributed by Santosh Kumar, Bhagyaraju Kasina, Dr. Sandeep Sovani and Dr. Max Starr Researchers and engineering teams running High Performance Computing (HPC) jobs face a constant [...]

## Transforming HPC Operations with Intelligent Workload Orchestration on AWS

DevFeed: [Transforming HPC Operations with Intelligent Workload Orchestration on AWS](<https://devfeed.tech/articles/transforming-hpc-operations-with-intelligent-workload-orchestration-on-aws-50160.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/transforming-hpc-operations-with-intelligent-workload-orchestration-on-aws/>)

Author: Manu Pillai

Published: 2026-06-26T00:15:47Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Langgraph](<https://devfeed.tech/topics/langgraph.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon Bedrock AgentCore](<https://devfeed.tech/topics/amazon-bedrock-agentcore.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [compute](<https://devfeed.tech/tags/compute.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [langgraph](<https://devfeed.tech/tags/langgraph.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

This tutorial presents an intelligent, agentic workload orchestration architecture for high-performance computing on AWS. It describes workload routing, failure diagnosis, self-healing, and continuous optimization using AWS Parallel Computing Service, LangGraph, Amazon Bedrock LLMs, and Amazon Bedrock AgentCore Runtime.

### Source excerpt

This post was contributed by Manu Pillai, Gloria Macia and Natalia Jimenez, PhD Organizations running high-performance computing (HPC) workloads today operate largely as they have for decades: users manually specify required compute specifications for each of their jobs. Users spend valuable time analyzing workload requirements, selecting instance types, and troubleshooting infrastructure issues - time that [...]

## Reducing costs by 50% while processing population-scale genomics with Mountpoint for Amazon S3 and AWS Batch

DevFeed: [Reducing costs by 50% while processing population-scale genomics with Mountpoint for Amazon S3 and AWS Batch](<https://devfeed.tech/articles/reducing-costs-by-50-while-processing-population-scale-genomics-with-mountpoint-for-amazon-s3-and-aws-batch-50155.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/reducing-costs-by-50-while-processing-population-scale-genomics-with-mountpoint-for-amazon-s3-and-aws-batch/>)

Author: Kambiz Shahim

Published: 2026-06-08T13:51:05Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Cloud Architecture](<https://devfeed.tech/topics/cloud-architecture.md>), [Bioinformatics](<https://devfeed.tech/topics/bioinformatics.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [compute](<https://devfeed.tech/tags/compute.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [genomics](<https://devfeed.tech/tags/genomics.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Oxford Nanopore Technologies built EPI2ME Cloud using Mountpoint for Amazon S3, AWS Batch, and Nextflow to process human genomes at population scale. The architecture uploads sequencing data to S3, triggers pipeline execution through AWS Batch, and reportedly reduces computational costs by 50%.

### Source excerpt

This post was contributed by Kambiz Shahim, Ankit Kalyani, and Chris Wright. Oxford Nanopore Technologies used Mountpoint for Amazon S3, AWS Batch, and Nextflow to build EPI2ME Cloud, a managed compute environment for processing human genomes at population-scale reliably and securely while reducing computational costs by 50%. EPI2ME Cloud forms Oxford Nanopore's suite of local [...]

## Monitoring AWS Parallel Computing Service

DevFeed: [Monitoring AWS Parallel Computing Service](<https://devfeed.tech/articles/monitoring-aws-parallel-computing-service-50159.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/the-complete-picture-unified-monitoring-for-aws-parallel-computing-service/>)

Author: Ronald Hudson

Published: 2026-06-02T16:29:06Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Computing](<https://devfeed.tech/topics/computing.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Grafana](<https://devfeed.tech/topics/grafana.md>), [Grafana Cloud Metrics](<https://devfeed.tech/topics/grafana-cloud-metrics.md>), [Amazon Managed Service for Prometheus](<https://devfeed.tech/topics/amazon-managed-service-for-prometheus.md>), [Parallelism](<https://devfeed.tech/topics/parallelism.md>), [Amazon CloudWatch Logs](<https://devfeed.tech/topics/amazon-cloudwatch-logs.md>), [OpenTelemetry](<https://devfeed.tech/topics/opentelemetry.md>)

Tags: [amazon-cloudwatch-logs](<https://devfeed.tech/tags/amazon-cloudwatch-logs.md>), [amazon-managed-grafana](<https://devfeed.tech/tags/amazon-managed-grafana.md>), [amazon-managed-service-for-prometheus](<https://devfeed.tech/tags/amazon-managed-service-for-prometheus.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-distro-for-opentelemetry](<https://devfeed.tech/tags/aws-distro-for-opentelemetry.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [collector](<https://devfeed.tech/tags/collector.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [grafana](<https://devfeed.tech/tags/grafana.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>)

### AI overview

This AWS post presents a unified observability solution for AWS Parallel Computing Service environments. It combines Amazon Managed Grafana, Amazon Managed Service for Prometheus, CloudWatch Logs, exporters, and AWS Distro for OpenTelemetry to provide dashboards for cluster resources, job performance, and diagnostic data.

### Source excerpt

This post was contributed by Ronald Hudson and Nate Haynes High Performance Computing (HPC) on AWS demands precise monitoring, like the racing telemetry used by Formula 1 teams to deliver results. Like race engineers tracking car performance, AWS Parallel Computing Service (AWS PCS) administrators must monitor computing metrics in real-time. This vigilance is critical because [...]

## High Throughput Scheduling for Financial Services with YellowDog HTS on AWS

DevFeed: [High Throughput Scheduling for Financial Services with YellowDog HTS on AWS](<https://devfeed.tech/articles/high-throughput-scheduling-for-financial-services-with-yellowdog-hts-on-aws-50147.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/high-throughput-scheduling-for-financial-services-with-yellowdog-hts-on-aws/>)

Author: Kirill Bogdanov

Published: 2026-05-04T22:53:06Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [scheduling](<https://devfeed.tech/topics/scheduling.md>), [Computing](<https://devfeed.tech/topics/computing.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Risk](<https://devfeed.tech/topics/risk.md>)

Tags: [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [aws](<https://devfeed.tech/tags/aws.md>), [batch](<https://devfeed.tech/tags/batch.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [control-plane](<https://devfeed.tech/tags/control-plane.md>), [fsi](<https://devfeed.tech/tags/fsi.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [performance](<https://devfeed.tech/tags/performance.md>), [scale](<https://devfeed.tech/tags/scale.md>), [scheduler](<https://devfeed.tech/tags/scheduler.md>), [scheduling](<https://devfeed.tech/tags/scheduling.md>), [tasks](<https://devfeed.tech/tags/tasks.md>)

### AI overview

This AWS post evaluates YellowDog High Throughput Scheduling, a scheduling architecture for massively parallel financial-services workloads. It describes multi-region resource orchestration, Amazon EC2 Spot capacity, and reported throughput of 40,000 tasks per second.

### Source excerpt

This post was contributed by Kirill Bogdanov (Pr. Solutions Architect at AWS) and Alan Parry, (CTO at YellowDog). Large-scale compute grids sit at the heart of modern financial services operations. They power overnight batch runs for regulatory risk and prepare traders for the coming day. During trading, the same grids drive intraday 'value at risk' [...]

## Cost-effective and scalable Oxford Nanopore Technologies primary analysis with Nextflow and Amazon EC2 G Instances

DevFeed: [Cost-effective and scalable Oxford Nanopore Technologies primary analysis with Nextflow and Amazon EC2 G Instances](<https://devfeed.tech/articles/cost-effective-and-scalable-oxford-nanopore-technologies-primary-analysis-with-nextflow-and-amazon-ec2-g-instances-50144.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/cost-effective-and-scalable-oxford-nanopore-technologies-primary-analysis-with-nextflow-and-amazon-ec2-g-instances/>)

Author: Michael Mueller

Published: 2026-04-30T22:34:19Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [dataset](<https://devfeed.tech/topics/dataset.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-elastic-block-store-amazon-ebs](<https://devfeed.tech/tags/amazon-elastic-block-store-amazon-ebs.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [batch](<https://devfeed.tech/tags/batch.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [effective](<https://devfeed.tech/tags/effective.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-accelerated](<https://devfeed.tech/tags/gpu-accelerated.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [inference](<https://devfeed.tech/tags/inference.md>), [primary](<https://devfeed.tech/tags/primary.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [storage](<https://devfeed.tech/tags/storage.md>), [technologies](<https://devfeed.tech/tags/technologies.md>)

### AI overview

This post examines cost-effective, scalable Oxford Nanopore sequencing basecalling using Nextflow and Amazon EC2 GPU instances. It reports that horizontally distributing workloads through AWS Batch can reduce costs by up to 64% while maintaining equivalent throughput, based on benchmarking with a publicly available dataset.

### Source excerpt

This post was contributed by Stefan Dittforth and Michael Mueller Introduction Oxford Nanopore Technologies (ONT) sequencing enhances genome analysis in research and healthcare with its ability to produce long-read sequencing data in real-time. Long reads improve our ability to detect structural variation, resolve repetitive regions, perform haplotype phasing and analyze full-length transcripts, providing a more [...]

## Accelerating HPC Deployment with AWS Parallel Computing Service and Kiro CLI

DevFeed: [Accelerating HPC Deployment with AWS Parallel Computing Service and Kiro CLI](<https://devfeed.tech/articles/accelerating-hpc-deployment-with-aws-parallel-computing-service-and-kiro-cli-50143.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/accelerating-hpc-deployment-with-aws-parallel-computing-service-and-kiro-cli/>)

Author: Markus Adhiwiyogo

Published: 2026-03-26T18:06:41Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Computing](<https://devfeed.tech/topics/computing.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [Kiro](<https://devfeed.tech/topics/kiro.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Provisioning](<https://devfeed.tech/topics/provisioning.md>), [configuration-management](<https://devfeed.tech/topics/configuration-management.md>), [Network](<https://devfeed.tech/topics/network.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>), [cost-optimization](<https://devfeed.tech/topics/cost-optimization.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [availability](<https://devfeed.tech/tags/availability.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cli](<https://devfeed.tech/tags/cli.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [compute](<https://devfeed.tech/tags/compute.md>), [compute-resources](<https://devfeed.tech/tags/compute-resources.md>), [configuration-management](<https://devfeed.tech/tags/configuration-management.md>), [cost-optimization](<https://devfeed.tech/tags/cost-optimization.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [kiro](<https://devfeed.tech/tags/kiro.md>), [networking](<https://devfeed.tech/tags/networking.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [teams](<https://devfeed.tech/tags/teams.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This tutorial explains how Kiro CLI custom agents can automate the deployment and configuration of AWS Parallel Computing Service clusters for cloud-based HPC workloads. It covers infrastructure provisioning, networking, storage, Slurm scheduling, monitoring, and cost optimization.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. Research teams moving from on-premises HPC environments often struggle with the complexity of cloud deployment. Traditional approaches require deep expertise in AWS networking, storage architectures, and Slurm configuration management. [...]

## A Technical Deep Dive into Amazon EC2 Hpc8a Performance for Engineering and Scientific Workloads

DevFeed: [A Technical Deep Dive into Amazon EC2 Hpc8a Performance for Engineering and Scientific Workloads](<https://devfeed.tech/articles/a-technical-deep-dive-into-amazon-ec2-hpc8a-performance-for-engineering-and-scientific-workloads-50141.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/a-technical-deep-dive-into-amazon-ec2-hpc8a-performance-for-engineering-and-scientific-workloads/>)

Author: Charunethran Panchalam Govindarajan

Published: 2026-03-05T03:43:51Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Computing](<https://devfeed.tech/topics/computing.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [Network](<https://devfeed.tech/topics/network.md>), [NUMA](<https://devfeed.tech/topics/numa.md>), [Computational Fluid Dynamics (CFD)](<https://devfeed.tech/topics/cfd.md>)

Tags: [aircraft](<https://devfeed.tech/tags/aircraft.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-elastic-compute-cloud-amazon-ec2](<https://devfeed.tech/tags/amazon-elastic-compute-cloud-amazon-ec2.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [automotive](<https://devfeed.tech/tags/automotive.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [computational-fluid-dynamics](<https://devfeed.tech/tags/computational-fluid-dynamics.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [crash-simulation](<https://devfeed.tech/tags/crash-simulation.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [energy](<https://devfeed.tech/tags/energy.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [epyc](<https://devfeed.tech/tags/epyc.md>), [financial-services](<https://devfeed.tech/tags/financial-services.md>), [floating-point](<https://devfeed.tech/tags/floating-point.md>), [healthcare](<https://devfeed.tech/tags/healthcare.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [industries](<https://devfeed.tech/tags/industries.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [manufacturing](<https://devfeed.tech/tags/manufacturing.md>), [memory](<https://devfeed.tech/tags/memory.md>), [numa](<https://devfeed.tech/tags/numa.md>), [performance](<https://devfeed.tech/tags/performance.md>), [physics](<https://devfeed.tech/tags/physics.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [semiconductor](<https://devfeed.tech/tags/semiconductor.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

This technical article examines Amazon EC2 Hpc8a instances for engineering and scientific high-performance computing workloads. It describes the instances' AMD EPYC processors, memory capacity, Elastic Fabric Adapter networking, NUMA configuration, and claimed performance benefits for simulations and tightly coupled workloads.

### Source excerpt

High performance computing (HPC) workloads continue to grow in scale and complexity. Whether simulating airflow over an aircraft wing, modeling structural behavior under load, or performing crash simulation and multi-physics analysis, these workloads demand sustained compute throughput, high memory bandwidth, and efficient scaling across large clusters. Improvements in any one of these dimensions can reduce [...]

## Scaling life sciences research by deploying AWS ParallelCluster and AWS DataSync

DevFeed: [Scaling life sciences research by deploying AWS ParallelCluster and AWS DataSync](<https://devfeed.tech/articles/scaling-life-sciences-research-by-deploying-aws-parallelcluster-and-aws-datasync-50158.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/scaling-life-sciences-research-by-deploying-aws-parallelcluster-and-aws-datasync/>)

Author: Yoshimasa Aoto

Published: 2026-02-12T06:16:23Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Bioinformatics](<https://devfeed.tech/topics/bioinformatics.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>), [backups](<https://devfeed.tech/topics/backups.md>), [GPU](<https://devfeed.tech/topics/gpu.md>)

Tags: [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-s3-glacier](<https://devfeed.tech/tags/amazon-s3-glacier.md>), [amazon-s3-glacier-deep-archive](<https://devfeed.tech/tags/amazon-s3-glacier-deep-archive.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [aws-datasync](<https://devfeed.tech/tags/aws-datasync.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [backups](<https://devfeed.tech/tags/backups.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [genomics](<https://devfeed.tech/tags/genomics.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [medical-research](<https://devfeed.tech/tags/medical-research.md>), [migration-transfer-services](<https://devfeed.tech/tags/migration-transfer-services.md>), [research](<https://devfeed.tech/tags/research.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

This AWS case study describes how JSR Corporation used AWS ParallelCluster and AWS DataSync to modernize computational resources and data management for life sciences research. It discusses on-premises HPC bottlenecks involving genomic analysis, protein structure prediction, medical image analysis, large experimental datasets, backups, and GPU procurement.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. In life sciences research, managing large-scale computational resources and data efficiently is important for success. However, traditional on-premises environments often struggle to meet these requirements effectively. This post [...]

## End-to-end scalable vision intelligence pipeline using LIDAR 3D Point Clouds on AWS

DevFeed: [End-to-end scalable vision intelligence pipeline using LIDAR 3D Point Clouds on AWS](<https://devfeed.tech/articles/end-to-end-scalable-vision-intelligence-pipeline-using-lidar-3d-point-clouds-on-aws-50145.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/end-to-end-scalable-vision-intelligence-pipeline-using-lidar-3d-point-clouds-on-aws/>)

Author: Frantz Lohier

Published: 2026-01-27T18:48:29Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Point cloud](<https://devfeed.tech/topics/point-cloud.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Photogrammetry](<https://devfeed.tech/topics/photogrammetry.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [aws](<https://devfeed.tech/tags/aws.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [lidar](<https://devfeed.tech/tags/lidar.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [point](<https://devfeed.tech/tags/point.md>), [scale](<https://devfeed.tech/tags/scale.md>), [slam](<https://devfeed.tech/tags/slam.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

This tutorial describes an AWS-based pipeline for analyzing LiDAR 3D point clouds and interpreting complex scenes with AI. It covers SLAM, photogrammetry, point-cloud reconstruction and image or video interpretation, with a focus on scaling compute-intensive algorithms and processing large historical datasets using serverless AWS services.

### Source excerpt

Elevate your mining and construction business to new heights with the power of 3D world modeling and AI-driven scene interpretation. Our latest blog post delves into the underlying technologies, from SLAM and photogrammetry to point-cloud analysis, and demonstrates how to scale the execution of these compute-intensive algorithms on AWS. Unlock the potential to optimize your workflows, improve decision-making, and drive sustainable growth.

## Evaluating next-generation cloud compute for large-scale genomic processing

DevFeed: [Evaluating next-generation cloud compute for large-scale genomic processing](<https://devfeed.tech/articles/evaluating-next-generation-cloud-compute-for-large-scale-genomic-processing-50146.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/evaluating-next-generation-cloud-compute-for-large-scale-genomic-processing/>)

Author: Manu Pillai

Published: 2026-01-20T17:56:37Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Bioinformatics](<https://devfeed.tech/topics/bioinformatics.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [migration](<https://devfeed.tech/topics/migration.md>), [fpga](<https://devfeed.tech/topics/fpga.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [amazon](<https://devfeed.tech/topics/amazon.md>)

Tags: [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [cost](<https://devfeed.tech/tags/cost.md>), [critical](<https://devfeed.tech/tags/critical.md>), [dna](<https://devfeed.tech/tags/dna.md>), [dragen](<https://devfeed.tech/tags/dragen.md>), [fpga](<https://devfeed.tech/tags/fpga.md>), [genomics](<https://devfeed.tech/tags/genomics.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [migration](<https://devfeed.tech/tags/migration.md>), [performance](<https://devfeed.tech/tags/performance.md>)

### AI overview

This post evaluates migrating large-scale genomic workloads from Amazon EC2 F1 FPGA-based instances to F2 instances. AWS, AstraZeneca, and Illumina compare performance, cost, and output equivalency using genomic research workloads and AWS Regions.

### Source excerpt

AstraZeneca's genomic research requires extensive computational resources to analyze DNA sequences for developing life-saving therapies. As cloud infrastructure evolves with more powerful capabilities, customers can adopt them to see performance and efficiency gains. AstraZeneca successfully migrated to Amazon EC2 F2 instances for genomics, boosting performance by 60% and slashing costs by 70%.

## How Adobe Search, Discovery, and Content (SDC) Empowers Large Scale Image (AI/ML) Inferencing Utilizing AWS Batch

DevFeed: [How Adobe Search, Discovery, and Content (SDC) Empowers Large Scale Image (AI/ML) Inferencing Utilizing AWS Batch](<https://devfeed.tech/articles/how-adobe-search-discovery-and-content-sdc-empowers-large-scale-image-ai-ml-inferencing-utilizing-aws-batch-50148.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-adobe-search-discovery-and-content-sdc-empowers-large-scale-image-ai-ml-inferencing-utilizing-aws-batch/>)

Author: Harish Suvarna

Published: 2026-01-20T15:53:01Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Parallelism](<https://devfeed.tech/topics/parallelism.md>), [Computing](<https://devfeed.tech/topics/computing.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-accelerated](<https://devfeed.tech/tags/gpu-accelerated.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [inferencing](<https://devfeed.tech/tags/inferencing.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [learn](<https://devfeed.tech/tags/learn.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [optimizing](<https://devfeed.tech/tags/optimizing.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [performance](<https://devfeed.tech/tags/performance.md>)

### AI overview

This technical post explains how Adobe's Search, Discovery, and Content team used AWS Batch and GPU-accelerated Amazon EC2 instances to run large-scale image embedding and inference workloads across hundreds of millions of assets. It discusses parallel processing, elastic infrastructure, GPU utilization, cost efficiency, and the role of embeddings in semantic search, recommendations, and RAG.

### Source excerpt

In this post, learn how Adobe scaled AI inference for 29B+ assets across Adobe Firefly and Adobe Stock using AWS Batch and GPU-accelerated EC2, optimizing cost and performance at massive scale.

## Optimize Nextflow Workflows on AWS Batch with Mountpoint for Amazon S3

DevFeed: [Optimize Nextflow Workflows on AWS Batch with Mountpoint for Amazon S3](<https://devfeed.tech/articles/optimize-nextflow-workflows-on-aws-batch-with-mountpoint-for-amazon-s3-50153.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/optimize-nextflow-workflows-on-aws-batch-with-mountpoint-for-amazon-s3/>)

Author: Michael Mueller

Published: 2026-01-13T15:19:37Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Filesystems](<https://devfeed.tech/topics/filesystems.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [POSIX](<https://devfeed.tech/topics/posix.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [genomics](<https://devfeed.tech/tags/genomics.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

This tutorial explains how to optimize Nextflow workflows on AWS Batch by using Mountpoint for Amazon S3 to stream large static reference files directly into processes instead of repeatedly staging them to Amazon EBS. It describes the distinction between dataflow channels and direct path references and discusses Genomics England's use of the approach for a variant annotation pipeline.

### Source excerpt

Are you running genomic workflows with Nextflow on AWS Batch and experiencing bottlenecks when staging large reference files? In this post, we will show you how to optimize your workflow performance by leveraging Mountpoint for Amazon S3 to stream reference data directly into your Nextflow processes, eliminating the need to stage large static files repeatedly.

## Accelerating CFD development from years to weeks with agentic AI and AWS

DevFeed: [Accelerating CFD development from years to weeks with agentic AI and AWS](<https://devfeed.tech/articles/accelerating-cfd-development-from-years-to-weeks-with-agentic-ai-and-aws-50142.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/accelerating-cfd-development-from-years-to-weeks-with-agentic-ai-and-aws/>)

Author: Ross Pivovar

Published: 2026-01-06T16:12:51Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Computational Fluid Dynamics (CFD)](<https://devfeed.tech/topics/cfd.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>), [Programming](<https://devfeed.tech/topics/programming.md>), [software-development](<https://devfeed.tech/topics/software-development.md>), [debugging](<https://devfeed.tech/topics/debugging.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [cfd](<https://devfeed.tech/tags/cfd.md>), [coding](<https://devfeed.tech/tags/coding.md>), [debugging](<https://devfeed.tech/tags/debugging.md>), [development](<https://devfeed.tech/tags/development.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [physics](<https://devfeed.tech/tags/physics.md>), [simulations](<https://devfeed.tech/tags/simulations.md>)

### AI overview

The article explains how agentic AI can accelerate computational fluid dynamics development by helping experienced engineers with coding, debugging, simulation setup, and iteration. It emphasizes that domain expertise remains necessary to maintain scientific rigor and identify unrealistic results.

### Source excerpt

Agentic AI is revolutionizing computational fluid dynamics (CFD) simulations, enabling experienced engineers to focus on physics, innovation, and engineering judgment rather than tedious coding and debugging. Our latest blog explores how this transformative technology can help your team deliver complex projects more rapidly while maintaining scientific rigor.

## How Aionics accelerates chemical formulation and discovery with AWS Parallel Computing Service

DevFeed: [How Aionics accelerates chemical formulation and discovery with AWS Parallel Computing Service](<https://devfeed.tech/articles/how-aionics-accelerates-chemical-formulation-and-discovery-with-aws-parallel-computing-service-50149.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-aionics-accelerates-chemical-formulation-and-discovery-with-aws-parallel-computing-service/>)

Author: Moe Elshazly

Published: 2025-11-26T15:35:53Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Panic Playdate SDK](<https://devfeed.tech/topics/playdate-sdk.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Molecular Dynamics](<https://devfeed.tech/topics/molecular-dynamics.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [DSQL](<https://devfeed.tech/topics/dsql.md>)

Tags: [accelerated](<https://devfeed.tech/tags/accelerated.md>), [aerospace](<https://devfeed.tech/tags/aerospace.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [batteries](<https://devfeed.tech/tags/batteries.md>), [computing](<https://devfeed.tech/tags/computing.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-accelerated](<https://devfeed.tech/tags/gpu-accelerated.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [machine](<https://devfeed.tech/tags/machine.md>), [models](<https://devfeed.tech/tags/models.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [slurm](<https://devfeed.tech/tags/slurm.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

This AWS post explains how Aionics uses AWS Parallel Computing Service to build flexible high-performance computing infrastructure for computational chemistry. It describes plane-wave DFT simulations with MPI parallelization and GPU-accelerated molecular dynamics using machine-learned interatomic potentials to support battery electrolyte discovery.

### Source excerpt

This post was contributed by Mohamed K. Elshazly, PhD, Kareem Abdol-Hamid, Sam Bydlon, PhD, Aarabhi Achanta, and Mark Azadpour The decarbonization of our modern economy depends on solving a defining scientific challenge: developing batteries that are both safe and high performing. From electrical grids to vehicles and aviation, these energy storage devices must provide power [...]

## How Rivian modernized engineering simulation using AWS

DevFeed: [How Rivian modernized engineering simulation using AWS](<https://devfeed.tech/articles/how-rivian-modernized-engineering-simulation-using-aws-50152.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-rivian-modernized-engineering-simulation-using-aws/>)

Author: Ameya Kamerkar

Published: 2025-11-25T15:26:25Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [cloud-migration](<https://devfeed.tech/topics/cloud-migration.md>), [migration](<https://devfeed.tech/topics/migration.md>), [Computing](<https://devfeed.tech/topics/computing.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Parallelism](<https://devfeed.tech/topics/parallelism.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-migration](<https://devfeed.tech/tags/cloud-migration.md>), [compute](<https://devfeed.tech/tags/compute.md>), [computing](<https://devfeed.tech/tags/computing.md>), [efa](<https://devfeed.tech/tags/efa.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [rivian](<https://devfeed.tech/tags/rivian.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [simulations](<https://devfeed.tech/tags/simulations.md>)

### AI overview

Rivian migrated its engineering simulation and production HPC environment to AWS after an on-premises infrastructure failure threatened its vehicle programs. The post describes the resulting cloud migration and the development of SimOS, a simulation orchestration system.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. This post was contributed by Ameya Kamerkar (Rivian), Vikram Pendyam (Rivian), Abhishek Chauhan (Rivian), Ajay Paknikar (AWS), Sandeep Sovani (AWS) Figure 1. Rivian's custom Amazon Electric Delivery Vehicle (EDV) [...]

## How Proteros accelerates drug discovery by using AWS ParallelCluster

DevFeed: [How Proteros accelerates drug discovery by using AWS ParallelCluster](<https://devfeed.tech/articles/how-proteros-accelerates-drug-discovery-by-using-aws-parallelcluster-50151.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-proteros-accelerates-drug-discovery-by-using-aws-parallelcluster/>)

Author: Jonathan Davies

Published: 2025-11-25T15:17:02Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Computing](<https://devfeed.tech/topics/computing.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Security](<https://devfeed.tech/topics/security.md>), [3D visualization](<https://devfeed.tech/topics/3d-visualization.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [3d-visualization](<https://devfeed.tech/tags/3d-visualization.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallelcluster](<https://devfeed.tech/tags/aws-parallelcluster.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [computing](<https://devfeed.tech/tags/computing.md>), [data](<https://devfeed.tech/tags/data.md>), [elastic-fabric-adapter](<https://devfeed.tech/tags/elastic-fabric-adapter.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [high-scalability](<https://devfeed.tech/tags/high-scalability.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

### AI overview

The post explains how Proteros built a secure, scalable cloud-based HPC environment for drug discovery using AWS ParallelCluster, cryoSPARC, and hybrid storage. It describes the need to process large Cryo-EM and protein crystallography datasets, support GPU-accelerated interactive visualization, accommodate fluctuating workloads, and maintain security and regulatory compliance.

### Source excerpt

This post references AWS ParallelCluster. Check out AWS Parallel Computing Service (AWS PCS), our new managed Slurm service for running HPC and AI workloads on AWS. Proteros is a leader in structure-based drug discovery solutions, and supports pharmaceutical, biotechnological, and academic clients with advanced technologies like Cryogenic Electron Microscopy (Cryo-EM) and Protein Crystallography (PX). [...]

## Running NVIDIA Cosmos world foundation models on AWS

DevFeed: [Running NVIDIA Cosmos world foundation models on AWS](<https://devfeed.tech/articles/running-nvidia-cosmos-world-foundation-models-on-aws-50157.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/running-nvidia-cosmos-world-foundation-models-on-aws/>)

Author: Abhishek Srivastav

Published: 2025-11-24T16:51:00Z

Content type: tutorial

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Cosmos](<https://devfeed.tech/topics/cosmos.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Robotics](<https://devfeed.tech/topics/robotics.md>), [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>)

Tags: [amazon-elastic-kubernetes-service](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-batch](<https://devfeed.tech/tags/aws-batch.md>), [cosmos](<https://devfeed.tech/tags/cosmos.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [generation](<https://devfeed.tech/tags/generation.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [ml](<https://devfeed.tech/tags/ml.md>), [model-inference](<https://devfeed.tech/tags/model-inference.md>), [model-training](<https://devfeed.tech/tags/model-training.md>), [partner-solutions](<https://devfeed.tech/tags/partner-solutions.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [scale](<https://devfeed.tech/tags/scale.md>), [thought-leadership](<https://devfeed.tech/tags/thought-leadership.md>)

### AI overview

This AWS tutorial explains how to deploy NVIDIA Cosmos world foundation models to generate synthetic training data for physical AI systems. It presents two production-ready architectures for use cases including autonomous vehicles, robotics, smart factories, and video analytics agents, with emphasis on scalable infrastructure, security, performance, and cost.

### Source excerpt

Running NVIDIA Cosmos world foundation models on AWS provides powerful physical AI capabilities at scale. This blog covers two production-ready architectures, each optimized for different organizational needs and constraints.

## How Daiichi Sankyo modernized drug discovery using AWS Parallel Computing Service

DevFeed: [How Daiichi Sankyo modernized drug discovery using AWS Parallel Computing Service](<https://devfeed.tech/articles/how-daiichi-sankyo-modernized-drug-discovery-using-aws-parallel-computing-service-50150.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/hpc/how-daiichi-sankyo-modernized-drug-discovery-using-aws-parallel-computing-service/>)

Author: Ryo Kunimoto

Published: 2025-11-19T14:34:36Z

Content type: article

Language: en

Sources: [AWS HPC Blog](<https://devfeed.tech/sources/aws-hpc-blog.md>)

Topics: [Computing](<https://devfeed.tech/topics/computing.md>), [Parallelism](<https://devfeed.tech/topics/parallelism.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [Network](<https://devfeed.tech/topics/network.md>)

Tags: [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-parallel-computing-service](<https://devfeed.tech/tags/aws-parallel-computing-service.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [computing](<https://devfeed.tech/tags/computing.md>), [configuration-management](<https://devfeed.tech/tags/configuration-management.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [simulations](<https://devfeed.tech/tags/simulations.md>), [slurm](<https://devfeed.tech/tags/slurm.md>)

### AI overview

This AWS blog describes how Daiichi Sankyo modernized its drug-discovery research environment by adopting AWS Parallel Computing Service for managed HPC cluster operations. It discusses the architecture, usability, operational benefits, and use of Slurm with Amazon EC2 and AWS storage services.

### Source excerpt

This blog was co-authored by Takehiro Nakajima and Mark Azadpour from AWS and Rintaro Yamada, Rei Kajitani and Ryo Kunimoto from Daiichi Sankyo In recent years, the informatics field of drug discovery has seen a rapid increase in workloads requiring large-scale parallel computing, such as genome analysis, structure prediction, and drug design. Daiichi Sankyo has [...]