# Amazon Web Services (AWS) Published articles for Amazon Web Services (AWS). This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## Unmasking Cloud Identities: From Behavioral Clustering to Automated Detection DevFeed: [Unmasking Cloud Identities: From Behavioral Clustering to Automated Detection]() Original publisher: [Read original article]() Author: Osher Jacob Published: 2026-09-14T10:00:01Z Content type: article Language: en Sources: [Unit 42]() Topics: [AWS CloudTrail](), [Cloud](), [threat detection](), [Threat Research](), [SIEM, Security, Observability](), [Machine learning](), [Algorithms](), [SQL](), [IAM](), [identity and access management](), [Amazon Web Services]() Tags: [algorithms](), [amazon-web-services-aws](), [analysis](), [aws-cloudtrail](), [cloud](), [cloud-cybersecurity-research](), [cloud-detection](), [devops](), [iam](), [identity-and-access-management](), [logs](), [machine-learning](), [post](), [sql](), [threat-detection](), [threat-research]() ### AI overview This article presents a behavioral clustering model for mapping cloud identities to functional roles using activity patterns from audit logs. It applies unsupervised machine learning with UMAP and HDBSCAN to data from more than 40,000 identities across 125 cloud environments, and shows how the resulting map can support automated threat detection. The article also explains how lightweight heuristics extracted from the map can classify identities at scale using standard SQL, reducing the need for continuous resource-intensive machine learning pipelines. ### Source excerpt We designed a behavioral clustering model to map cloud identity roles from audit logs, enabling continuous threat detection using standard SQL queries. The post Unmasking Cloud Identities: From Behavioral Clustering to Automated Detection appeared first on Unit 42. ## GitLab Dedicated: Compliance for a new regulatory era DevFeed: [GitLab Dedicated: Compliance for a new regulatory era]() Original publisher: [Read original article]() Author: Aathira Nair Published: 2026-09-14T00:00:00Z Content type: article Language: en Sources: [GitLab]() Topics: [GitLab](), [Software as a service](), [Amazon Web Services](), [Cybersecurity](), [Security](), [Resilience](), [Deployment](), [Testing](), [Multitenancy]() Tags: [amazon-web-services-aws](), [aws](), [compliance](), [deployment](), [gdpr](), [gitlab](), [infrastructure-as-code](), [nis2](), [product](), [regulatory](), [resilience](), [saas](), [security](), [testing]() ### AI overview The article presents GitLab Dedicated as a fully isolated, single-tenant SaaS platform hosted and managed by GitLab in a preferred Amazon Web Services region. It explains how the service is intended to help European enterprises address compliance, data sovereignty, audit readiness, security, resilience, and operational responsibilities related to DORA, NIS2, and GDPR. ### Source excerpt Enforcements such as NIS2 are no longer a future planning consideration. The European Union Agency for Cybersecurity's (ENISA) NIS360 report confirms that supervisory authorities are actively assessing cybersecurity maturity across critical sectors. The agency is moving from guidance and consultation into active oversight, scrutiny, and accountability. This is the regulatory environment European enterprises now operate in. Multi-tenant cloud platforms remove operational overhead but place source code and pipelines on shared infrastructure regulators now scrutinize. Self-managed solutions provide isolation but transfer responsibility for upgrade cycles, security patches, and disaster recovery (DR) tests to an already stretched platform team. Both deployment options leave gaps in risk management, data sovereignty, and furnishing audit evidence. In this article, you'll discover how GitLab Dedicated, a fully isolated, single-tenant SaaS solution deployed in your preferred Amazon Web Services (AWS) region and hosted and managed by GitLab, addresses these challenges and helps you keep pace with evolving compliance requirements. "NatWest Group is adopting GitLab Dedicated SaaS to enable our engineers to use a common cloud engineering platform; delivering new customer and colleague outcomes rapidly, frequently, and securely with high quality, automated testing, on-demand infrastructure, and straight-through deployment." -- Adam Leggett, Platform Lead for Engineering Platforms, NatWest Group Regulations are driving change In the European Union, key regulations are driving the need for a different platform approach. These regulations converge on a decision most enterprises made before they existed: a platform their developers build on. That decision now carries audit consequences it didn't before. Digital Operational Resilience Act (DORA), which came into force across EU financial services in January 2025, requires financial institutions to keep critical technology resilient, ## AWS open-sources Pizza Bot: email-style inbox for background AI agents DevFeed: [AWS open-sources Pizza Bot: email-style inbox for background AI agents]() Original publisher: [Read original article]() Author: Paul Sawers Published: 2026-09-10T22:54:00Z Content type: news Language: en Sources: [The New Stack]() Topics: [AI Bots](), [AI Chat]() Tags: [agent-skills](), [agents](), [ai](), [ai-agents](), [amazon-web-services-aws](), [mcp](), [model-context-protocol](), [open-source]() ### AI overview AWS has open-sourced Pizza Bot, a self-hosted inbox interface for reviewing and triaging work from background AI agents. The desktop app supports scheduled work, human-decision requests, and configurable model providers. ### Source excerpt Amazon Web Services (AWS) has released a new open-source application dubbed Pizza Bot, which gives developers an email-style inbox for The post AWS open-sources Pizza Bot: email-style inbox for background AI agents appeared first on The New Stack. ## OSPAR 2026 report now available with 167 services in scope DevFeed: [OSPAR 2026 report now available with 167 services in scope]() Original publisher: [Read original article]() Author: James Chang Published: 2026-09-04T18:13:04Z Content type: news Language: en Sources: [AWS Security Blog]() Topics: [Security, Privacy and Abuse Prevention](), [Cryptography]() Tags: [amazon-web-services-aws](), [announcements](), [compliance](), [cryptography](), [financial-services](), [foundational-100](), [security](), [security-blog](), [security-identity-compliance]() ### AI overview AWS completed its annual OSPAR assessment under the OSPAR 2.0 framework. The certification covers 167 AWS services in the Asia Pacific (Singapore) Region and is intended to support customer compliance due diligence. ### Source excerpt We're pleased to confirm the successful completion of our annual Amazon Web Services (AWS) Outsourced Service Provider's Audit Report (OSPAR) assessment on July 29, 2026, in line with the OSPAR version 2.0 framework. The Association of Banks in Singapore (ABS) established the Guidelines on Control Objectives and Procedures for Outsourced Service Providers (ABS Guidelines) to [...] ## Detecting multi-stage attacks on AWS: A guide to cross-service signal correlation DevFeed: [Detecting multi-stage attacks on AWS: A guide to cross-service signal correlation]() Original publisher: [Read original article]() Author: Nisha Kashyap Published: 2026-08-26T17:39:19Z Content type: article Language: en Sources: [AWS Security Blog]() Topics: [Amazon Web Services (AWS)](), [Security](), [Detection engineering](), [Amazon CloudWatch Logs](), [AWS CloudTrail](), [VPC Flow Logs](), [Amazon S3](), [data]() Tags: [advanced-300](), [amazon-cloudwatch](), [amazon-cloudwatch-logs](), [amazon-guardduty](), [amazon-route-53](), [amazon-web-services-aws](), [analysis](), [aws-cloudtrail](), [aws-security-hub](), [best-practices](), [cybersecurity](), [guide](), [incident-response](), [logs](), [s3](), [security](), [security-blog](), [security-identity-compliance](), [shared-responsibility-model](), [technical-how-to](), [threat-detection](), [vpc-flow-logs]() ### AI overview This article explains how security engineers can detect multi-stage attacks on AWS by correlating signals across services with business context. It presents examples using CloudWatch Logs Insights and discusses expanding the correlations into an automated pipeline. ### Source excerpt A single alert from one security service tells you something happened. Read that signal alongside activity from other services and your own business context, and you will know whether what happened is part of a multi-stage attack. Consider a short sequence. An identity calls GetCallerIdentity from a source address it hasn't previously used. Within minutes, [...] ## DuckLabs to Join AWS, Projects to Remain Open Source DevFeed: [DuckLabs to Join AWS, Projects to Remain Open Source]() Original publisher: [Read original article]() Author: Mark Raasveldt and Hannes Mühleisen Published: 2026-08-26T00:00:00Z Content type: news Language: en Sources: [DuckDB]() Topics: [DuckDB](), [Open Source](), [Amazon Web Services (AWS)](), [amazon]() Tags: [amazon](), [amazon-web-services-aws](), [deep-dive](), [duckdb](), [open-source](), [projects](), [software]() ### AI overview DuckLabs will join Amazon Web Services as a new subsidiary, with the change expected to take effect in early September. DuckDB, DuckLake, Quack, and related extensions will remain free and open source under the MIT license, with their roadmap, governance model, and development pace unchanged. ### Source excerpt DuckLabs will join Amazon Web Services (AWS), which is expected to be effective in early September. The projects will remain open-source under the MIT license. ## Security Hub Extended adds Supply Chain Security as its tenth category DevFeed: [Security Hub Extended adds Supply Chain Security as its tenth category]() Original publisher: [Read original article]() Author: Michael Fuller Published: 2026-08-18T17:04:28Z Content type: news Language: en Sources: [AWS Security Blog]() Topics: [supply-chain-security](), [Security](), [Amazon Web Services]() Tags: [amazon-web-services-aws](), [announcements](), [aws](), [aws-security-hub](), [black-hat](), [engineering](), [enterprise](), [foundational-100](), [leadership](), [open-source](), [partners](), [payment](), [pricing](), [security](), [security-blog](), [security-identity-compliance](), [software](), [streaming](), [supply-chain](), [supply-chain-security](), [uncategorized](), [vulnerability]() ### AI overview AWS Security Hub Extended adds Supply Chain Security as its tenth category, with Chainguard and Socket as curated partners. The article frames software supply-chain risk as an enterprise security concern and describes pay-as-you-go and private-offer procurement options. ### Source excerpt Since February, we've grown AWS Security Hub Extended from 14 curated partners across 9 categories to 23 partners across 10. At Black Hat this month, 14 of those partners were at the Amazon Web Services (AWS) booth demoing live. Four of those partners delivered theater talks and ten were featured on SecurityLive streaming. We hosted [...] ## Updates to your AWS Sign-In experience DevFeed: [Updates to your AWS Sign-In experience]() Original publisher: [Read original article]() Author: Vaibhav Chowla Published: 2026-08-17T17:22:33Z Content type: release Language: en Sources: [AWS Security Blog]() Topics: [Amazon Web Services (AWS)](), [AWS IAM](), [identity and access management](), [AWS IAM Identity Center](), [browser]() Tags: [amazon-web-services-aws](), [aws](), [aws-iam](), [aws-iam-identity-center](), [aws-identity-and-access-management-iam](), [browser](), [identity-and-access-management](), [intermediate-200](), [scripted](), [security-blog](), [security-identity-compliance](), [uncategorized](), [updates]() ### AI overview AWS is gradually introducing a redesigned sign-in and sign-up experience to a limited number of customers. The changes add new account access options, unify the initial email entry point, and refresh the session selection page while existing customers continue using their current credentials and sign-in methods. ### Source excerpt Amazon Web Services (AWS) is gradually introducing updates to the AWS Sign-In and sign-up experience to a limited number of customers. We're sharing these changes so you will know what to expect as we gradually make the updated experience available to more customers. These updates include new options for creating and accessing AWS accounts. To [...] ## Adobe Firefly: Simplified observability with Amazon Managed Prometheus DevFeed: [Adobe Firefly: Simplified observability with Amazon Managed Prometheus]() Original publisher: [Read original article]() Author: Dev Arora Published: 2026-08-13T00:14:19Z Content type: article Language: en Sources: [AWS Architecture Blog]() Topics: [observability](), [GPU](), [Amazon EKS](), [Amazon Web Services](), [Monitoring](), [telemetry](), [migration](), [Training AI Models]() Tags: [adobe](), [amazon](), [amazon-eks](), [amazon-elastic-kubernetes-service](), [amazon-managed-service-for-prometheus](), [amazon-web-services-aws](), [aws](), [compute](), [cpu](), [customer-solutions](), [data](), [deployment](), [efficiency](), [gpu](), [infrastructure](), [jobs](), [kubernetes](), [metrics](), [observability](), [performance](), [prometheus]() ### AI overview Adobe Firefly migrated critical GPU infrastructure metrics from self-managed Prometheus to Amazon Managed Service for Prometheus. The article describes the observability challenges of large-scale model training on Amazon EKS, including high-cardinality GPU, compute, memory, and network telemetry, and reports 28x faster GPU metric queries with improved reliability and operational efficiency. ### Source excerpt Learn how Adobe Firefly achieved 28x faster GPU metric queries by migrating from self-managed Prometheus to Amazon Managed Service for Prometheus, with improvements in query performance, infrastructure reliability, and operational efficiency. ## A decade of mathematical certainty: Reflections on the Automated Reasoning Group DevFeed: [A decade of mathematical certainty: Reflections on the Automated Reasoning Group]() Original publisher: [Read original article]() Author: Byron Cook Published: 2026-08-11T16:22:19Z Content type: article Language: en Sources: [Amazon Science homepage]() Topics: [Automated reasoning](), [Formal verification](), [Math and Logic](), [systems](), [Amazon Web Services](), [VPC](), [network security](), [Security](), [AWS IAM](), [Amazon S3](), [Cloud](), [amazon]() Tags: [agentic-ai](), [amazon](), [amazon-web-services-aws](), [automated-reasoning](), [aws](), [compliance](), [formal-verification](), [network-security](), [security](), [security-privacy-and-abuse-prevention](), [vpc](), [vulnerabilities]() ### AI overview Amazon's Automated Reasoning Group reflects on a decade of applying mathematical logic, formal verification, and program analysis to AWS security and reliability. The article describes how research projects became production systems, including Tiros for VPC and network analysis and Zelkova for analyzing policies, S3 Block Public Access, and IAM Access Analyzer. ### Source excerpt Ten years after we founded the Automated Reasoning Group, mathematical logic has moved from academic research into production services that secure millions of customer workloads -- demonstrating that systems can be provably correct, not just probably correct. ## Amazon is investing in the Lean Focused Research Organization DevFeed: [Amazon is investing in the Lean Focused Research Organization]() Original publisher: [Read original article]() Author: Byron Cook; Shawn Bice Published: 2026-07-26T08:00:00Z Content type: news Language: en Sources: [Amazon Science homepage]() Topics: [AI Bots](), [AI Chat]() Tags: [agents](), [ai-agents](), [amazon](), [amazon-aurora](), [amazon-bedrock](), [amazon-bedrock-agentcore](), [amazon-web-services-aws](), [automated-reasoning](), [aws](), [developer](), [formal-verification](), [generative-ai](), [large-language-models-llms](), [llm](), [programming](), [programming-language](), [research](), [responsible-ai](), [safety](), [software-testing](), [testing](), [trustworthy-ai]() ### AI overview Amazon is making a long-term investment in the Lean Focused Research Organization to advance Lean, a programming language for mathematical correctness proofs. The article highlights Lean-based verification for safer AI agents and AWS systems. ### Source excerpt As AI agents take on higher-stakes decisions, Lean programming language makes it possible to mathematically prove they will behave safely. ## EC2's formally verified "isolation engine" provides mathematical assurance of virtual-machine isolation DevFeed: [EC2's formally verified "isolation engine" provides mathematical assurance of virtual-machine isolation]() Original publisher: [Read original article]() Author: Dominic Mulligan; Nathan Chong Published: 2026-06-10T15:00:00Z Content type: article Language: en Sources: [Amazon Science homepage]() Topics: [Amazon EC2](), [Rust formal verification]() Tags: [amazon-web-services-aws](), [autocorrode-library](), [automated-reasoning](), [aws-graviton5-security](), [cloud-and-systems](), [confidentiality-integrity-proofs](), [ec2-virtual-machine-security](), [formal-verification](), [formally-verified-hypervisor](), [isabelle-hol-proof-assistant](), [kernel](), [memory-safety-verification](), [nitro-isolation-engine](), [nitro-system](), [provable-security](), [rust](), [rust-formal-verification](), [security](), [security-privacy-and-abuse-prevention]() ### AI overview Amazon describes formally verifying the Nitro Isolation Engine, a separation-kernel component that enforces isolation between EC2 virtual machines. The verification uses Isabelle/HOL and is deployed as an always-on feature for Graviton5 users. ### Source excerpt Splitting the "separation kernel" off from the rest of the Nitro security system and using only a subset of the Rust programming language to code it enabled its formal verification. ## Cockroach Labs Achieves AWS Generative AI Competency for Production AI Infrastructure DevFeed: [Cockroach Labs Achieves AWS Generative AI Competency for Production AI Infrastructure]() Original publisher: [Read original article]() Author: David Weiss Published: 2026-05-19T00:00:00Z Content type: release Language: en Sources: [Cockroach Labs]() Topics: [Cockroach Labs](), [AI Infrastructure](), [Amazon Web Services (AWS)](), [Generative AI](), [Database](), [AI Bots]() Tags: [ai-agents](), [ai-infrastructure](), [amazon-web-services-aws](), [availability](), [cockroachdb](), [database](), [generative-ai](), [low-latency]() ### AI overview Cockroach Labs announces that it has achieved the AWS Generative AI Competency, recognizing its expertise and demonstrated customer success in delivering generative AI solutions with AWS technologies. The article explains how CockroachDB provides a unified infrastructure layer for transactional data, vector context, and agent state in AI applications. ### Source excerpt Cockroach Labs is pleased to announce we have achieved the Amazon Web Services (AWS) Generative AI Competency. ## Virtual machines, virtually everywhere - and with real security gaps DevFeed: [Virtual machines, virtually everywhere - and with real security gaps]() Original publisher: [Read original article]() Author: Tomáš Foltýn Published: 2026-03-25T10:00:00Z Content type: article Language: en Sources: [WeLiveSecurity]() Topics: [Cloud](), [Security](), [cloud-infrastructure](), [Amazon Web Services](), [Azure](), [on-prem](), [Amazon EC2](), [Amazon S3]() Tags: [amazon-web-services-aws](), [apis](), [aws](), [azure](), [breach](), [business-security](), [cloud](), [identity](), [infrastructure](), [ip](), [on-prem](), [operations](), [s3](), [scale](), [security](), [speed](), [storage]() ### AI overview Cloud adoption has created a widespread virtual-machine sprawl problem. Unmanaged or poorly monitored VMs may miss operating-system updates, retain outdated access policies, and evade security operations, creating subtle risks alongside more visible threats such as misconfigured storage buckets and exposed APIs. ### Source excerpt Cloud VMs offer unmatched speed, scale and flexibility - all of which could eventually count for little if they're left to fend for themselves ## Cyber fallout from the Iran war: What to have on your radar DevFeed: [Cyber fallout from the Iran war: What to have on your radar]() Original publisher: [Read original article]() Author: Tomáš Foltýn Published: 2026-03-12T14:17:33Z Content type: article Language: en Sources: [WeLiveSecurity]() Topics: [Security & Privacy](), [Threat Research](), [cloud-infrastructure](), [Amazon Web Services (AWS)](), [DDoS](), [Reconnaissance]() Tags: [amazon-web-services-aws](), [business-security](), [canada](), [cloud](), [cybersecurity](), [ddos](), [iran](), [united-kingdom](), [us]() ### AI overview The article examines the cybersecurity fallout from the Iran war, including attacks on AWS data centers and the rapid mobilization of pro-Iranian cyber groups. It describes hacktivism, APT reconnaissance and initial access, espionage, disruption, sabotage, and the heightened risks to organizations with Middle East supply-chain or cloud dependencies. ### Source excerpt The cybersecurity implications of the war in the Middle East extend far beyond the region. Here's where to focus your defenses. ## OpenAI and Amazon announce strategic partnership DevFeed: [OpenAI and Amazon announce strategic partnership]() Original publisher: [Read original article]() Published: 2026-02-27T05:30:00Z Content type: news Language: en Sources: [OpenAI News]() Topics: [amazon](), [Amazon Web Services (AWS)](), [OpenAI](), [AI Infrastructure](), [bedrock](), [Generative AI](), [Artificial Intelligence](), [Amazon Bedrock AgentCore]() Tags: [agents](), [ai-infrastructure](), [amazon](), [amazon-bedrock](), [amazon-bedrock-agentcore](), [amazon-web-services-aws](), [company](), [generative-ai](), [infrastructure](), [openai](), [security]() ### AI overview OpenAI and Amazon announce a multi-year strategic partnership involving AWS distribution of OpenAI Frontier, a Stateful Runtime Environment on Amazon Bedrock, customized models, AI infrastructure, and a $50 billion Amazon investment in OpenAI. ### Source excerpt OpenAI and Amazon announce a strategic partnership bringing OpenAI's Frontier platform to AWS, expanding AI infrastructure, custom models, and enterprise AI agents. ## Latacora Achieves AWS Advanced Tier Services Partner Status DevFeed: [Latacora Achieves AWS Advanced Tier Services Partner Status]() Original publisher: [Read original article]() Published: 2026-01-27T21:00:00Z Content type: release Language: en Sources: [Latacora]() Topics: [Amazon Web Services (AWS)](), [Security & compliance, Cloud security](), [Security](), [AWS IAM](), [Monitoring](), [threat detection]() Tags: [amazon-web-services-aws](), [cloud-security](), [compliance](), [iam](), [iso-27001](), [monitoring](), [security](), [soc](), [soc-2](), [threat-detection]() ### AI overview Latacora announces that it has achieved Amazon Web Services (AWS) Advanced Tier Services Partner status within the AWS Partner Network. The company says the designation reflects validated technical expertise, AWS-certified professionals, and a proven record of customer success in cloud security and compliance. ### Source excerpt We are thrilled to announce a major milestone for Latacora: we have achieved the Amazon Web Services (AWS) Advanced Tier Services Partner status within the AWS Partner Network (APN). This designation reflects Latacora's technical expertise and diligence in delivering exceptional cloud security and compliance solutions to our clients, and confirms that we have successfully completed a rigorous validation process demonstrating a proven track record of customer success delivered by a team of AWS-certified professionals with specialized technical capabilities. ## SIDN's planned move of domain registry functions to Amazon Web Services DevFeed: [SIDN's planned move of domain registry functions to Amazon Web Services]() Original publisher: [Read original article]() Published: 2024-02-09T14:15:21Z Content type: opinion Language: nl Sources: [Bert Hubert's writings]() Topics: [Amazon Web Services](), [Cloud](), [Internet]() Tags: [amazon-web-services-aws](), [article](), [autonomie](), [aws](), [cloud](), [internet](), [internet-governance](), [policy](), [technology]() ### AI overview This opinion article examines SIDN's decision to move part of its Dutch domain registry operations to Amazon Web Services. It argues that the shift raises concerns about European digital autonomy, security, stability, and long-term dependence on large American cloud providers. ### Source excerpt Door Corinne CathDr. Corinne Cath is an anthropologist of technology who studies the politics of Internet infrastructure. She is a recent graduate of the Oxford Internet Institute's PhD program (University of Oxford) and the Alan Turing Institute for data science. Previously, she worked on technology policy for human rights' organization ARTICLE 19 and the US House of Representatives. & Bert Hubert De Stichting Internet Domeinregistratie Nederland (SIDN) beheert het digitale kadaster van meer dan 6 miljoen '. ## AWS Launches the Reinventing Health Spaces IoT Contest DevFeed: [AWS Launches the Reinventing Health Spaces IoT Contest]() Original publisher: [Read original article]() Author: John Lee Published: 2021-07-21T00:00:00Z Content type: article Language: en Sources: [Blog on Developer Portal]() Topics: [Amazon Web Services (AWS)](), [AWS IoT Core](), [ESP32](), [Espressif](), [m5stack](), [Open Source](), [Cloud](), [Esp Rainmaker]() Tags: [amazon-web-services-aws](), [arduino](), [aws-iot-core](), [blog](), [esp-rainmaker](), [esp32](), [espressif](), [iot](), [m5stack](), [newsletter](), [open-source]() ### AI overview Amazon Web Services launched the Reinventing Health Spaces IoT contest on Hackster.io. Developers are challenged to build an open-source healthy-spaces solution using M5Stack Core2 for AWS IoT EduKit reference hardware, AWS IoT Core, and at least one other cloud service. ### Source excerpt Hi everyone, An exciting IoT contest has just been launched by Amazon Web Services (AWS) on hackster.io. It is entitled "Reinventing Health Spaces" and the challenge for developers across the world is to build an open-source, healthy-spaces solution using M5Stack Core2 for the AWS IoT EduKit reference hardware, AWS IoT Core, and at least one other cloud service. We, at Espressif, are particularly happy about this event, because the AWS IoT EduKit is based on ESP32. ## How we build the Image Gallery on trivago DevFeed: [How we build the Image Gallery on trivago]() Original publisher: [Read original article]() Author: Praneeth Peiris I want Published: 2021-07-07T00:00:00Z Content type: article Language: en Sources: [Trivago]() Topics: [Google Cloud Platform (GCP)](), [etl](), [data lake](), [Kafka](), [Front end](), [Amazon Web Services]() Tags: [amazon-web-services-aws](), [architecture](), [backend](), [cloud](), [data-lake](), [engineering](), [etl](), [frontend](), [gcp](), [kafka](), [platforms]() ### AI overview trivago describes migrating its hotel image-gallery ETL pipeline from Amazon Web Services to Google Cloud Platform. The redesigned architecture uses Dataflow jobs to snapshot images and tags, fetch changed accommodations, build and validate sorted galleries, and stream approved changes to frontend teams through Kafka. ### Source excerpt When was the last time you booked accommodation without checking its photos? Most probably never! Because having imagery information makes our decision-making process much easier and faster. How... ## Monitoring Kubernetes in Production DevFeed: [Monitoring Kubernetes in Production]() Original publisher: [Read original article]() Author: info@goteleport.com (Dmitry Shelenin) Published: 2016-03-12T00:00:00Z Content type: tutorial Language: en Sources: [Teleport]() Topics: [Kubernetes](), [Monitoring](), [Kubernetes clusters](), [Latency](), [upgrade](), [Amazon Web Services](), [Linux](), [Docker]() Tags: [amazon-web-services-aws](), [bare-metal](), [docker](), [kubernetes](), [kubernetes-clusters](), [latency](), [linux](), [logs](), [monitoring](), [network](), [production](), [upgrade]() ### AI overview This article explains how to monitor Kubernetes itself in production, especially after upgrades, rather than only monitoring applications. It describes failures involving SkyDNS, etcd, network-attached disk latency, connectivity, nodes, the API server, and Docker across AWS and bare-metal Linux deployments. ### Source excerpt Kubernetes has great built-in application monitoring features. But how to make sure Kubernetes itself is healthy after you upgrade it to the next version? ## Use of Formal Methods at Amazon Web Services DevFeed: [Use of Formal Methods at Amazon Web Services]() Original publisher: [Read original article]() Author: Marc Brooker Published: 2014-08-09T00:00:00Z Content type: article Language: en Sources: [Marc Brooker's Blog](), [Marc Brooker's Blog]() Topics: [Formal methods](), [Amazon Web Services]() Tags: [amazon](), [amazon-web-services-aws](), [code](), [concurrency](), [formal-methods]() ### AI overview The article describes how Amazon Web Services uses formal methods, particularly TLA+, to create precise system designs and detect subtle design errors. It explains that precise descriptions make assumptions about failures and concurrency explicit while avoiding the excessive detail of executable code. ### Source excerpt Use of Formal Methods at Amazon Web Services How we're using TLA+ at AWS Late last year, we published Use of Formal Methods at Amazon Web Services about our experiences with using formal methods at Amazon Web Services (AWS). The focus is on TLA+, and why we think it's a great fit for the kind of work we do. From the paper: In order to find subtle bugs in a system design, it is necessary to have a precise description of that design. There are at least two major benefits to writing a precise design; the author is forced to think more clearly, which helps eliminate 'plausible hand-waving', and tools can be applied to check for errors in the design, even while it is being written. In contrast, conventional design documents consist of prose, static diagrams, and perhaps pseudo-code in an adhoc untestable language. Such descriptions are far from precise; they are often ambiguous, or omit critical aspects such as partial failure or the granularity of concurrency (i.e. which constructs are assumed to be atomic). At the other end of the spectrum, the final executable code is unambiguous, but contains an overwhelming amount of detail. We needed to be able to capture the essence of a design in a few hundred lines of precise description. The full paper is worth reading if you're interested in formal methods.