# Cloud Logging

Cloud Logging is a real-time log-management system with storage, search, analysis, and monitoring support.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Find the log line that matters faster with full-text search in Grafana Cloud Logs

DevFeed: [Find the log line that matters faster with full-text search in Grafana Cloud Logs](<https://devfeed.tech/articles/find-the-log-line-that-matters-faster-with-full-text-search-in-grafana-cloud-logs-139558.md>)

Original publisher: [Read original article](<https://grafana.com/blog/find-the-log-line-that-matters-faster-with-full-text-search-in-grafana-cloud-logs/>)

Author: Jason Nochlin

Published: 2026-11-17T16:53:32Z

Content type: article

Language: en

Sources: [Grafana Labs](<https://devfeed.tech/sources/grafana-labs-blog-on-grafana-labs.md>)

Topics: [Grafana Cloud](<https://devfeed.tech/topics/grafana-cloud.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [Grafana](<https://devfeed.tech/topics/grafana.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [full-text-search](<https://devfeed.tech/tags/full-text-search.md>), [grafana](<https://devfeed.tech/tags/grafana.md>), [grafana-cloud-logs](<https://devfeed.tech/tags/grafana-cloud-logs.md>), [log-aggregation](<https://devfeed.tech/tags/log-aggregation.md>), [logs](<https://devfeed.tech/tags/logs.md>), [loki](<https://devfeed.tech/tags/loki.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [observability](<https://devfeed.tech/tags/observability.md>), [traces](<https://devfeed.tech/tags/traces.md>)

### AI overview

Grafana Cloud Logs full-text search adds a secondary index to Loki so supported searches for rare strings can skip data that cannot contain a match, reducing scans across long time ranges. It accelerates exact string filters (`|=`), literal regex searches (`|~`, including `(?i)`), and certain filters on structured metadata, labels, or parsed attributes; some advanced regex constructions are unsupported. The article reports about 10% additional compute and storage costs at Grafana Cloud scale, partly offset by reduced query compute. It preserves Loki's schemaless model, existing ingestion pipelines, labels, and LogQL. The feature is generally available in Grafana Cloud Logs at no additional cost. To try it, open Explore, select the Logs data source, add a stream selector and line filter, choose a longer time range, and run the query. A DATEV eG example reports reducing searched data from nearly 1 TB to around 100 GB and query time from three minutes to under three seconds for newly submitted logs.

### Source excerpt

A support ticket comes in with one clue: a transaction ID. The answer is somewhere in your logs, but you don't know which service logged it, which pod handled it, or which day it happened. So you write the query you always write, {service="payments"} |= "txn-123456", widen the time range to the last two weeks, and wait. Then the query times out. Loki was originally built around a simple idea: index labels, not log content, and store compressed logs cheaply in object storage. That design keeps storage costs low and operations light, and it's why teams keep choosing Loki and Grafana Cloud Logs, the fully managed log aggregation system powered by Loki, as their log volumes grow. For most queries, this model works very well. But when you search for a highly unique value, like a request ID, job ID, user ID, or device ID, labels can only narrow the search so far. Loki still has to read a lot of raw log data to find a handful of matching lines. At terabyte and petabyte scale, that process can be slow and costly. To fix that, we built full-text search for Grafana Cloud Logs, a capability based on the Logline technology Grafana Labs acquired in April 2026. Full-text search, now generally available in Grafana Cloud Logs, adds a purpose-built secondary index to Loki, so you can find specific log lines across weeks of logs in seconds without a full scan. You go straight to the one transaction ID, user ID, or error that matters and cut time to resolution. "When I ran our first query on newly submitted logs after enabling Logline, the improvement was clear," said Timo Kirzdörfer, OpenTelemetry & Grafana Cloud Admin, DATEV eG. "We went from processing nearly a terabyte of logs in three minutes to around 100 gigabytes in under three seconds. That represents an 80-90% reduction in the volume of logs searched for newly submitted logs, and we saw the results immediately." In this post, we'll explore how full-text search speeds up log investigations. You can also learn more in the Obse

## Autobase 2.12 released

DevFeed: [Autobase 2.12 released](<https://devfeed.tech/articles/autobase-2-12-released-119624.md>)

Original publisher: [Read original article](<https://www.postgresql.org/about/news/autobase-212-released-3430/>)

Published: 2026-11-05T00:00:00Z

Content type: release

Language: en

Sources: [PostgreSQL news](<https://devfeed.tech/sources/postgresql-news.md>)

Topics: [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>), [infrastructure monitoring](<https://devfeed.tech/topics/infrastructure-monitoring.md>), [ClusterControl](<https://devfeed.tech/topics/clustercontrol.md>), [internal developer platform automation](<https://devfeed.tech/topics/internal-developer-platform-automation.md>), [CI/CD secrets management](<https://devfeed.tech/topics/ci-cd-secrets-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [API Logging](<https://devfeed.tech/topics/api-logging.md>), [Amazon Elastic Block Store (Amazon EBS)](<https://devfeed.tech/topics/amazon-elastic-block-store-amazon-ebs.md>), [race-condition](<https://devfeed.tech/topics/race-condition.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-secrets-manager](<https://devfeed.tech/tags/aws-secrets-manager.md>), [azure](<https://devfeed.tech/tags/azure.md>), [backup](<https://devfeed.tech/tags/backup.md>), [built-in](<https://devfeed.tech/tags/built-in.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [environment-variables](<https://devfeed.tech/tags/environment-variables.md>), [files](<https://devfeed.tech/tags/files.md>), [gcp](<https://devfeed.tech/tags/gcp.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [postgresql-clusters](<https://devfeed.tech/tags/postgresql-clusters.md>), [release](<https://devfeed.tech/tags/release.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [restore](<https://devfeed.tech/tags/restore.md>), [secrets-management](<https://devfeed.tech/tags/secrets-management.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

Autobase 2.12 adds Netdata-powered dashboards for system, PostgreSQL, PgBouncer, and table and index metrics, while keeping an existing monitoring system in place. AWS, GCP, and Azure cluster provisioning now distributes nodes across Availability Zones by default to reduce the impact of a single-zone failure. A new secrets role can export and store secrets in AWS Secrets Manager. The release also improves security through credential and secret redaction, secure password files, IMDSv2 enforcement, and EBS encryption with AWS KMS support. Reliability changes address WAL archiving and replica promotion during restores, and a new SSH jump-host option enables management of clusters on private networks without direct SSH access to database servers. The supplied excerpt is incomplete, so it does not establish the full set of release changes.

### Source excerpt

We are pleased to announce the release of Autobase 2.12! Highlights Built-in Monitoring Dashboards Autobase isn't intended to replace your monitoring system. Instead, we've integrated with Netdata, which we consider one of the best solutions for real-time infrastructure monitoring. Autobase Platform now includes built-in dashboards powered by the Netdata agent, providing convenient access to key metrics for: System -- CPU, memory, disk, and network performance PostgreSQL -- database health and performance PgBouncer -- connection pooling metrics Tables and Indexes -- statistics and performance insights Explore the dashboards in our live demo sandbox: https://demo.autobase.tech Multi-AZ Deployment When provisioning PostgreSQL clusters on AWS, GCP, and Azure, Autobase now distributes nodes across multiple Availability Zones (AZs) by default. This improves cluster resilience by reducing the impact of a single Availability Zone failure. Implementation details: AWS -- PR #1732 GCP -- PR #1738 Azure -- PR #1740 External Secrets Provider: AWS Secrets Manager We've introduced a new secrets role with support for AWS Secrets Manager. This integration enables Autobase to export and store secrets in AWS Secrets Manager, providing an option for centralized secrets management. Security Enhancements Autobase 2.12 includes important security improvements across the platform and automation engine: Redacted sensitive credentials and secrets from API request and service logs. Replaced PGPASSWORD environment variables with secure password files. Prevented sensitive pgBackRest configuration details from appearing in logs. Enforced IMDSv2 for AWS EC2 instances. Added EBS encryption and AWS KMS key support. Reliability Improvements This release also improves the safety and reliability of cluster management, backup, and restore operations: Preserved WAL archiving and prevented unintended replica promotion during restore operations. Fixed a race condition when creating pgBackRest stanzas on shared

## Google: LLMjacking attacks rack up $1 million in cloud AI charges

DevFeed: [Google: LLMjacking attacks rack up $1 million in cloud AI charges](<https://devfeed.tech/articles/google-llmjacking-attacks-rack-up-1-million-in-cloud-ai-charges-115538.md>)

Original publisher: [Read original article](<https://www.bleepingcomputer.com/news/security/google-llmjacking-attacks-rack-up-1-million-in-cloud-ai-charges/>)

Author: Bill Toulas

Published: 2026-11-03T18:51:04Z

Content type: news

Language: en

Sources: [BleepingComputer](<https://devfeed.tech/sources/bleepingcomputer.md>)

Topics: [Cybersecurity](<https://devfeed.tech/topics/cybersecurity.md>), [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [litellm](<https://devfeed.tech/topics/litellm.md>), [MFA](<https://devfeed.tech/topics/mfa.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [api](<https://devfeed.tech/tags/api.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [attacks](<https://devfeed.tech/tags/attacks.md>), [business-email-compromise](<https://devfeed.tech/tags/business-email-compromise.md>), [charges](<https://devfeed.tech/tags/charges.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-ai](<https://devfeed.tech/tags/cloud-ai.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [compromise](<https://devfeed.tech/tags/compromise.md>), [computer-help](<https://devfeed.tech/tags/computer-help.md>), [computer-security](<https://devfeed.tech/tags/computer-security.md>), [computers](<https://devfeed.tech/tags/computers.md>), [costs](<https://devfeed.tech/tags/costs.md>), [credentials](<https://devfeed.tech/tags/credentials.md>), [cve](<https://devfeed.tech/tags/cve.md>), [cve-2026-40217](<https://devfeed.tech/tags/cve-2026-40217.md>), [cybercrime](<https://devfeed.tech/tags/cybercrime.md>), [databases](<https://devfeed.tech/tags/databases.md>), [google](<https://devfeed.tech/tags/google.md>), [infosec](<https://devfeed.tech/tags/infosec.md>), [infosec-computer-security](<https://devfeed.tech/tags/infosec-computer-security.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [linux](<https://devfeed.tech/tags/linux.md>), [llmjacking](<https://devfeed.tech/tags/llmjacking.md>), [mac](<https://devfeed.tech/tags/mac.md>), [malware](<https://devfeed.tech/tags/malware.md>), [malware-removal](<https://devfeed.tech/tags/malware-removal.md>), [security](<https://devfeed.tech/tags/security.md>), [spyware](<https://devfeed.tech/tags/spyware.md>), [support](<https://devfeed.tech/tags/support.md>), [tech-support](<https://devfeed.tech/tags/tech-support.md>), [technical-support](<https://devfeed.tech/tags/technical-support.md>), [virus](<https://devfeed.tech/tags/virus.md>), [virus-removal](<https://devfeed.tech/tags/virus-removal.md>), [windows](<https://devfeed.tech/tags/windows.md>)

### AI overview

Google's GTIG and Mandiant report that LLMjacking can generate more than $100,000 in fraudulent cloud charges in a day, with cumulative costs reaching $1 million in observed cases. Attackers find exposed LLM endpoints or steal credentials and API keys, then resell access through LLM mixers; request spikes can exceed 1,000 per second while providers bill the victim organization. The excerpt also describes credential theft, persistence attempts, exploitation of a LiteLLM vulnerability, and unauthorized proxy or agent deployments. Google recommends centralized secrets management and key rotation, least-privilege IAM, phishing-resistant MFA, visibility into unauthorized AI services, API usage and spending limits, and monitored cloud audit and inference logs.

### Source excerpt

Large language model hijacking attacks, also known as LLMjacking, are generating large fraudulent cloud charges, with some organizations losing more than $100,000 per day. [...]

## ColdFusion Kubernetes Ephemeral Storage Filling From Application Logs

DevFeed: [ColdFusion Kubernetes Ephemeral Storage Filling From Application Logs](<https://devfeed.tech/articles/coldfusion-kubernetes-ephemeral-storage-filling-from-application-logs-109723.md>)

Original publisher: [Read original article](<https://blog.devops.dev/coldfusion-kubernetes-ephemeral-storage-filling-from-application-logs-d2343c499c2e?source=rss----33f8b2d9a328---4>)

Author: Deepak Purohit

Published: 2026-10-30T18:59:31Z

Content type: tutorial

Language: en

Sources: [DevOps.dev](<https://devfeed.tech/sources/devops-dev.md>)

Topics: [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [container images](<https://devfeed.tech/topics/container-images.md>)

Tags: [adobe](<https://devfeed.tech/tags/adobe.md>), [adobe-coldfusion](<https://devfeed.tech/tags/adobe-coldfusion.md>), [alert](<https://devfeed.tech/tags/alert.md>), [coldfusion](<https://devfeed.tech/tags/coldfusion.md>), [coldfusion-development](<https://devfeed.tech/tags/coldfusion-development.md>), [container](<https://devfeed.tech/tags/container.md>), [ephemeral-storage](<https://devfeed.tech/tags/ephemeral-storage.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [logging](<https://devfeed.tech/tags/logging.md>), [logs](<https://devfeed.tech/tags/logs.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [pod](<https://devfeed.tech/tags/pod.md>), [storage](<https://devfeed.tech/tags/storage.md>), [volumes](<https://devfeed.tech/tags/volumes.md>)

### AI overview

ColdFusion logs can silently fill a pod's ephemeral storage and trigger pod or node evictions. Kubernetes counts writable layers, pod logs, and local emptyDir volumes; enforcement depends on local storage measurement being enabled. The excerpt recommends bounding ColdFusion output with maxOutLogSize and maxFileBackup in neo-logging.xml, checking cflog files for applicable rotation limits, and baking configuration into the image. Routing logs to stdout lets kubelet rotation apply (documented defaults: 10 MiB and five files), while writing to a file and streaming the same lines to stdout can double storage use. Set ephemeral-storage requests and limits, use size-limited emptyDir for scratch files, and ship logs off-node with a DaemonSet agent. Check filesystem layout and ColdFusion image behavior, since these vary; storage limits may not be enforced if measurement is unavailable, and QoS does not protect pods from disk-pressure evictions.

### Source excerpt

ColdFusion Kubernetes Ephemeral Storage Filling From Application LogsThe Disk You Forgot You Had: Stopping ColdFusion Logs From Filling Kubernetes Ephemeral Storage Your pods were stable for six weeks. Then, within an hour, three of them were evicted. Nothing changed in the code. Traffic was ordinary. Memory and CPU graphs looked healthy. The cause was a log file. One ColdFusion instance had been writing steadily to disk since the last deployment, and that disk was never meant to hold anything for long. When it filled, Kubernetes evicted the pod to protect the node. This failure mode is easy to miss because log volume grows slowly and silently. There is no spike to alert on. The pod simply reaches a ceiling nobody configured, often weeks after release. This guide explains what ephemeral storage actually includes, why ColdFusion fills it, and how to cap it. It uses the Kubernetes documentation and Adobe's own logging guidance. Lucid Outsourcing Solutions helps enterprise teams run ColdFusion containers that stay healthy for months, not weeks. What Counts as Ephemeral Storage? More than most teams expect. The Kubernetes ephemeral storage documentation states the purpose directly: "Pods use ephemeral local storage for scratch space, caching, and for logs." Logs are named explicitly. They are not an edge case; they are one of the three intended uses, and they are the one that grows without bound. The documentation also notes that the kubelet uses this same storage for container images and the writable layers of running containers. So your application competes with the platform for the same space. The resource management documentation lists what Kubernetes tracks toward usage. It counts writes to the container's writable layer, container images, or both. It counts local emptyDir volumes. It counts the Pod's own logs, usually under /var/log/pods. And it counts system files mapped into the Pod, such as /etc/hosts. Measurement is conditional, which matters later. The docume

## Don't Wait for an Outage: Stress-Test Your Google Cloud Observability Setup Today

DevFeed: [Don't Wait for an Outage: Stress-Test Your Google Cloud Observability Setup Today](<https://devfeed.tech/articles/don-t-wait-for-an-outage-stress-test-your-google-cloud-observability-setup-today-93915.md>)

Original publisher: [Read original article](<https://medium.com/google-developer-experts/dont-wait-for-an-outage-stress-test-your-google-cloud-observability-setup-today-a987166fcd68?source=rss----a67bd6fa7d58---4>)

Author: Fed Mestrone

Published: 2026-10-21T12:50:54Z

Content type: tutorial

Language: en

Sources: [Google Developer Experts](<https://devfeed.tech/sources/google-developer-experts-medium.md>)

Topics: [observability](<https://devfeed.tech/topics/observability.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [Cloud Monitoring](<https://devfeed.tech/topics/cloud-monitoring.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Tool](<https://devfeed.tech/topics/tool.md>), [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>)

Tags: [alert](<https://devfeed.tech/tags/alert.md>), [alerts](<https://devfeed.tech/tags/alerts.md>), [basics](<https://devfeed.tech/tags/basics.md>), [business](<https://devfeed.tech/tags/business.md>), [business-context](<https://devfeed.tech/tags/business-context.md>), [cli](<https://devfeed.tech/tags/cli.md>), [code](<https://devfeed.tech/tags/code.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [debugging](<https://devfeed.tech/tags/debugging.md>), [error](<https://devfeed.tech/tags/error.md>), [fake](<https://devfeed.tech/tags/fake.md>), [generate](<https://devfeed.tech/tags/generate.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [it](<https://devfeed.tech/tags/it.md>), [logging](<https://devfeed.tech/tags/logging.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [observability](<https://devfeed.tech/tags/observability.md>), [outage](<https://devfeed.tech/tags/outage.md>), [python](<https://devfeed.tech/tags/python.md>), [test](<https://devfeed.tech/tags/test.md>)

### AI overview

The Python-based Observability Testing Tool for Google Cloud generates configurable logs and metrics to validate PromQL, LQL, and Log Analytics SQL queries, exercise live alert routing, and train engineers in a sandbox. YAML jobs run in historical backfill mode for past time windows or live mode for incoming data and alert testing. The excerpt's setup requires Python 3.12+, a Google Cloud project, and a service account with Logs Writer and Monitoring Metric Writer roles; credentials may be auto-detected in Cloud Shell or on a GCE instance. Run `obs-tool -v --dry-run config.obs.yaml` to preview jobs before they call Google Cloud APIs. YAML data sources and variables can add randomized values, and GCE metadata can provide instance context.

### Source excerpt

How to validate alerts, train teams, and simulate chaos without breaking production The silence of a healthy system is a goal for every Site Reliability Engineer (SRE). But when you are building dashboards, writing query logic, or configuring alert policies, silence is your enemy. How do you test a "Critical CPU Load" alert if your CPU usage never goes above 20%? How do you validate a complex Log Analytics SQL query if the specific error pattern hasn't happened in months? Waiting for a real production failure to verify your observability stack is a dangerous strategy. By the same token, you probably don't particularly want to break your systems just to confirm that your alerts are working... What you need is a way to generate noise on demand! Enter the Observability Testing Tool for Google Cloud, a Python-based utility designed to fill your empty dashboards with meaningful, controlled, and realistic data. Why "Fake" Data Provides Real Business Value In a business context, observability is not just about having logs; it's about Mean Time To Detect (MTTD). If your detection logic is flawed, you won't know until it's too late. This tool addresses three critical business problems: Validation of Logic: Prove that your PromQL, LQL (Logging Query Language), and Log Analytics SQL queries actually catch what they are supposed to catch. Alert Simulation: distinct from simple unit testing, this allows you to trigger live alerts in real-time to verify notification channels (PagerDuty, Slack, Email) are routed correctly. Training & Onboarding: It is an excellent resource for training new engineers. You can simulate a "server outage" scenario in a safe sandbox environment and let junior engineers practice debugging using the Google Cloud console. How It Works: The Basics The Observability Testing Tool is a CLI (Command Line Interface) written in Python. It operates on a simple principle: Configuration over Code. You define what logs or metrics you want as well as when they should b

## Zero-code trace-log correlation with OBI

DevFeed: [Zero-code trace-log correlation with OBI](<https://devfeed.tech/articles/zero-code-trace-log-correlation-with-obi-65645.md>)

Original publisher: [Read original article](<https://opentelemetry.io/blog/2026/obi-trace-log-correlation/>)

Author: OpenTelemetry Authors; Docs CC BY

Published: 2026-10-06T10:19:48Z

Content type: tutorial

Language: en

Sources: [OpenTelemetry](<https://devfeed.tech/sources/blog-on-opentelemetry.md>)

Topics: [log management](<https://devfeed.tech/topics/log-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>)

Tags: [ebpf](<https://devfeed.tech/tags/ebpf.md>), [instrumentation](<https://devfeed.tech/tags/instrumentation.md>), [logging](<https://devfeed.tech/tags/logging.md>), [logs](<https://devfeed.tech/tags/logs.md>), [opentelemetry](<https://devfeed.tech/tags/opentelemetry.md>), [structured](<https://devfeed.tech/tags/structured.md>)

### AI overview

OpenTelemetry eBPF Instrumentation (OBI) can add trace and span IDs to application logs without changing the application. The tutorial explains its coverage, configuration, kernel and logging requirements, pipeline filtering, and rollout considerations.

### Source excerpt

You get paged. A trace shows a request failing in one of your services, and you know the answer is in the logs -- but which log lines belong to that request? If the service never adopted structured logging with trace context, the honest answer is: you grep by timestamp and hope. OpenTelemetry eBPF Instrumentation (OBI) can now add that missing trace context to the logs your services already write. Your applications don't change: no SDK, no logging-library configuration, no application rebuild or redeploy.

## A resilient kernel log reporter

DevFeed: [A resilient kernel log reporter](<https://devfeed.tech/articles/a-resilient-kernel-log-reporter-63556.md>)

Original publisher: [Read original article](<https://blog.janestreet.com/linux-engineering-kernel-reporter-index/>)

Author: Varun Gupta

Published: 2026-10-01T00:00:00Z

Content type: article

Language: en

Sources: [Jane Street](<https://devfeed.tech/sources/jane-street.md>)

Topics: [Kernel](<https://devfeed.tech/topics/kernel.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [log management](<https://devfeed.tech/topics/log-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [backend](<https://devfeed.tech/tags/backend.md>), [backpressure](<https://devfeed.tech/tags/backpressure.md>), [capture](<https://devfeed.tech/tags/capture.md>), [cause](<https://devfeed.tech/tags/cause.md>), [chrome](<https://devfeed.tech/tags/chrome.md>), [cli](<https://devfeed.tech/tags/cli.md>), [collection](<https://devfeed.tech/tags/collection.md>), [debug](<https://devfeed.tech/tags/debug.md>), [device](<https://devfeed.tech/tags/device.md>), [dns](<https://devfeed.tech/tags/dns.md>), [file](<https://devfeed.tech/tags/file.md>), [filesystem](<https://devfeed.tech/tags/filesystem.md>), [internship](<https://devfeed.tech/tags/internship.md>), [kernel](<https://devfeed.tech/tags/kernel.md>)

### AI overview

A Linux log shipper collects kernel logs without depending on local disk or network availability. The project also uses pstore to preserve panic logs for transfer after reboot, then exposes them through command-line tools to help diagnose crashes, including failures associated with a recent Nvidia driver update.

### Source excerpt

The following is part of a series of posts about 2026 summer intern projects--for more, see "What the interns have wrought, special jumbo 2026 edition"

## A comprehensive guide to Fly.io logging

DevFeed: [A comprehensive guide to Fly.io logging](<https://devfeed.tech/articles/a-comprehensive-guide-to-fly-io-logging-20051.md>)

Original publisher: [Read original article](<https://www.honeybadger.io/blog/fly-io-logging/>)

Author: Muhammed Ali

Published: 2026-08-13T07:00:00Z

Content type: tutorial

Language: en

Sources: [Honeybadger](<https://devfeed.tech/sources/honeybadger.md>)

Topics: [Logging](<https://devfeed.tech/topics/logging.md>), [fly.io](<https://devfeed.tech/topics/fly-io.md>), [log management](<https://devfeed.tech/topics/log-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [error tracking](<https://devfeed.tech/topics/error-tracking.md>), [observability pipelines](<https://devfeed.tech/topics/observability-pipelines.md>), [API Logging](<https://devfeed.tech/topics/api-logging.md>), [Tutorial](<https://devfeed.tech/topics/tutorial.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [application](<https://devfeed.tech/tags/application.md>), [article](<https://devfeed.tech/tags/article.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [collect](<https://devfeed.tech/tags/collect.md>), [container](<https://devfeed.tech/tags/container.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [devops-articles](<https://devfeed.tech/tags/devops-articles.md>), [errors](<https://devfeed.tech/tags/errors.md>), [fastapi](<https://devfeed.tech/tags/fastapi.md>), [fly-io](<https://devfeed.tech/tags/fly-io.md>), [guide](<https://devfeed.tech/tags/guide.md>), [lightweight](<https://devfeed.tech/tags/lightweight.md>), [logging](<https://devfeed.tech/tags/logging.md>), [logs](<https://devfeed.tech/tags/logs.md>), [monitor](<https://devfeed.tech/tags/monitor.md>), [platform](<https://devfeed.tech/tags/platform.md>), [process](<https://devfeed.tech/tags/process.md>), [program](<https://devfeed.tech/tags/program.md>), [running](<https://devfeed.tech/tags/running.md>), [vector](<https://devfeed.tech/tags/vector.md>)

### AI overview

Fly.io automatically collects application output written to standard output and standard error and streams it for access. The excerpt describes logs being gathered in each app container, sent from the host through Vector into Fly.io's internal NATS cluster, then read by the log shipper and forwarded to a sink such as Honeybadger. It introduces a FastAPI example with endpoints intended to generate informational, warning, and error logs, but the excerpt ends before showing the commands or results. It does not establish how to configure Honeybadger.

### Source excerpt

Logging is an import part of debugging an app. Without a good method of catching errors or logs in general, you would end up with uncaught issues and could also lose valuable customers in the process. Read this article to learn how to effectively handle logs on Fly.io.

## Building Secure, Scalable Authentication with FusionAuth and Google Cloud

DevFeed: [Building Secure, Scalable Authentication with FusionAuth and Google Cloud](<https://devfeed.tech/articles/building-secure-scalable-authentication-with-fusionauth-and-google-cloud-43238.md>)

Original publisher: [Read original article](<https://fusionauth.io/blog/bilt-google-cloud>)

Author: Brad McCarty

Published: 2025-12-04T00:00:00Z

Content type: article

Language: en

Sources: [FusionAuth](<https://devfeed.tech/sources/fusionauth-blog.md>)

Topics: [Authentication](<https://devfeed.tech/topics/authentication.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [identity and access management](<https://devfeed.tech/topics/identity-and-access-management.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [cloud-sql](<https://devfeed.tech/topics/cloud-sql.md>), [Entra ID](<https://devfeed.tech/topics/entra-id.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-logging](<https://devfeed.tech/tags/cloud-logging.md>), [cloud-sql](<https://devfeed.tech/tags/cloud-sql.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data-ownership](<https://devfeed.tech/tags/data-ownership.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [developer](<https://devfeed.tech/tags/developer.md>), [development](<https://devfeed.tech/tags/development.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [identity-and-access-management](<https://devfeed.tech/tags/identity-and-access-management.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>)

### AI overview

This article explains how FusionAuth and Google Cloud can provide scalable authentication infrastructure for growing applications. It describes running FusionAuth in a single-tenant Google Cloud environment with Managed Instance Groups, Cloud SQL, and Cloud Logging to support scaling, monitoring, data ownership, compliance, and low-latency access.

### Source excerpt

Learn how FusionAuth and Google Cloud deliver modern authentication infrastructure designed for growing user bases and mission-critical applications.

## ProxMenux Manager: Menu Driven CLI and Real Time Web Dashboard for Proxmox

DevFeed: [ProxMenux Manager: Menu Driven CLI and Real Time Web Dashboard for Proxmox](<https://devfeed.tech/articles/proxmenux-manager-menu-driven-cli-and-real-time-web-dashboard-for-proxmox-65799.md>)

Original publisher: [Read original article](<https://noted.lol/proxmenux-manager/>)

Author: Jeremy

Published: 2025-11-21T18:16:09Z

Content type: article

Language: en

Sources: [Noted](<https://devfeed.tech/sources/noted.md>)

Topics: [Proxmox](<https://devfeed.tech/topics/proxmox.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>)

Tags: [cli-tools](<https://devfeed.tech/tags/cli-tools.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [proxmox](<https://devfeed.tech/tags/proxmox.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

ProxMenux Manager is an open-source tool for Proxmox that provides guided CLI workflows for managing virtual machines, containers, storage, networks, and related tasks. It also includes a web dashboard with real-time infrastructure metrics, and the article describes authentication, two-factor authentication, and installation.

### Source excerpt

ProxMenux Manager simplifies Proxmox administration with a menu driven CLI and a modern web dashboard for real time monitoring of VMs storage and hardware.

## Dealing with Imperfect Telemetry

DevFeed: [Dealing with Imperfect Telemetry](<https://devfeed.tech/articles/dealing-with-imperfect-telemetry-54420.md>)

Original publisher: [Read original article](<https://www.huntress.com/blog/imperfect-telemetry-techniques-effective-incident-response>)

Author: Anton Ovrutsky

Published: 2025-10-21T05:00:00Z

Content type: article

Language: en

Sources: [Huntress Blog](<https://devfeed.tech/sources/huntress-blog.md>)

Topics: [telemetry](<https://devfeed.tech/topics/telemetry.md>), [Logging](<https://devfeed.tech/topics/logging.md>), [Security](<https://devfeed.tech/topics/security.md>), [Security Information and Event Management (SIEM)](<https://devfeed.tech/topics/siem-security.md>), [incident](<https://devfeed.tech/topics/incident.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [Windows](<https://devfeed.tech/topics/windows.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [azure](<https://devfeed.tech/tags/azure.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-logging](<https://devfeed.tech/tags/cloud-logging.md>), [incident](<https://devfeed.tech/tags/incident.md>), [lateral-movement](<https://devfeed.tech/tags/lateral-movement.md>), [legacy](<https://devfeed.tech/tags/legacy.md>), [logging](<https://devfeed.tech/tags/logging.md>), [logs](<https://devfeed.tech/tags/logs.md>), [security](<https://devfeed.tech/tags/security.md>), [siem](<https://devfeed.tech/tags/siem.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>)

### AI overview

The article explains how Huntress Tactical Response investigates security incidents when telemetry is incomplete, including missing Windows event logs, unavailable network data, and disabled Azure diagnostic logging. It presents practical techniques for extracting useful findings despite gaps in logging.

### Source excerpt

See how the Huntress Tactical Response team tackles security telemetry gaps. We share real-world techniques for working with missing logs, degraded telemetry, and cloud logging challenges to uncover critical insights and improve investigations.

## Optimizing Enterprise Operations with Heroku's Advanced Logging Features

DevFeed: [Optimizing Enterprise Operations with Heroku's Advanced Logging Features](<https://devfeed.tech/articles/optimizing-enterprise-operations-with-heroku-s-advanced-logging-features-26481.md>)

Original publisher: [Read original article](<https://www.heroku.com/blog/optimizing-enterprise-operations-herokus-advanced-logging-features/>)

Author: Julián Duque

Published: 2025-05-13T15:00:13Z

Content type: article

Language: en

Sources: [Heroku](<https://devfeed.tech/sources/heroku.md>)

Topics: [Logging](<https://devfeed.tech/topics/logging.md>), [Heroku](<https://devfeed.tech/topics/heroku.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>)

Tags: [backend](<https://devfeed.tech/tags/backend.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [data-residency](<https://devfeed.tech/tags/data-residency.md>), [databases](<https://devfeed.tech/tags/databases.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-operations](<https://devfeed.tech/tags/enterprise-operations.md>), [gateways](<https://devfeed.tech/tags/gateways.md>), [heroku](<https://devfeed.tech/tags/heroku.md>), [logging](<https://devfeed.tech/tags/logging.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [monitoring-tools](<https://devfeed.tech/tags/monitoring-tools.md>), [mttr](<https://devfeed.tech/tags/mttr.md>), [new-relic](<https://devfeed.tech/tags/new-relic.md>), [operations](<https://devfeed.tech/tags/operations.md>), [performance-optimization](<https://devfeed.tech/tags/performance-optimization.md>), [private-spaces](<https://devfeed.tech/tags/private-spaces.md>), [security-compliance](<https://devfeed.tech/tags/security-compliance.md>)

### AI overview

Heroku's Private Space Logging centralizes logs from applications and the services they depend on within a Private Space, giving operations teams a consolidated view for monitoring and troubleshooting. The excerpt says this can help identify issues and reduce mean time to recovery. Setup involves creating a Private Space and providing a log drain URL, which directs its logs to a destination. The feature is described as working with Mezmo, SolarWinds, and New Relic. The excerpt also signals discussion of data residency and broader logging attributes, but does not provide their details.

### Source excerpt

Logging is the unsung hero of enterprise operations--quietly saving the day, one log line at a time. Imagine trying to maintain successful applications without knowing what's happening inside them. This would be like flying a plane blindfolded at night, in a storm, with no instruments. Spoiler alert: Neither scenario would end well! Today's distributed systems [...] The post Optimizing Enterprise Operations with Heroku's Advanced Logging Features appeared first on Heroku.

## Replacing AWS Step Functions with SQS FIFO queues and cutting the cost in half

DevFeed: [Replacing AWS Step Functions with SQS FIFO queues and cutting the cost in half](<https://devfeed.tech/articles/replacing-aws-step-functions-with-sqs-fifo-queues-and-cutting-the-cost-in-half-23900.md>)

Original publisher: [Read original article](<https://medium.com/smg-real-estate/replacing-aws-step-functions-with-sqs-fifo-queues-and-cutting-the-cost-in-half-9ab97e819b3a?source=rss----2186e5b9bd8f---4>)

Author: Alexei Liulin

Published: 2025-03-14T14:47:27Z

Content type: article

Language: en

Sources: [Homegate Engineering Blog - Medium](<https://devfeed.tech/sources/homegate-engineering-blog-medium.md>)

Topics: [scheduling](<https://devfeed.tech/topics/scheduling.md>), [AWS Step Functions](<https://devfeed.tech/topics/aws-step-functions.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [implementation](<https://devfeed.tech/topics/implementation.md>)

Tags: [alert](<https://devfeed.tech/tags/alert.md>), [alerts](<https://devfeed.tech/tags/alerts.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-step-functions](<https://devfeed.tech/tags/aws-step-functions.md>), [batching](<https://devfeed.tech/tags/batching.md>), [cloud-computing](<https://devfeed.tech/tags/cloud-computing.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cost-optimization](<https://devfeed.tech/tags/cost-optimization.md>), [deduplication](<https://devfeed.tech/tags/deduplication.md>), [email](<https://devfeed.tech/tags/email.md>), [fifo](<https://devfeed.tech/tags/fifo.md>), [lambda](<https://devfeed.tech/tags/lambda.md>), [notification](<https://devfeed.tech/tags/notification.md>), [notifications](<https://devfeed.tech/tags/notifications.md>), [push-notification](<https://devfeed.tech/tags/push-notification.md>), [push-notifications](<https://devfeed.tech/tags/push-notifications.md>), [queue](<https://devfeed.tech/tags/queue.md>), [queues](<https://devfeed.tech/tags/queues.md>), [real-estate](<https://devfeed.tech/tags/real-estate.md>), [sqs](<https://devfeed.tech/tags/sqs.md>), [sqs-queue](<https://devfeed.tech/tags/sqs-queue.md>), [step-functions](<https://devfeed.tech/tags/step-functions.md>)

### AI overview

SMG Real Estate replaced Step Functions for five-minute Search Alert batching with an SQS FIFO queue, cutting AWS costs in half and improving resilience to match spikes. Previously, each alert started a workflow that waited five minutes before invoking `LoadMatches`; repeated starts with the same execution name deduplicated pending work. The new flow uses FIFO's five-minute deduplication interval and delayed messages to batch equivalent messages containing a search alert ID. The team shadowed both flows, compared correlated trigger events and timing with Athena queries over exported CloudWatch logs, then routed a stable subset of alerts to each flow and gradually increased the FIFO share to 100%. FIFO pricing was cited as $0.48 per million messages versus $25 per million Step Functions state transitions. The approach suits five-minute batching; because FIFO deduplication lasts only five minutes, longer intervals still use Step Functions, with scheduled EventBridge triggers mentioned as a possible future option.

### Source excerpt

One of the core services for SMG Real Estate is Search Alerts -- a service that allows users to be notified about new properties published on ImmoScout24 and Homegate. For example, if a user is looking for a new apartment having N rooms and costing less than X, and not finding any matches now, they can create a search alert with those search criteria. When a new property matching those criteria is published, the user will be notified either via email or a mobile push notification. About the Search Alerts system Users can choose the frequency of notifications -- either every 5 minutes or every 4 hours (assuming there are any to be delivered). The vast majority of search alerts are configured with the 5-minute frequency. Just to get an idea of the scale, we have: Millions of published properties match saved search alerts every day More than a million emails and push notifications sent daily Check out our "Homegate's fast and modern search experience helps users find their dream home" blog post for an overview of how Search Alerts work. The Original Implementation In the original implementation we used an AWS Step Function to achieve the 5- minute batching of notifications: When a new property matching a search alert arrived, the StartSendNotificationProcess lambda would start a Step Function execution specific to that search alert. All it did was waiting for 5 minutes while the matches accumulated in the matches-{searchAlertId} SQS queue, which was programmatically created for that specific search alert If more matching listings arrived during the 5-minute waiting period, the StartSendNotificationProcess lambda attempted to start the step function execution with the same name. When it failed with the ExecutionAlreadyExists error, we knew there was already a SF for waiting. That way the deduplication of notification processes was guaranteed. After 5 minutes of waiting time, the Step Function execution proceeded with triggering the LoadMatches lambda that received the acc

## Cloud Logging Tip & Tricks: Getting the most value out of your cloud logs

DevFeed: [Cloud Logging Tip & Tricks: Getting the most value out of your cloud logs](<https://devfeed.tech/articles/cloud-logging-tip-tricks-getting-the-most-value-out-of-your-cloud-logs-53729.md>)

Original publisher: [Read original article](<https://www.wiz.io/blog/cloud-logging-tip-tricks-getting-the-most-value-out-of-your-cloud-logs>)

Author: Chris Champa

Published: 2024-10-08T14:12:15Z

Content type: article

Language: en

Sources: [Wiz](<https://devfeed.tech/sources/wiz-blog-rss-feed.md>)

Topics: [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [cloud security](<https://devfeed.tech/topics/cloud-security.md>), [Logging](<https://devfeed.tech/topics/logging.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Security Information and Event Management (SIEM)](<https://devfeed.tech/topics/siem-security.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [actions](<https://devfeed.tech/tags/actions.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-detection](<https://devfeed.tech/tags/cloud-detection.md>), [cloud-detection-and-response](<https://devfeed.tech/tags/cloud-detection-and-response.md>), [cloud-logging](<https://devfeed.tech/tags/cloud-logging.md>), [critical](<https://devfeed.tech/tags/critical.md>), [detection](<https://devfeed.tech/tags/detection.md>), [detection-and-response](<https://devfeed.tech/tags/detection-and-response.md>), [getting](<https://devfeed.tech/tags/getting.md>), [logging](<https://devfeed.tech/tags/logging.md>), [logs](<https://devfeed.tech/tags/logs.md>), [making](<https://devfeed.tech/tags/making.md>), [product](<https://devfeed.tech/tags/product.md>), [program](<https://devfeed.tech/tags/program.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [time](<https://devfeed.tech/tags/time.md>), [tip](<https://devfeed.tech/tags/tip.md>), [tricks](<https://devfeed.tech/tags/tricks.md>), [value](<https://devfeed.tech/tags/value.md>), [visibility](<https://devfeed.tech/tags/visibility.md>)

### AI overview

The excerpt recommends prioritizing control-plane or management logs because they cover activity across the attack chain, including sign-ins, resource changes, and discovery. It groups cloud logs by security use case and notes that S3 data events in CloudTrail can help detect data exfiltration. Provider guidance differs: AWS Organization Trails extend collection across accounts, with the first ongoing management-event copy to S3 free; Azure activity and Entra logs have 90-day and 7-30-day default retention, so diagnostic settings can extend it, while Azure control logs omit most read activity. GCP Admin Activity write logs are enabled by default and retained for 400 days, but read activity requires enabling Data Access ADMIN_READ; DATA_WRITE configuration events are also not on by default. Google Workspace logs are enabled by default and retained for six months; streaming them to GCP is free, though most categories omit error logs. The excerpt also recommends pairing log-based detection with runtime detectors and reassessing coverage as cloud environments change.

### Source excerpt

In the cloud, logs are often the only way to get real-time visibility into what's happening, making them critical to any cloud detection and response program.

## Cloud Logging Tips and Tricks

DevFeed: [Cloud Logging Tips and Tricks](<https://devfeed.tech/articles/cloud-logging-tips-and-tricks-53730.md>)

Original publisher: [Read original article](<https://www.wiz.io/blog/cloud-logging-tips-and-tricks>)

Author: Alice Klimovitsky

Published: 2024-09-17T14:00:00Z

Content type: tutorial

Language: en

Sources: [Wiz](<https://devfeed.tech/sources/wiz-blog-rss-feed.md>)

Topics: [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [cloud security](<https://devfeed.tech/topics/cloud-security.md>), [AWS CloudTrail](<https://devfeed.tech/topics/aws-cloudtrail.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Security Information and Event Management (SIEM)](<https://devfeed.tech/topics/siem-security.md>), [site-reliability-engineering](<https://devfeed.tech/topics/site-reliability-engineering.md>)

Tags: [best-practices](<https://devfeed.tech/tags/best-practices.md>), [cloud-logging](<https://devfeed.tech/tags/cloud-logging.md>), [cloud-security](<https://devfeed.tech/tags/cloud-security.md>), [cloudtrail](<https://devfeed.tech/tags/cloudtrail.md>), [data-exfiltration](<https://devfeed.tech/tags/data-exfiltration.md>), [detection-and-response](<https://devfeed.tech/tags/detection-and-response.md>), [product](<https://devfeed.tech/tags/product.md>)

### AI overview

This article previews a cloud logging guide focused on collecting, configuring, and prioritizing logs for cloud security and detection. It presents a framework that categorizes logs by identity, data, network, compute, and control-plane use cases, including monitoring S3 data events in CloudTrail to detect data exfiltration.

### Source excerpt

Getting the most value out of your cloud logs

## Audit log streaming beta update - Google Cloud Storage support

DevFeed: [Audit log streaming beta update - Google Cloud Storage support](<https://devfeed.tech/articles/audit-log-streaming-beta-update-google-cloud-storage-support-74226.md>)

Original publisher: [Read original article](<https://github.blog/changelog/2021-12-08-audit-log-streaming-beta-update-google-cloud-storage-support>)

Author: Becca Crockett

Published: 2021-12-08T16:43:41Z

Content type: release

Language: en

Sources: [GitHub Changelog](<https://devfeed.tech/sources/github-changelog.md>)

Topics: [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [log management](<https://devfeed.tech/topics/log-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>)

Tags: [audit](<https://devfeed.tech/tags/audit.md>), [beta](<https://devfeed.tech/tags/beta.md>), [github-enterprise-cloud](<https://devfeed.tech/tags/github-enterprise-cloud.md>), [google-cloud-storage](<https://devfeed.tech/tags/google-cloud-storage.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [update](<https://devfeed.tech/tags/update.md>)

### AI overview

GitHub Enterprise Cloud customers in the audit log streaming public beta can now configure streams to use Google Cloud Storage. This makes streamed enterprise audit events more readily available to tools that support Google Cloud Storage as a data source.

### Source excerpt

GitHub Enterprise Cloud customers participating in the audit log streaming public beta may now use Google Cloud Storage when configuring a stream. This will allow tools that support Google Cloud...

## Improving trust with Datadog Log Management

DevFeed: [Improving trust with Datadog Log Management](<https://devfeed.tech/articles/improving-trust-with-datadog-log-management-83472.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/engineering/improving-trust-with-datadog-log-management/>)

Author: Jules Denardou

Published: 2018-11-01T00:00:00Z

Content type: tutorial

Language: en

Sources: [Datadog](<https://devfeed.tech/sources/datadog.md>)

Topics: [log management](<https://devfeed.tech/topics/log-management.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [AWS Lambda](<https://devfeed.tech/topics/aws-lambda.md>), [aws-sns](<https://devfeed.tech/topics/aws-sns.md>), [Amazon CloudWatch](<https://devfeed.tech/topics/amazon-cloudwatch.md>)

Tags: [amazon-ses](<https://devfeed.tech/tags/amazon-ses.md>), [amazon-simple-email-service-ses](<https://devfeed.tech/tags/amazon-simple-email-service-ses.md>), [aws](<https://devfeed.tech/tags/aws.md>), [datadog](<https://devfeed.tech/tags/datadog.md>), [lambda](<https://devfeed.tech/tags/lambda.md>), [log-management](<https://devfeed.tech/tags/log-management.md>), [observability](<https://devfeed.tech/tags/observability.md>)

### AI overview

Datadog describes using Amazon SES, SNS, and Lambda to send email event data to Datadog Log Management. The setup makes password reset email events searchable for support teams and supports monitoring across the pipeline.

### Source excerpt

Integrating Amazon Simple Email Service with Datadog to improve observability.

## Exporting Logs to BigQuery, GCS, Pub/Sub through Stackdriver

DevFeed: [Exporting Logs to BigQuery, GCS, Pub/Sub through Stackdriver](<https://devfeed.tech/articles/exporting-logs-to-bigquery-gcs-pub-sub-through-stackdriver-48668.md>)

Original publisher: [Read original article](<https://istio.io/latest/blog/2018/export-logs-through-stackdriver/>)

Author: Nupur Garg and Douglas Reid

Published: 2018-07-09T00:00:00Z

Content type: tutorial

Language: en

Sources: [Istio](<https://devfeed.tech/sources/istio-blog.md>)

Topics: [istio](<https://devfeed.tech/topics/istio.md>), [Cloud Logging](<https://devfeed.tech/topics/cloud-logging.md>), [Cloud Monitoring](<https://devfeed.tech/topics/cloud-monitoring.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Security Information and Event Management (SIEM)](<https://devfeed.tech/topics/siem-security.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>)

Tags: [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cloud-pub-sub](<https://devfeed.tech/tags/cloud-pub-sub.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [istio](<https://devfeed.tech/tags/istio.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [logs](<https://devfeed.tech/tags/logs.md>), [mesh](<https://devfeed.tech/tags/mesh.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [permissions](<https://devfeed.tech/tags/permissions.md>), [services](<https://devfeed.tech/tags/services.md>), [stackdriver](<https://devfeed.tech/tags/stackdriver.md>)

### AI overview

A tutorial showing how to route Istio access logs through Stackdriver and export them to BigQuery, Google Cloud Storage, or Cloud Pub/Sub for analysis. It uses the Bookinfo sample application and covers sink setup, permissions, and related configuration.

### Source excerpt

This post shows how to direct Istio logs to Stackdriver and export those logs to various configured sinks such as such as BigQuery, Google Cloud Storage or Cloud Pub/Sub. At the end of this post you can perform analytics on Istio data from your favorite places such as BigQuery, GCS or Cloud Pub/Sub. The Bookinfo sample application is used as the example application throughout this task. Before you begin Install Istio in your cluster and deploy an application. Configuring Istio to export logs Istio exports logs using the logentry template. This specifies all the variables that are available for analysis. It contains information like source service, destination service, auth metrics (coming..) among others. Following is a diagram of the pipeline: Exporting logs from Istio to Stackdriver for analysis Istio supports exporting logs to Stackdriver which can in turn be configured to export logs to your favorite sink like BigQuery, Pub/Sub or GCS. Please follow the steps below to set up your favorite sink for exporting logs first and then Stackdriver in Istio. Setting up various log sinks Common setup for all sinks: Enable Stackdriver Monitoring API for the project. Make sure principalEmail that would be setting up the sink has write access to the project and Logging Admin role permissions. Make sure the GOOGLE_APPLICATION_CREDENTIALS environment variable is set. Please follow instructions here to set it up. BigQuery Create a BigQuery dataset as a destination for the logs export. Record the ID of the dataset. It will be needed to configure the Stackdriver handler. It would be of the form bigquery.googleapis.com/projects/[PROJECT_ID]/datasets/[DATASET_ID] Give sink's writer identity: cloud-logs@system.gserviceaccount.com BigQuery Data Editor role in IAM. If using Google Kubernetes Engine, make sure bigquery Scope is enabled on the cluster. Google Cloud Storage (GCS) Create a GCS bucket where you would like logs to get exported in GCS. Recode the ID of the bucket. It will be