# Cloud Storage

Published articles for Cloud Storage.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Backblaze B2 and WEKA NeuralMesh Validated as a Two-Tier AI Storage Pipeline, With Snap-to-Object Checkpoints in B2

DevFeed: [Backblaze B2 and WEKA NeuralMesh Validated as a Two-Tier AI Storage Pipeline, With Snap-to-Object Checkpoints in B2](<https://devfeed.tech/articles/backblaze-b2-and-weka-neuralmesh-validated-as-a-two-tier-ai-storage-pipeline-with-snap-to-object-checkpoints-in-b2-12360.md>)

Original publisher: [Read original article](<https://www.storagereview.com/news/backblaze-b2-and-weka-neuralmesh-validated-as-a-two-tier-ai-storage-pipeline-with-snap-to-object-checkpoints-landing-in-b2>)

Author: Harold Fritts

Published: 2026-09-10T20:40:57Z

Content type: news

Language: en

Sources: [StorageReview.com](<https://devfeed.tech/sources/storagereview-com.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [inference](<https://devfeed.tech/tags/inference.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [integration](<https://devfeed.tech/tags/integration.md>), [performance](<https://devfeed.tech/tags/performance.md>), [snapshots](<https://devfeed.tech/tags/snapshots.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Backblaze and WEKA validated a two-tier AI storage pipeline that uses WEKA NeuralMesh as the high-performance tier for GPU workloads and Backblaze B2 Cloud Storage as the capacity tier. Raw data, training sets, media, source files, checkpoints, and other assets can move between the tiers according to access needs. NeuralMesh's Snap-to-Object feature was also tested with B2 for storing consistent filesystem snapshots and supporting recovery.

### Source excerpt

Backblaze and WEKA have validated their two platforms together for AI pipelines, pairing WEKA NeuralMesh as the performance tier that feeds GPUs with Backblaze B2 Cloud Storage as the capacity tier that holds everything else. The integration, sizing, tuning, and testing are already done, so an AI infrastructure team can deploy a proven two-tier layout The post Backblaze B2 and WEKA NeuralMesh Validated as a Two-Tier AI Storage Pipeline, With Snap-to-Object Checkpoints in B2 appeared first on StorageReview.com.

## Backblaze B2 x Suite Studios: S3 Native File Streaming Turns B2 Cloud Storage Into a High-Performance Drive

DevFeed: [Backblaze B2 x Suite Studios: S3 Native File Streaming Turns B2 Cloud Storage Into a High-Performance Drive](<https://devfeed.tech/articles/backblaze-b2-x-suite-studios-s3-native-file-streaming-turns-b2-cloud-storage-into-a-high-performance-drive-12318.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/backblaze-b2-x-suite-studios-s3-native-file-streaming-turns-b2-cloud-storage-into-a-high-performance-drive/>)

Author: Dave Simon

Published: 2026-09-10T14:04:38Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Filesystems](<https://devfeed.tech/topics/filesystems.md>), [mount](<https://devfeed.tech/topics/mount.md>), [data](<https://devfeed.tech/topics/data.md>), [migration](<https://devfeed.tech/topics/migration.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [automation](<https://devfeed.tech/tags/automation.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [data](<https://devfeed.tech/tags/data.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [media](<https://devfeed.tech/tags/media.md>), [media-workflow](<https://devfeed.tech/tags/media-workflow.md>), [migration](<https://devfeed.tech/tags/migration.md>), [mount](<https://devfeed.tech/tags/mount.md>), [nas](<https://devfeed.tech/tags/nas.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [s3](<https://devfeed.tech/tags/s3.md>), [storage](<https://devfeed.tech/tags/storage.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

Backblaze B2 integrates with Suite Studios' S3 Native File Streaming to provide drive-like, high-performance access to cloud-stored data. Teams can mount B2 buckets, stream only the file portions applications need, and use standard S3-compatible objects without duplicating or relocating datasets. The integration supports media production and other workflows involving large cloud datasets.

### Source excerpt

Backblaze B2 now integrates with Suite Studios S3 Native File Streaming, giving teams high-performance, drive-like access to cloud data. Work directly with standard S3-compatible objects across media, scientific, geospatial, and engineering workflows without duplicating datasets or creating new storage silos. The post Backblaze B2 x Suite Studios: S3 Native File Streaming Turns B2 Cloud Storage Into a High-Performance Drive appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Introducing the Backblaze B2 MCP Server

DevFeed: [Introducing the Backblaze B2 MCP Server](<https://devfeed.tech/articles/introducing-the-backblaze-b2-mcp-server-12322.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/introducing-the-backblaze-b2-mcp-server/>)

Author: Jeronimo De Leon

Published: 2026-09-08T18:13:00Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [MCP Server](<https://devfeed.tech/topics/mcp-server.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [api](<https://devfeed.tech/tags/api.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [developers](<https://devfeed.tech/tags/developers.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [storage](<https://devfeed.tech/tags/storage.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

### AI overview

Backblaze introduces an open-source B2 MCP Server that lets AI agents operate cloud object storage through MCP-compatible clients. Access is constrained by the permissions of the connected B2 application key, including limits on buckets and operations.

### Source excerpt

The Backblaze B2 MCP Server gives AI agents a safe, standard way to operate cloud object storage. Connect MCP-compatible clients to scoped B2 application keys, manage files and buckets, move large objects directly, and control destructive actions with configurable safeguards. The post Introducing the Backblaze B2 MCP Server appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Four Platforms, One Timeline: Bringing TAMS Workflow to Life on Backblaze B2

DevFeed: [Four Platforms, One Timeline: Bringing TAMS Workflow to Life on Backblaze B2](<https://devfeed.tech/articles/four-platforms-one-timeline-bringing-tams-workflow-to-life-on-backblaze-b2-12321.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/four-platforms-one-timeline-bringing-tams-workflow-to-life-on-backblaze-b2/>)

Author: Dave Simon

Published: 2026-09-03T14:23:57Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [API](<https://devfeed.tech/topics/api.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [browser](<https://devfeed.tech/topics/browser.md>), [systems](<https://devfeed.tech/topics/systems.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [article](<https://devfeed.tech/tags/article.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [browser](<https://devfeed.tech/tags/browser.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [media](<https://devfeed.tech/tags/media.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

The article explains how Time Addressable Media Store (TAMS) organizes live media by timeline-based, timestamped segments in object storage. It describes a cloud-native, interoperable workflow built around Backblaze B2 and ecosystem partners LiveWyer, CuttingRoom, and Drastic Technologies, enabling ingest, editing, distribution, playback, and archiving through shared access to the same content.

### Source excerpt

TAMS organizes live media by time, giving distributed production teams faster access to shared footage. See how Backblaze B2, LiveWyer, CuttingRoom, and Drastic Technologies create an interoperable, cloud-native workflow for ingest, editing, playback, distribution, and archive with economics at scale. The post Four Platforms, One Timeline: Bringing TAMS Workflow to Life on Backblaze B2 appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Code42 Is Shutting Down. Is CrashPlan the Safe Choice, or Just the Convenient One?

DevFeed: [Code42 Is Shutting Down. Is CrashPlan the Safe Choice, or Just the Convenient One?](<https://devfeed.tech/articles/code42-is-shutting-down-is-crashplan-the-safe-choice-or-just-the-convenient-one-12320.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/code42-is-shutting-down-is-crashplan-the-safe-choice-or-just-the-convenient-one/>)

Author: Kari Wilson

Published: 2026-09-01T16:00:37Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [migration](<https://devfeed.tech/topics/migration.md>), [Tooling](<https://devfeed.tech/topics/tooling.md>), [data loss prevention](<https://devfeed.tech/topics/data-loss-prevention.md>)

Tags: [alternatives](<https://devfeed.tech/tags/alternatives.md>), [backing-up](<https://devfeed.tech/tags/backing-up.md>), [backup](<https://devfeed.tech/tags/backup.md>), [blog](<https://devfeed.tech/tags/blog.md>), [businessbackup](<https://devfeed.tech/tags/businessbackup.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-backing-up](<https://devfeed.tech/tags/featured-backing-up.md>), [migration](<https://devfeed.tech/tags/migration.md>), [post](<https://devfeed.tech/tags/post.md>)

### AI overview

The article examines whether CrashPlan is an appropriate replacement for Code42 after Code42 stopped new sales in 2025 and plans to end support in 2026, with subsequent deletion of backup archives. It explains that Code42's backup business became a separate CrashPlan company in 2022 and urges IT teams to evaluate alternatives rather than assume CrashPlan is an automatic successor. It highlights migration incentives and a possible 5TB storage cap on some CrashPlan plans.

### Source excerpt

Code42 support ends in 2026, but CrashPlan isn't the automatic successor it appears to be. Before migrating, understand the companies' split, CrashPlan's ownership, potential storage limits, evolving positioning, and the questions IT teams should ask when evaluating better backup alternatives. The post Code42 Is Shutting Down. Is CrashPlan the Safe Choice, or Just the Convenient One? appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Backblaze B2 To Encrypt New Uploads by Default

DevFeed: [Backblaze B2 To Encrypt New Uploads by Default](<https://devfeed.tech/articles/backblaze-b2-to-encrypt-new-uploads-by-default-12317.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/backblaze-b2-to-encrypt-new-uploads-by-default/>)

Author: Backblaze

Published: 2026-08-27T13:00:00Z

Content type: release

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [Cloud](<https://devfeed.tech/topics/cloud.md>), [Encryption](<https://devfeed.tech/topics/encryption.md>), [Security](<https://devfeed.tech/topics/security.md>), [configuration](<https://devfeed.tech/topics/configuration.md>)

Tags: [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [encryption](<https://devfeed.tech/tags/encryption.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [secure-by-default](<https://devfeed.tech/tags/secure-by-default.md>), [security](<https://devfeed.tech/tags/security.md>), [storage](<https://devfeed.tech/tags/storage.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>), [update](<https://devfeed.tech/tags/update.md>)

### AI overview

Backblaze B2 will automatically apply server-side AES-256 encryption to newly uploaded and copied object data at rest. SSE-B2 requires no application changes, added cost, or performance tradeoff, while SSE-C remains available for objects encrypted with customer-provided keys.

### Source excerpt

Starting September 14, Backblaze B2 will automatically encrypt every new upload and destination copy at rest with AES-256. Always-on SSE-B2 strengthens security without application changes, added costs, or performance impact, while preserving SSE-C for customer-managed encryption keys when required instead. The post Backblaze B2 To Encrypt New Uploads by Default appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## How Adobe Reduced GPU Idle Time in Generative AI Training Through Faster Data Access and Checkpointing

DevFeed: [How Adobe Reduced GPU Idle Time in Generative AI Training Through Faster Data Access and Checkpointing](<https://devfeed.tech/articles/why-your-gpu-is-sitting-idle-the-data-pipeline-problem-no-one-talks-about-12325.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/why-your-gpu-is-sitting-idle-the-data-pipeline-problem-no-one-talks-about/>)

Author: Maddie Presland

Published: 2026-08-25T15:22:30Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [GPU](<https://devfeed.tech/topics/gpu.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [networking](<https://devfeed.tech/topics/networking.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [compute](<https://devfeed.tech/tags/compute.md>), [ethernet](<https://devfeed.tech/tags/ethernet.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [model-training](<https://devfeed.tech/tags/model-training.md>), [networking](<https://devfeed.tech/tags/networking.md>)

### AI overview

Adobe's generative AI training pipeline left roughly two-thirds of GPU time waiting for data. The article attributes the waste to storage and retrieval bottlenecks, networking limits, and checkpointing overhead, and describes Adobe's use of a high-performance networking fabric and fragmented checkpoint storage to reduce delays.

### Source excerpt

Adobe's experience reveals why GPUs sit idle during AI model training: slow storage, insufficient throughput, and uneven workloads. Learn how storage bottlenecks and uneven data loading leave expensive GPUs idle--and how always-hot, high-throughput object storage keeps AI training pipelines running efficiently at scale while reducing wasted compute costs. The post Why Your GPU Is Sitting Idle: The Data Pipeline Problem No One Talks About appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Results from the Backblaze Generative AI Media Hackathon

DevFeed: [Results from the Backblaze Generative AI Media Hackathon](<https://devfeed.tech/articles/results-from-the-backblaze-generative-ai-media-hackathon-12324.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/results-from-the-backblaze-generative-ai-media-hackathon/>)

Author: Jeronimo De Leon

Published: 2026-08-14T15:52:05Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [For the Love of Code](<https://devfeed.tech/topics/for-the-love-of-code.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [developer](<https://devfeed.tech/tags/developer.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [generative](<https://devfeed.tech/tags/generative.md>), [hackathon](<https://devfeed.tech/tags/hackathon.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [tech-lab](<https://devfeed.tech/tags/tech-lab.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

The article examines the strongest projects from the Backblaze Generative AI Media Hackathon and argues that production-ready generative media applications depend on more than generating images, video, or audio. It highlights storage design, provenance, verification, correction, deletion protection, and orchestration across multiple providers.

### Source excerpt

See what the strongest projects from the Backblaze Generative AI Media Hackathon had in common. These five generative media apps show how storage and orchestration become part of production-ready design. The post Results from the Backblaze Generative AI Media Hackathon appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## Backblaze Drive Stats: How an Open Dataset Powers Academic and AI/ML Research

DevFeed: [Backblaze Drive Stats: How an Open Dataset Powers Academic and AI/ML Research](<https://devfeed.tech/articles/backblaze-drive-stats-how-an-open-dataset-powers-academic-and-ai-ml-research-12319.md>)

Original publisher: [Read original article](<https://www.backblaze.com/blog/backblaze-drive-stats-academic-ai-ml-research/>)

Author: Stephanie Doyle

Published: 2026-08-13T15:08:38Z

Content type: article

Language: en

Sources: [Backblaze Blog | Cloud Storage & Cloud Backup](<https://devfeed.tech/sources/backblaze-blog-cloud-storage-cloud-backup.md>)

Topics: [dataset](<https://devfeed.tech/topics/dataset.md>), [DRIVE](<https://devfeed.tech/topics/drive.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [Disk image](<https://devfeed.tech/topics/disk-image.md>)

Tags: [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [articles](<https://devfeed.tech/tags/articles.md>), [b2cloud](<https://devfeed.tech/tags/b2cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [data](<https://devfeed.tech/tags/data.md>), [drive](<https://devfeed.tech/tags/drive.md>), [featured](<https://devfeed.tech/tags/featured.md>), [featured-cloud-storage](<https://devfeed.tech/tags/featured-cloud-storage.md>), [hard-drive-stats](<https://devfeed.tech/tags/hard-drive-stats.md>), [ml](<https://devfeed.tech/tags/ml.md>), [research](<https://devfeed.tech/tags/research.md>), [source](<https://devfeed.tech/tags/source.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

The article explains how Backblaze Drive Stats evolved from an internal hard-drive reliability tool into an open dataset used in academic and AI/ML research. It describes the dataset's real-world scale, quarterly publication, SMART attributes, labeled failures, broad manufacturer coverage, and use in hard-drive failure prediction research.

### Source excerpt

Backblaze Drive Stats has been cited in more than 105 academic papers and AI/ML projects since 2018. Explore the research it powers and download the dataset. The post Backblaze Drive Stats: How an Open Dataset Powers Academic and AI/ML Research appeared first on Backblaze Blog | Cloud Storage & Cloud Backup

## How Redpanda Cloud Topics rethinks Kafka compaction

DevFeed: [How Redpanda Cloud Topics rethinks Kafka compaction](<https://devfeed.tech/articles/how-redpanda-cloud-topics-rethinks-kafka-compaction-12705.md>)

Original publisher: [Read original article](<https://www.redpanda.com/blog/how-redpanda-cloud-topics-rethinks-kafka-compaction>)

Author: Willem Kaufmann

Published: 2026-06-30T00:00:00Z

Content type: article

Language: en

Sources: [Redpanda](<https://devfeed.tech/sources/redpanda.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Algorithm](<https://devfeed.tech/topics/algorithm.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cycles](<https://devfeed.tech/tags/cycles.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [reduce](<https://devfeed.tech/tags/reduce.md>), [retention](<https://devfeed.tech/tags/retention.md>), [scale](<https://devfeed.tech/tags/scale.md>), [storage](<https://devfeed.tech/tags/storage.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

The article explains how Redpanda Cloud Topics redesigns Kafka log compaction for cloud-native streaming. It describes how the architecture reduces redundant processing and CPU use, lowers cloud storage costs, and preserves Kafka behavior while addressing scaling challenges such as limited memory, tombstone removal, and rewriting large volumes of object storage data.

### Source excerpt

Compaction can overwhelm poorly sized Kafka clusters, leading to full disks and maxed-out CPUs. Learn how Redpanda's Cloud Topics architecture redesigns compaction to cut redundant work, reduce cloud storage costs, and preserve the Kafka semantics you rely on.

## ClickPy at 2 Trillion rows: Scaling ingestion and fixing the past

DevFeed: [ClickPy at 2 Trillion rows: Scaling ingestion and fixing the past](<https://devfeed.tech/articles/clickpy-at-2-trillion-rows-scaling-ingestion-and-fixing-the-past-5184.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/clickpy-2-trillion-rows>)

Author: Lionel Palacin

Published: 2026-01-21T10:48:32Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [data](<https://devfeed.tech/topics/data.md>), [Python](<https://devfeed.tech/topics/python.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Code](<https://devfeed.tech/topics/code.md>), [Scripting](<https://devfeed.tech/topics/scripting.md>)

Tags: [bigquery](<https://devfeed.tech/tags/bigquery.md>), [blog](<https://devfeed.tech/tags/blog.md>), [blog-post](<https://devfeed.tech/tags/blog-post.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [code](<https://devfeed.tech/tags/code.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [operational](<https://devfeed.tech/tags/operational.md>), [python](<https://devfeed.tech/tags/python.md>), [scale](<https://devfeed.tech/tags/scale.md>), [scripting](<https://devfeed.tech/tags/scripting.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

ClickPy has grown to more than 2 trillion Python package-download rows dating back to 2011. This article describes replacing a custom, cron-based ingestion script with ClickPipes and correcting historical data while keeping the service available and ingestion uninterrupted.

### Source excerpt

A look at how ClickPy handles over 2 trillion Python package downloads, from ingestion redesign to fixing historical data at scale.

## How to use Vertex AI Prompt Optimizer with ground truth data

DevFeed: [How to use Vertex AI Prompt Optimizer with ground truth data](<https://devfeed.tech/articles/boost-accuracy-with-the-prompt-optimizer-16647.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2026/01/boost-accuracy-with-the-prompt-optimizer>)

Author: Alexander Nohe; Elena Erbiceanu Tener

Published: 2026-01-20T00:00:00Z

Content type: tutorial

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [Google](<https://devfeed.tech/topics/google.md>), [CSV](<https://devfeed.tech/topics/csv.md>), [data](<https://devfeed.tech/topics/data.md>), [Firebase](<https://devfeed.tech/topics/firebase.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [data](<https://devfeed.tech/tags/data.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [format](<https://devfeed.tech/tags/format.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [learn](<https://devfeed.tech/tags/learn.md>), [quality](<https://devfeed.tech/tags/quality.md>), [vertex](<https://devfeed.tech/tags/vertex.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>)

### AI overview

This tutorial explains how to use Vertex AI Prompt Optimizer with ground truth data to iteratively tune prompts and evaluate output quality. It describes preparing scripts and target descriptions in a Google Sheet, exporting the data as CSV, uploading it to Google Cloud Storage, and configuring optimization in a Colab Enterprise notebook.

### Source excerpt

Learn how to use the Vertex AI Prompt Optimizer to automatically tune your prompts to get better results by iterating on your prompts and then running an evaluation on the outputs assessing their quality to see if it has improved.

## Streaming IoT and event data into Snowflake and ClickHouse

DevFeed: [Streaming IoT and event data into Snowflake and ClickHouse](<https://devfeed.tech/articles/streaming-iot-and-event-data-into-snowflake-and-clickhouse-12773.md>)

Original publisher: [Read original article](<https://www.redpanda.com/blog/stream-iot-snowflake-clickhouse>)

Author: Mdu Sibisi

Published: 2025-12-09T00:00:00Z

Content type: tutorial

Language: en

Sources: [Redpanda](<https://devfeed.tech/sources/redpanda.md>)

Topics: [Internet of things](<https://devfeed.tech/topics/iot.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Redpanda-Connect](<https://devfeed.tech/topics/redpanda-connect.md>), [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [data-governance](<https://devfeed.tech/topics/data-governance.md>), [DataOps](<https://devfeed.tech/topics/dataops.md>), [Database](<https://devfeed.tech/topics/database.md>)

Tags: [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [data](<https://devfeed.tech/tags/data.md>), [data-governance](<https://devfeed.tech/tags/data-governance.md>), [event](<https://devfeed.tech/tags/event.md>), [iot](<https://devfeed.tech/tags/iot.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [redpanda-connect](<https://devfeed.tech/tags/redpanda-connect.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

A guide to streaming IoT and event data through Redpanda and Redpanda Connect into Snowflake and ClickHouse. It compares ClickHouse for real-time analysis with Snowflake for scalable cloud storage, historical reporting, and querying, while discussing governance, compression, data freshness, and robust pipeline design.

### Source excerpt

Learn how to stream IoT and event data into Snowflake and ClickHouse using Redpanda

## Moving Thanos from GCS to Huawei OBS, and fixing a multipart upload bug on the way

DevFeed: [Moving Thanos from GCS to Huawei OBS, and fixing a multipart upload bug on the way](<https://devfeed.tech/articles/moving-thanos-from-gcs-to-huawei-obs-and-fixing-a-multipart-upload-bug-on-the-way-34034.md>)

Original publisher: [Read original article](<https://andikaahmad.com/blog/thanos-objstore-huawei-obs/>)

Published: 2025-10-20T00:00:00Z

Content type: article

Language: en

Sources: [Andika Ahmad Ramadhan -- Blog](<https://devfeed.tech/sources/andika-ahmad-ramadhan-blog.md>)

Topics: [huawei](<https://devfeed.tech/topics/huawei.md>), [migration](<https://devfeed.tech/topics/migration.md>), [bug](<https://devfeed.tech/topics/bug.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [Code](<https://devfeed.tech/topics/code.md>)

Tags: [bug](<https://devfeed.tech/tags/bug.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [code](<https://devfeed.tech/tags/code.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [huawei](<https://devfeed.tech/tags/huawei.md>), [migration](<https://devfeed.tech/tags/migration.md>)

### AI overview

This article describes migrating Thanos object storage from Google Cloud Storage to Huawei Cloud OBS. The migration exposed two multipart upload bugs in the OBS provider: a zero-value part size and a content-length mismatch. A patch addressed both issues, although the upstream change was still under review when the article was written.

### Source excerpt

What broke when Thanos blocks started landing in Huawei Cloud OBS instead of Google Cloud Storage, and the objstore patch that fixed it.

## How to integrate Firebase services in Firebase Studio

DevFeed: [How to integrate Firebase services in Firebase Studio](<https://devfeed.tech/articles/from-vibe-to-reality-integrating-firebase-in-firebase-studio-16618.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2025/07/integrating-firebase-in-firebase-studio>)

Author: Yvonne Monterroso; James O'Reilly

Published: 2025-07-22T10:05:00Z

Content type: tutorial

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Appwrite](<https://devfeed.tech/topics/appwrite.md>), [Authentication](<https://devfeed.tech/topics/authentication.md>), [Firestore](<https://devfeed.tech/topics/firestore.md>), [MCP Server](<https://devfeed.tech/topics/mcp-server.md>), [Vibe coding](<https://devfeed.tech/topics/vibe-coding.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [app](<https://devfeed.tech/tags/app.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [backend](<https://devfeed.tech/tags/backend.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firebase-studio](<https://devfeed.tech/tags/firebase-studio.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [generate](<https://devfeed.tech/tags/generate.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [prototyping](<https://devfeed.tech/tags/prototyping.md>), [tutorials](<https://devfeed.tech/tags/tutorials.md>), [vibe-coding](<https://devfeed.tech/tags/vibe-coding.md>)

### AI overview

This tutorial explains two ways to connect Firebase Authentication, Firestore, and Cloud Storage to apps built in Firebase Studio: generating an integrated application with the App Prototyping agent or using the Firebase MCP server in interactive chat.

### Source excerpt

News, tutorials, and updates from the Firebase team.

## Fueld.AI's nutrition coach with Firebase and Google Cloud

DevFeed: [Fueld.AI's nutrition coach with Firebase and Google Cloud](<https://devfeed.tech/articles/fueld-ai-s-nutrition-coach-with-firebase-and-google-cloud-16611.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2025/06/fueld-ai-app-coach>)

Author: Raïssa Tona

Published: 2025-06-25T00:00:00Z

Content type: article

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Cloud Functions](<https://devfeed.tech/topics/cloud-functions.md>), [Firestore](<https://devfeed.tech/topics/firestore.md>), [Genkit](<https://devfeed.tech/topics/genkit.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [cloud-functions](<https://devfeed.tech/tags/cloud-functions.md>), [cloud-logging](<https://devfeed.tech/tags/cloud-logging.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [genkit](<https://devfeed.tech/tags/genkit.md>), [google-analytics](<https://devfeed.tech/tags/google-analytics.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [hosting](<https://devfeed.tech/tags/hosting.md>), [news](<https://devfeed.tech/tags/news.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>)

### AI overview

Fueld.AI used Firebase and Google Cloud services to build a health and nutrition app that analyzes meal photos, provides AI coaching, and securely shares data with health professionals. The article describes its use of Authentication, Cloud Storage, Cloud Functions, Genkit, Gemini, Cloud Firestore, Hosting, Analytics, and Cloud Logging.

### Source excerpt

News, tutorials, and updates from the Firebase team.

## Firebase MCP Server

DevFeed: [Firebase MCP Server](<https://devfeed.tech/articles/firebase-mcp-server-16603.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2025/05/firebase-mcp-server>)

Author: Michael Bleigh

Published: 2025-05-20T10:47:00Z

Content type: release

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [MCP Server](<https://devfeed.tech/topics/mcp-server.md>), [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [Firebase CLI](<https://devfeed.tech/topics/firebase-cli.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [cloud-messaging](<https://devfeed.tech/tags/cloud-messaging.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [experimental](<https://devfeed.tech/tags/experimental.md>), [explore](<https://devfeed.tech/tags/explore.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firebase-cli](<https://devfeed.tech/tags/firebase-cli.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [google-i-o](<https://devfeed.tech/tags/google-i-o.md>), [launch](<https://devfeed.tech/tags/launch.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [security-rules](<https://devfeed.tech/tags/security-rules.md>)

### AI overview

Firebase announces an experimental Firebase MCP Server, integrated with the Firebase CLI, that lets AI assistants and coding agents use standardized tools to configure, build, manage, and observe Firebase applications. The article describes capabilities including project setup, user management, Firestore access, GraphQL queries, security-rule validation, messaging, Remote Config deployment, crash monitoring, and Cloud Storage URL generation.

### Source excerpt

News, tutorials, and updates from the Firebase team.

## We're Cutting Storage Costs (Automatically)

DevFeed: [We're Cutting Storage Costs (Automatically)](<https://devfeed.tech/articles/we-re-cutting-storage-costs-automatically-5159.md>)

Original publisher: [Read original article](<https://neon.com/blog/cutting-storage-costs>)

Author: Anna Stepanyan

Published: 2024-11-21T00:26:43Z

Content type: article

Language: en

Sources: [Blog -- Neon Docs](<https://devfeed.tech/sources/blog-neon-docs.md>)

Topics: [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Database](<https://devfeed.tech/topics/database.md>), [Cache](<https://devfeed.tech/topics/cache.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [Developer experience](<https://devfeed.tech/topics/developer-experience.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [availability](<https://devfeed.tech/tags/availability.md>), [azure](<https://devfeed.tech/tags/azure.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [company](<https://devfeed.tech/tags/company.md>), [data](<https://devfeed.tech/tags/data.md>), [developer-experience](<https://devfeed.tech/tags/developer-experience.md>), [performance](<https://devfeed.tech/tags/performance.md>), [ssd](<https://devfeed.tech/tags/ssd.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Neon is reducing storage costs for inactive database branches automatically. Branches that have been idle for at least one day and are older than two weeks are archived by evicting their data from the Pageserver's high-performance SSD cache while retaining it in durable cloud object storage such as Amazon S3 or Azure Blob Storage. When accessed again, a branch is automatically reactivated, with a small first-query delay while its data is reloaded into the cache.

### Source excerpt

Starting December 1st, many Neon users will see lower storage costs. Inactive branches--those idle for at least a day and older than 2 weeks--will now be charged at a reduced per-GB rate. If this applies to you, there's nothing you need to do--it all happens automatically. Simply en...

## Trippy Wins the Gemini API Developer Competition with a Firebase-Powered Travel App

DevFeed: [Trippy Wins the Gemini API Developer Competition with a Firebase-Powered Travel App](<https://devfeed.tech/articles/trippy-your-ai-travel-guide-built-with-firebase-and-gemini-16571.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2024/11/gemini-competition-best-firebase-app>)

Author: Lloyd Hightower

Published: 2024-11-21T00:00:00Z

Content type: news

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [API](<https://devfeed.tech/topics/api.md>), [App](<https://devfeed.tech/topics/app.md>), [Cloud Functions](<https://devfeed.tech/topics/cloud-functions.md>), [Firestore](<https://devfeed.tech/topics/firestore.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [Authentication](<https://devfeed.tech/topics/authentication.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [real-time](<https://devfeed.tech/topics/real-time.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [app](<https://devfeed.tech/tags/app.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [backend](<https://devfeed.tech/tags/backend.md>), [cloud-functions](<https://devfeed.tech/tags/cloud-functions.md>), [cloud-messaging](<https://devfeed.tech/tags/cloud-messaging.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [messaging](<https://devfeed.tech/tags/messaging.md>), [news](<https://devfeed.tech/tags/news.md>), [notifications](<https://devfeed.tech/tags/notifications.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [recognition](<https://devfeed.tech/tags/recognition.md>), [recommendations](<https://devfeed.tech/tags/recommendations.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [storage](<https://devfeed.tech/tags/storage.md>), [travel](<https://devfeed.tech/tags/travel.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>)

### AI overview

Firebase announces Trippy as the winner of its Gemini API Developer Competition. The travel app combines Gemini with Firebase services to provide personalized itineraries, recommendations, multilingual support, games, receipt-based expense tracking, currency conversion, and contextual chat.

### Source excerpt

News, tutorials, and updates from the Firebase team.

## Firestore for Image Embeddings

DevFeed: [Firestore for Image Embeddings](<https://devfeed.tech/articles/firestore-for-image-embeddings-23888.md>)

Original publisher: [Read original article](<https://medium.com/firebase-developers/firestore-for-image-embeddings-f3fa2a5a5058?source=rss----8e8b7dc6774d---4>)

Author: Mete Atamel

Published: 2024-10-29T19:13:03Z

Content type: tutorial

Language: en

Sources: [Firebase Developers - Medium](<https://devfeed.tech/sources/firebase-developers-medium.md>)

Topics: [Firestore](<https://devfeed.tech/topics/firestore.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [generative-ai-tools](<https://devfeed.tech/tags/generative-ai-tools.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [llms](<https://devfeed.tech/tags/llms.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [software-development](<https://devfeed.tech/tags/software-development.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

A tutorial showing how to use FirestoreVectorStore and LangChain to generate, store, and retrieve image embeddings for similarity search. It covers multimodal embedding models, images from local storage, Google Cloud Storage, and the web, plus text- and image-based queries.

### Source excerpt

Powering LLMs with Firestore In my previous post about Firestore for Text Embedding and Similarity Search, I talked about how Firestore and LangChain can help you to store text embeddings and do similarity searches against them. With multimodal embedding models, you can generate embeddings not only for text but for images and video as well. In this post, I will show you how to store image embeddings in Firestore and later use them for similarity search. Image embeddings support in FirestoreVectorStore As a recap from the previous post, the Firestore for LangChain project provides a FirestoreVectorStore which simplifies storage and retrieval of embeddings. Initially, FirestoreVectorStore only supported text embeddings, but we recently added a new add_images method to store image embeddings. Likewise, we added the similarity_search_image method to run similarity searches with image embeddings. Let's take a closer look at how you can use FirestoreVectorStore in LangChain to work with image embeddings. First, you need to create a multimodal embedding model that can embed images: from langchain_google_vertexai import VertexAIEmbeddings embedding = VertexAIEmbeddings( model_name="multimodalembedding", project=PROJECT_ID, location="us-central1" ) Then, you create a Firestore-backed vector store with the embedding model: from langchain_google_firestore import FirestoreVectorStore vector_store = FirestoreVectorStore( collection=COLLECTION_NAME, embedding_service=embedding, ) Now, you can add images stored locally, in Google Cloud Storage, or any image on the web as follows: ids = ["landmark1.png", "landmark2.png", "landmark3.png"] image_paths = [ "gs://your-storage-bucket/landmark1.png", "./images/landmark2.png", "https://your-website/images/landmark3.png", ] vector_store.add_images(image_paths, ids=ids) This creates embeddings for each image and saves them to Firestore. Afterwards, you can perform a similarity search with a text query: vector_store.similarity_search("stadiu

## Vertex AI in Firebase is now Generally Available

DevFeed: [Vertex AI in Firebase is now Generally Available](<https://devfeed.tech/articles/vertex-ai-in-firebase-is-now-generally-available-16566.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2024/10/vertex-ai-in-firebase-ga>)

Author: Miguel Ramos

Published: 2024-10-21T00:00:00Z

Content type: release

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Google AI](<https://devfeed.tech/topics/google-ai.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>), [API](<https://devfeed.tech/topics/api.md>), [JSON](<https://devfeed.tech/topics/json.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Web](<https://devfeed.tech/topics/web.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-logic](<https://devfeed.tech/tags/ai-logic.md>), [android](<https://devfeed.tech/tags/android.md>), [api](<https://devfeed.tech/tags/api.md>), [app-check](<https://devfeed.tech/tags/app-check.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [flutter](<https://devfeed.tech/tags/flutter.md>), [function-calling](<https://devfeed.tech/tags/function-calling.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [ios](<https://devfeed.tech/tags/ios.md>), [javascript](<https://devfeed.tech/tags/javascript.md>), [json](<https://devfeed.tech/tags/json.md>), [launch](<https://devfeed.tech/tags/launch.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [remote-config](<https://devfeed.tech/tags/remote-config.md>), [sdks](<https://devfeed.tech/tags/sdks.md>), [structured-output](<https://devfeed.tech/tags/structured-output.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Firebase announces the general availability of Vertex AI in Firebase, enabling mobile and web apps to access Gemini models through Firebase client SDKs. The release includes support for multimodal prompting, system instructions, function calling, and structured JSON output with schemas.

### Source excerpt

Securely add generative AI features to your app using Firebase client SDKs

## Introducing Vertex AI for Firebase

DevFeed: [Introducing Vertex AI for Firebase](<https://devfeed.tech/articles/introducing-vertex-ai-for-firebase-16550.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2024/05/introducing-vertex-ai-firebase>)

Author: Miguel Ramos; Rachel Saunders

Published: 2024-05-14T03:00:00Z

Content type: release

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Google AI](<https://devfeed.tech/topics/google-ai.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>), [API](<https://devfeed.tech/topics/api.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [Web](<https://devfeed.tech/topics/web.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-logic](<https://devfeed.tech/tags/ai-logic.md>), [api](<https://devfeed.tech/tags/api.md>), [app-check](<https://devfeed.tech/tags/app-check.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firebase-remote-config](<https://devfeed.tech/tags/firebase-remote-config.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [launch](<https://devfeed.tech/tags/launch.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [remote-config](<https://devfeed.tech/tags/remote-config.md>), [sdks](<https://devfeed.tech/tags/sdks.md>), [vertex](<https://devfeed.tech/tags/vertex.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Google introduces Vertex AI for Firebase, providing client SDKs that let mobile and web applications use the Vertex AI Gemini API and run inference across Gemini models without requiring a separate backend service layer.

### Source excerpt

Build AI features with the Vertex AI Gemini API using Firebase's new client SDKs

## Introducing Workflow History Export

DevFeed: [Introducing Workflow History Export](<https://devfeed.tech/articles/introducing-workflow-history-export-35896.md>)

Original publisher: [Read original article](<https://temporal.io/blog/introducing-workflow-history-export>)

Author: Nikitha Suryadevara

Published: 2024-03-01T07:00:00Z

Content type: release

Language: en

Sources: [Temporal Blog](<https://devfeed.tech/sources/temporal-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [AWS CloudFormation](<https://devfeed.tech/topics/aws-cloudformation.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [audit](<https://devfeed.tech/topics/audit.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>)

Tags: [audit](<https://devfeed.tech/tags/audit.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-cloudformation](<https://devfeed.tech/tags/aws-cloudformation.md>), [aws-s3](<https://devfeed.tech/tags/aws-s3.md>), [cli](<https://devfeed.tech/tags/cli.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [export](<https://devfeed.tech/tags/export.md>), [preview](<https://devfeed.tech/tags/preview.md>), [product-news](<https://devfeed.tech/tags/product-news.md>), [production](<https://devfeed.tech/tags/production.md>), [release](<https://devfeed.tech/tags/release.md>), [s3](<https://devfeed.tech/tags/s3.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

Temporal Cloud has introduced Workflow History Export, allowing users to export closed workflow histories by namespace to an AWS S3 bucket. The feature supports longer-term retention for compliance, auditing, and analysis and is available to all users in Public Preview for production use.

### Source excerpt

Workflow History Export in Temporal Cloud allows users to export closed workflow histories on a per-namespace basis to an AWS S3 cloud storage bucket.

## Firebase announces its first Demo Day with 10 demos and technical resources

DevFeed: [Firebase announces its first Demo Day with 10 demos and technical resources](<https://devfeed.tech/articles/see-what-s-new-what-s-possible-with-firebase-at-demo-day-16531.md>)

Original publisher: [Read original article](<https://firebase.blog/posts/2023/11/demo-day>)

Author: Annum Munir

Published: 2023-11-08T00:00:00Z

Content type: release

Language: en

Sources: [Firebase Blog](<https://devfeed.tech/sources/firebase-blog.md>)

Topics: [Firebase](<https://devfeed.tech/topics/firebase.md>), [Development](<https://devfeed.tech/topics/development.md>), [Google](<https://devfeed.tech/topics/google.md>), [Flutter](<https://devfeed.tech/topics/flutter.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [android](<https://devfeed.tech/tags/android.md>), [app-distribution](<https://devfeed.tech/tags/app-distribution.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [cloud-functions](<https://devfeed.tech/tags/cloud-functions.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [crashlytics](<https://devfeed.tech/tags/crashlytics.md>), [demo](<https://devfeed.tech/tags/demo.md>), [demo-day](<https://devfeed.tech/tags/demo-day.md>), [development](<https://devfeed.tech/tags/development.md>), [event](<https://devfeed.tech/tags/event.md>), [extensions](<https://devfeed.tech/tags/extensions.md>), [firebase](<https://devfeed.tech/tags/firebase.md>), [firestore](<https://devfeed.tech/tags/firestore.md>), [flutter](<https://devfeed.tech/tags/flutter.md>), [google](<https://devfeed.tech/tags/google.md>), [google-analytics](<https://devfeed.tech/tags/google-analytics.md>), [ios](<https://devfeed.tech/tags/ios.md>), [kotlin](<https://devfeed.tech/tags/kotlin.md>), [launch](<https://devfeed.tech/tags/launch.md>), [palm](<https://devfeed.tech/tags/palm.md>), [project-idx](<https://devfeed.tech/tags/project-idx.md>), [python](<https://devfeed.tech/tags/python.md>), [remote-config](<https://devfeed.tech/tags/remote-config.md>), [swift](<https://devfeed.tech/tags/swift.md>), [terraform](<https://devfeed.tech/tags/terraform.md>), [web](<https://devfeed.tech/tags/web.md>), [windows](<https://devfeed.tech/tags/windows.md>)

### AI overview

Firebase announces its first Demo Day, releasing 10 prerecorded videos and technical resources covering app development, AI workflows, Flutter and Project IDX integrations, security, infrastructure, and Firebase console updates.

### Source excerpt

After sharing tons of teasers and behind-the-scenes footage over the past few weeks, we're excited to announce that our very first Demo Day is finally here!

[Next page](<https://devfeed.tech/tags/cloud-storage.md?cursor=WyIyMDIzLTExLTA4VDAwOjAwOjAwKzAwOjAwIiwgIjY3ZjQxZGVmLTliYTEtNDhhNy1hZmM3LTQxMjAyYmZmNTBkMSJd>)