# dataops

Published articles for dataops.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## From siloed DataOps, MLOps, and LLMOps to a unified data-intelligence platform

DevFeed: [From siloed DataOps, MLOps, and LLMOps to a unified data-intelligence platform](<https://devfeed.tech/articles/from-siloed-dataops-mlops-and-llmops-to-a-unified-data-intelligence-platform-26354.md>)

Original publisher: [Read original article](<https://medium.com/udemy-engineering/from-siloed-dataops-mlops-and-llmops-to-a-unified-data-intelligence-platform-4400be283641?source=rss----19c6d3367ed4---4>)

Author: Rajit Saha

Published: 2025-08-04T18:03:19Z

Content type: opinion

Language: en

Sources: [Udemy Engineering](<https://devfeed.tech/sources/udemy-engineering.md>)

Topics: [DataOps](<https://devfeed.tech/topics/dataops.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [apache-flink](<https://devfeed.tech/topics/apache-flink.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [aiops](<https://devfeed.tech/tags/aiops.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [bedrock](<https://devfeed.tech/tags/bedrock.md>), [dataops](<https://devfeed.tech/tags/dataops.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llmops](<https://devfeed.tech/tags/llmops.md>), [mlops](<https://devfeed.tech/tags/mlops.md>)

### AI overview

The article describes how DataOps, MLOps, and AI/LLM Ops commonly rely on separate systems and teams for data processing, model deployment, inference, evaluation, orchestration, governance, and monitoring. It then introduces Databricks' Data Intelligence Platform as a unified environment intended to bring these domains together.

### Source excerpt

Introduction In modern data-driven businesses, the pace of innovation in analytics and artificial intelligence has outstripped the capacity of many teams. Three distinct disciplines emerged to handle this expansion: Data platform (DataOps) teams built data lakes on cloud storage such as Amazon S3, processed them with Apache Spark and Hive on EMR, ingested streaming data with Spark Structured Streaming or Apache Flink, and loaded tabular copies into MPP warehouses like Redshift for interactive SQL and BI. Cataloguing and governance were offloaded to external tools such as DataHub, and fine-grained access controls required third-party services like Privacera. This architecture worked, but it required separate workflows for batch and streaming, extra systems for lineage and governance, and a mosaic of operational teams. MLOps teams provided an additional layer. Data scientists used notebook environments (for example, Amazon SageMaker) to preprocess data, train, and evaluate models. Deploying models meant writing integration code to move features into a serving layer, to register models in disparate registries and to build custom APIs for inference. Feature stores and model registries were bought from additional vendors. Updates and monitoring were often manual processes. AI/LLM Ops teams are a new addition because generative AI requires specialized components: LLM gateways (e.g., Amazon Bedrock) to proxy access to foundation models; evaluation tooling to compare large language models; orchestration frameworks for agents; vector databases for retrieval augmented generation; and of course another layer of security, access management and cost control. These tools seldom integrate seamlessly with existing data and ML pipelines. This fragmented state makes it difficult to react quickly when product requirements change. Each new capability requires another system, another integration, and another team. Meanwhile, budgets tighten and go-to-market timelines shrink. The questio

## The MLOps Playbook: Best Practices for Ensuring Reliability of ML Systems

DevFeed: [The MLOps Playbook: Best Practices for Ensuring Reliability of ML Systems](<https://devfeed.tech/articles/the-mlops-playbook-best-practices-for-ensuring-reliability-of-ml-systems-24580.md>)

Original publisher: [Read original article](<https://medium.com/headspace-engineering/the-mlops-playbook-best-practices-for-ensuring-reliability-of-ml-systems-75203dc60763?source=rss-3da90e297190------2>)

Author: Headspace

Published: 2021-09-28T21:04:00Z

Content type: opinion

Language: en

Sources: [Stories by Headspace on Medium](<https://devfeed.tech/sources/stories-by-headspace-on-medium.md>)

Topics: [MLOps](<https://devfeed.tech/topics/mlops.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [version-control](<https://devfeed.tech/topics/version-control.md>), [Software Engineering](<https://devfeed.tech/topics/software-engineering.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataops](<https://devfeed.tech/tags/dataops.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [observability](<https://devfeed.tech/tags/observability.md>), [quality](<https://devfeed.tech/tags/quality.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [version-control](<https://devfeed.tech/tags/version-control.md>)

### AI overview

This article presents an MLOps playbook for assessing the production readiness and operational reliability of machine learning systems. It recommends version-controlling model code, data, parameters, and metrics; accounting for model complexity and operating cost; evaluating quality across important data slices; and testing for inclusion and potential bias.

### Source excerpt

Author: Mo Messidi, a seasoned DataOps leader at Headspace with a decade of experience in both startups and enterprises. His mission is to help organizations operationalize their data. This article presents a simple, yet comprehensive, set of MLOps best practices for organizations to assess the production readiness of machine learning systems. It has also proved beneficial for assessing off-the-shelf MLOps platforms for feature and functionality completeness. There may be a whole range of software engineering best practices towards producing trustworthy software, but similar best practices for machine learning system operations are only in their infancy. Stage A: Model Development Model code, data, parameters, and metrics are version controlled It is important to know the code, data, and artifacts that produced a model. You can do this by having good version control for the model specification, including hyper-parameters and experiment artifacts. This ensures reproducibility, enables rollbacks, and de-risks system changes. A simpler model is not better The more complex a model, the higher its cost to operate. Adding a complexity tax to model assessment equations can help reveal the true incremental value of a given model. Model quality is sufficient for all important data slices ML models quality metrics can easily get lost in the averages when benchmarking against full datasets. It is important to examine quality independently for temporal and location variations. It is common for models to exhibit large drops in quality for specific data slices e.g. users in Denmark vs. users in Europe. The model is tested for considerations of inclusion ML unfairness may occur due to the way that people's choices affect what training data is used for something like word embedding. This can then lead to biased system behavior because it is based on these bad choices done during training data set creation. Measuring what you are doing is important to make systems for everyone. For

## DataOps: How to Develop and Scale Data Intensive Projects

DevFeed: [DataOps: How to Develop and Scale Data Intensive Projects](<https://devfeed.tech/articles/dataops-how-to-develop-and-scale-data-intensive-projects-18467.md>)

Original publisher: [Read original article](<https://www.tinybird.co/blog/dataops>)

Author: Alberto Romeu

Published: 2021-02-27T00:00:00Z

Content type: tutorial

Language: en

Sources: [Tinybird](<https://devfeed.tech/sources/tinybird.md>)

Topics: [DataOps](<https://devfeed.tech/topics/dataops.md>), [DevOps](<https://devfeed.tech/topics/devops.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [dataops](<https://devfeed.tech/tags/dataops.md>), [develop](<https://devfeed.tech/tags/develop.md>), [devops](<https://devfeed.tech/tags/devops.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [scalable-analytics-architecture](<https://devfeed.tech/tags/scalable-analytics-architecture.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

The article presents DataOps practices for developing and scaling data-intensive projects. It describes these workflows as applying DevOps rigor to data pipelines in 2026.

### Source excerpt

DataOps practices separate teams that ship from teams that struggle. These workflows bring DevOps rigor to data pipelines in 2026.

## DataOps: 10 principles to develop data intensive projects

DevFeed: [DataOps: 10 principles to develop data intensive projects](<https://devfeed.tech/articles/dataops-10-principles-to-develop-data-intensive-projects-18468.md>)

Original publisher: [Read original article](<https://www.tinybird.co/blog/dataops-principles>)

Author: Alberto Romeu

Published: 2021-02-27T00:00:00Z

Content type: article

Language: en

Sources: [Tinybird](<https://devfeed.tech/sources/tinybird.md>)

Topics: [DataOps](<https://devfeed.tech/topics/dataops.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [data](<https://devfeed.tech/tags/data.md>), [dataops](<https://devfeed.tech/tags/dataops.md>), [develop](<https://devfeed.tech/tags/develop.md>), [projects](<https://devfeed.tech/tags/projects.md>), [scalable-analytics-architecture](<https://devfeed.tech/tags/scalable-analytics-architecture.md>), [teams](<https://devfeed.tech/tags/teams.md>)

### AI overview

The article presents 10 DataOps principles for developing data-intensive projects and supporting data teams.

### Source excerpt

10 of the principles of DataOps that we make available to data teams.