# MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering

DevFeed: [MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering](<https://devfeed.tech/articles/mlsysbook-ai-principles-and-practices-of-machine-learning-systems-engineering-7417.md>)

Original publisher: [Read original article](<https://blog.tensorflow.org/2024/11/mlsysbookai-principles-and-practices-of-machine-learning-systems-engineering.html>)

Author: TensorFlow Blog (noreply@blogger.com)

Published: 2024-11-19T17:00:00Z

Content type: article

Language: en

Sources: [The TensorFlow Blog](<https://devfeed.tech/sources/the-tensorflow-blog.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [community](<https://devfeed.tech/tags/community.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [monitoring-maintenance](<https://devfeed.tech/tags/monitoring-maintenance.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [socratiq](<https://devfeed.tech/tags/socratiq.md>), [systems-engineering](<https://devfeed.tech/tags/systems-engineering.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>)

## AI overview

An overview of MLSysBook.ai's machine-learning systems engineering concepts, connected to the TensorFlow ecosystem. It emphasizes the infrastructure, hardware, scaling, deployment, efficiency, and reliability considerations required to build and operate machine-learning systems.

## Source excerpt

Posted by Jason Jabbour, Kai Kleinbard and Vijay Janapa Reddi (Harvard University) Everyone wants to do the modeling work, but no one wants to do the engineering. If ML developers are like astronauts exploring new frontiers, ML systems engineers are the rocket scientists designing and building the engines that take them there. Introduction "Everyone wants to do modeling, but no one wants to do the engineering," highlights a stark reality in the machine learning (ML) world: the allure of building sophisticated models often overshadows the critical task of engineering them into robust, scalable, and efficient systems. The reality is that ML and systems are inextricably linked. Models, no matter how innovative, are computationally demanding and require substantial resources--with the rise of generative AI and increasingly complex models, understanding how ML infrastructure scales becomes even more critical. Ignoring the system's limitations during model development is a recipe for disaster. Unfortunately, educational resources on the systems side of machine learning are lacking. There are plenty of textbooks and materials on deep learning theory and concepts. However, we truly need more resources on the infrastructure and systems side of machine learning. Critical questions--such as how to optimize models for specific hardware, deploy them at scale, and ensure system efficiency and reliability--are still not adequately understood by ML practitioners. This lack of understanding is not due to disinterest but rather a gap in available knowledge. One significant resource addressing this gap is MLSysBook.ai. This blog post explores key ML systems engineering concepts from MLSysBook.ai and maps them to the TensorFlow ecosystem to provide practical insights for building efficient ML systems. The Connection Between Machine Learning and Systems Many think machine learning is solely about extracting patterns and insights from data. While this is fundamental, it's only part of the s