# A decoder-only foundation model for time-series forecasting

DevFeed: [A decoder-only foundation model for time-series forecasting](<https://devfeed.tech/articles/a-decoder-only-foundation-model-for-time-series-forecasting-28545.md>)

Original publisher: [Read original article](<http://blog.research.google/2024/02/a-decoder-only-foundation-model-for.html>)

Author: Google AI (noreply@blogger.com)

Published: 2024-02-02T19:07:00Z

Content type: article

Language: en

Sources: [Google Research](<https://devfeed.tech/sources/google-research.md>)

Topics: [Time Series](<https://devfeed.tech/topics/time-series.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Google](<https://devfeed.tech/topics/google.md>), [Deep learning](<https://devfeed.tech/topics/deep-learning.md>)

Tags: [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [forecasting](<https://devfeed.tech/tags/forecasting.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud-platform](<https://devfeed.tech/tags/google-cloud-platform.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [model](<https://devfeed.tech/tags/model.md>), [time-series](<https://devfeed.tech/tags/time-series.md>)

## AI overview

Google Research introduces TimesFM, a decoder-only foundation model for time-series forecasting. The model is pretrained on 100 billion real-world time-points and is reported to provide zero-shot forecasts on unseen datasets across domains and temporal granularities, with 200 million parameters.

## Source excerpt

Posted by Rajat Sen and Yichen Zhou, Google Research Time-series forecasting is ubiquitous in various domains, such as retail, finance, manufacturing, healthcare and natural sciences. In retail use cases, for example, it has been observed that improving demand forecasting accuracy can meaningfully reduce inventory costs and increase revenue. Deep learning (DL) models have emerged as a popular approach for forecasting rich, multivariate, time-series data because they have proven to perform well in a variety of settings (e.g., DL models performed well in the M5 competition). At the same time, there has been rapid progress in large foundation language models used for natural language processing (NLP) tasks, such as translation, retrieval-augmented generation, and code completion. These models are trained on massive amounts of textual data derived from a variety of sources like common crawl and open-source code that allows them to identify patterns in languages. This makes them very powerful zero-shot tools; for instance, when paired with retrieval, they can answer questions about and summarize current events. Despite DL-based forecasters largely outperforming traditional methods and progress being made in reducing training and inference costs, they face challenges: most DL architectures require long and involved training and validation cycles before a customer can test the model on a new time-series. A foundation model for time-series forecasting, in contrast, can provide decent out-of-the-box forecasts on unseen time-series data with no additional training, enabling users to focus on refining forecasts for the actual downstream task like retail demand planning. To that end, in "A decoder-only foundation model for time-series forecasting", we introduce TimesFM, a single forecasting model pre-trained on a large time-series corpus of 100 billion real world time-points. Compared to the latest large language models (LLMs), TimesFM is much smaller (200M parameters), yet we