# How We're Solving Data Discovery Challenges at Shopify

DevFeed: [How We're Solving Data Discovery Challenges at Shopify](<https://devfeed.tech/articles/how-we-re-solving-data-discovery-challenges-at-shopify-1625.md>)

Original publisher: [Read original article](<https://shopify.engineering/solving-data-discovery-challenges-shopify>)

Author: Ranko Cupovic

Published: 2020-07-21T18:14:00Z

Content type: article

Language: en

Sources: [Shopify Engineering](<https://devfeed.tech/sources/shopify-engineering.md>), [Shopify Engineering - Shopify Engineering](<https://devfeed.tech/sources/shopify-engineering-shopify-engineering.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [Shopify](<https://devfeed.tech/topics/shopify.md>), [data-governance](<https://devfeed.tech/topics/data-governance.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>)

Tags: [accessibility](<https://devfeed.tech/tags/accessibility.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-governance](<https://devfeed.tech/tags/data-governance.md>), [github](<https://devfeed.tech/tags/github.md>), [logs](<https://devfeed.tech/tags/logs.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [shopify](<https://devfeed.tech/tags/shopify.md>), [slack](<https://devfeed.tech/tags/slack.md>)

## AI overview

Shopify describes Artifact, a data discovery and management tool built to catalog data assets and metadata. The article discusses the challenges of data growth, asset discovery, governance, and accessibility, and reports that Artifact reduced the share of Shopify's Data team saying discovery hindered delivery from 80% to 41%.

## Source excerpt

Humans generate a lot of data. Every two days we create as much data as we did from the beginning of time until 2003! The International Data Corporation estimates the global datasphere totaled 33 zettabytes (one trillion gigabytes) in 2018. The estimate for 2025 is 175 ZBs, an increase of 430%. This growth is challenging organizations across all industries to rethink their data pipelines.