# Incident with Git Operations and Actions

DevFeed: [Incident with Git Operations and Actions](<https://devfeed.tech/articles/incident-with-git-operations-and-actions-76320.md>)

Original publisher: [Read original article](<https://www.githubstatus.com/incidents/frdfpnnt85s8>)

Published: 2023-09-05T06:59:00Z

Content type: news

Language: en

Sources: [GitHub Status - Incident History](<https://devfeed.tech/sources/github-status-incident-history.md>)

Topics: [Git](<https://devfeed.tech/topics/git.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [rate-limiting](<https://devfeed.tech/topics/rate-limiting.md>), [database-consistency](<https://devfeed.tech/topics/database-consistency.md>), [Netlify](<https://devfeed.tech/topics/netlify.md>)

Tags: [caching](<https://devfeed.tech/tags/caching.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [git](<https://devfeed.tech/tags/git.md>), [github-actions](<https://devfeed.tech/tags/github-actions.md>), [impact](<https://devfeed.tech/tags/impact.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [incident](<https://devfeed.tech/tags/incident.md>), [latency](<https://devfeed.tech/tags/latency.md>), [rate-limiting](<https://devfeed.tech/tags/rate-limiting.md>), [state](<https://devfeed.tech/tags/state.md>)

## AI overview

GitHub reported intermittent latency in Git archive and raw file downloads, along with failures in some Actions workflows. Increased traffic overloaded caching and exposed a bug that could leave archives incomplete at high load. GitHub said it mitigated the issue with rate limiting and backend and cache changes, and noted plans to improve customer impact updates during incidents.

## Source excerpt

Between 06:59 UTC to 13:18 UTC GitHub customers experienced intermittent increased latency when using our git archive and raw file downloading capability. This capability is typically used for larger CI/CD systems and bulk download of repository data. This also caused intermittent periods of Actions workflow failures. During this incident we saw bursts of increased unique traffic on specific endpoints that overloaded our caching capability for this system. In addition, the traffic caused saturation of the service that exposed a bug in downloading archived files at high load which caused some archives to be downloaded with incomplete data. This caused intermittent failure of workflows for GitHub Actions, which primarily downloads actions data via these endpoints. We mitigated this through improvements to our rate limiting and changes to get to a healthy state across our backend service and cache . We initially relied on automated communication messages during this incident and will be working to ensure future incidents have more relevant status updates with specific customer impact.