# How We Stopped a Weekly Batch Job From Taking Down a Live MySQL Service

DevFeed: [How We Stopped a Weekly Batch Job From Taking Down a Live MySQL Service](<https://devfeed.tech/articles/how-we-stopped-a-weekly-batch-job-from-taking-down-a-live-mysql-service-88646.md>)

Original publisher: [Read original article](<https://hackernoon.com/how-we-stopped-a-weekly-batch-job-from-taking-down-a-live-mysql-service?source=rss>)

Author: Rajesh Gomathinayagam

Published: 2026-10-16T05:33:40Z

Content type: article

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [MySQL](<https://devfeed.tech/topics/mysql.md>), [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>), [database-optimization](<https://devfeed.tech/topics/database-optimization.md>)

Tags: [assets](<https://devfeed.tech/tags/assets.md>), [database](<https://devfeed.tech/tags/database.md>), [database-design](<https://devfeed.tech/tags/database-design.md>), [database-performance](<https://devfeed.tech/tags/database-performance.md>), [database-queue-architecture](<https://devfeed.tech/tags/database-queue-architecture.md>), [high-volume-data-ingestion](<https://devfeed.tech/tags/high-volume-data-ingestion.md>), [inno-db-row-locking](<https://devfeed.tech/tags/inno-db-row-locking.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [mysql-lock-contention](<https://devfeed.tech/tags/mysql-lock-contention.md>), [mysql-performance-optimization](<https://devfeed.tech/tags/mysql-performance-optimization.md>), [mysql-table-partitioning](<https://devfeed.tech/tags/mysql-table-partitioning.md>), [production](<https://devfeed.tech/tags/production.md>), [queue](<https://devfeed.tech/tags/queue.md>), [resumable-batch-processing](<https://devfeed.tech/tags/resumable-batch-processing.md>), [rotation](<https://devfeed.tech/tags/rotation.md>)

## AI overview

A weekly bulk update to a MySQL table held row locks that blocked live inserts and caused production timeouts. The team moved new requests to a separate queue table, merged them into the primary table hourly, and rotated queues through a checkpointed workflow. Partitioning the primary table and retaining only recent data online helped keep the live workload bounded. The design trades immediate status visibility for simpler live-path isolation: a new request may take up to an hour to appear in the primary table.

## Source excerpt

How a team eliminated production timeouts caused by MySQL bulk updates using queue tables, resumable rotation, and workload isolation.