# Parallel pgloader

DevFeed: [Parallel pgloader](<https://devfeed.tech/articles/parallel-pgloader-34439.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2011/08/parallel-pgloader/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2011-08-01T10:15:00Z

Content type: tutorial

Language: en

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [parallel](<https://devfeed.tech/topics/parallel.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>), [Processes](<https://devfeed.tech/topics/processes.md>), [Python](<https://devfeed.tech/topics/python.md>), [round robin](<https://devfeed.tech/topics/round-robin.md>), [Database](<https://devfeed.tech/topics/database.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [benefit](<https://devfeed.tech/tags/benefit.md>), [code](<https://devfeed.tech/tags/code.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [process](<https://devfeed.tech/tags/process.md>), [python](<https://devfeed.tech/tags/python.md>), [queues](<https://devfeed.tech/tags/queues.md>), [round-robin](<https://devfeed.tech/tags/round-robin.md>), [threading](<https://devfeed.tech/tags/threading.md>)

## AI overview

This tutorial explains how pgloader loads data in parallel. It describes loading multiple files concurrently, splitting large files among workers, and using a reader thread with worker threads and queues. It also cautions that Python's Global Interpreter Lock limits runtime parallelism and recommends testing thread configurations.

## Source excerpt

This article continues the series that began with How To Use PgLoader then detailed How to Setup pgloader. We have some more fine points to talk about here, today's article is about loading your data in parallel with pgloader.