# parallel

Parallel computing is the simultaneous use of multiple compute resources to solve computational problems, while parallel programming writes software that executes multiple computations simultaneously.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Working Effectively with Claude Code

DevFeed: [Working Effectively with Claude Code](<https://devfeed.tech/articles/working-effectively-with-claude-code-33580.md>)

Original publisher: [Read original article](<https://blog.scottlogic.com/2026/06/18/working-effectively-with-claude-code.html>)

Author: Amy Laws

Published: 2026-06-18T09:09:00Z

Content type: article

Language: en

Sources: [Scott Logic](<https://devfeed.tech/sources/scott-logic.md>)

Topics: [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Terminal](<https://devfeed.tech/topics/terminal.md>), [Code](<https://devfeed.tech/topics/code.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Git](<https://devfeed.tech/topics/git.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [code](<https://devfeed.tech/tags/code.md>), [copilot](<https://devfeed.tech/tags/copilot.md>), [github-copilot](<https://devfeed.tech/tags/github-copilot.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [round-robin](<https://devfeed.tech/tags/round-robin.md>), [terminal](<https://devfeed.tech/tags/terminal.md>), [vs-code](<https://devfeed.tech/tags/vs-code.md>)

### AI overview

This article shares practical lessons from switching from GitHub Copilot in VS Code to Claude Code. It focuses on parallel development with multiple agents, using terminal sessions and Git worktrees, and managing concurrent work through Claude Code's agent view.

### Source excerpt

After months working with GitHub Copilot in VS Code and recently switching to Claude Code, the transition turned out to be more involved than expected. Claude Code operates differently and in ways that take time to adjust to. In this post, I share my experiences and tips drawn from that experience.

## How to build deep research agents using Temporal and Braintrust

DevFeed: [How to build deep research agents using Temporal and Braintrust](<https://devfeed.tech/articles/how-to-build-deep-research-agents-using-temporal-and-braintrust-35865.md>)

Original publisher: [Read original article](<https://temporal.io/blog/how-to-build-deep-research-agents-using-temporal-and-braintrust>)

Author: Martin Bergman

Published: 2026-06-03T00:00:00Z

Content type: tutorial

Language: en

Sources: [Temporal Blog](<https://devfeed.tech/sources/temporal-blog.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [retry](<https://devfeed.tech/topics/retry.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [build](<https://devfeed.tech/tags/build.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [observability](<https://devfeed.tech/tags/observability.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [research](<https://devfeed.tech/tags/research.md>), [retry](<https://devfeed.tech/tags/retry.md>), [tracing](<https://devfeed.tech/tags/tracing.md>)

### AI overview

This tutorial explains a multi-agent deep research pipeline built with Temporal and Braintrust. It covers planning, query generation, parallel web search, report synthesis, and the use of Durable Execution, evals, and observability to handle timeouts, partial failures, and difficult debugging.

### Source excerpt

Deep research agents are fragile in production. Here's how Temporal and Braintrust make them resilient with Durable Execution, evals, and tracing.

## Per-worker, and global, IO bandwidth in explain plans

DevFeed: [Per-worker, and global, IO bandwidth in explain plans](<https://devfeed.tech/articles/per-worker-and-global-io-bandwidth-in-explain-plans-33676.md>)

Original publisher: [Read original article](<https://www.depesz.com/2026/02/21/per-worker-and-global-io-bandwidth-in-explain-plans/>)

Author: depesz

Published: 2026-02-21T13:24:57Z

Content type: article

Language: en

Sources: [select \* from depesz;](<https://devfeed.tech/sources/select-from-depesz.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [IO](<https://devfeed.tech/topics/io.md>), [parallel](<https://devfeed.tech/topics/parallel.md>)

Tags: [analyze](<https://devfeed.tech/tags/analyze.md>), [execution](<https://devfeed.tech/tags/execution.md>), [explain](<https://devfeed.tech/tags/explain.md>), [explain-depesz-com](<https://devfeed.tech/tags/explain-depesz-com.md>), [io](<https://devfeed.tech/tags/io.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [plan](<https://devfeed.tech/tags/plan.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [speed](<https://devfeed.tech/tags/speed.md>), [timing](<https://devfeed.tech/tags/timing.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>), [worker](<https://devfeed.tech/tags/worker.md>)

### AI overview

This article explains how PostgreSQL explain plans can report per-worker and global I/O bandwidth during parallel execution. It describes how summed worker timings differ from wall-clock time and introduces an exclusive-time bandwidth figure for the disks' total workload.

### Source excerpt

Jeremy Schneider suggested a change to how plans are displayed - adding another bit of information in case we have timing information for IO for explain node. Took me a while to research, but it finally made it's way... Let's consider this simple plan. In it's Parallel Seq Scan node we see: -> Parallel Seq ... Continue reading "Per-worker, and global, IO bandwidth in explain plans"

## From VHS to Interactive Streams: Customization at Scale with the NFL Sunday Ticket on YouTube

DevFeed: [From VHS to Interactive Streams: Customization at Scale with the NFL Sunday Ticket on YouTube](<https://devfeed.tech/articles/from-vhs-to-interactive-streams-customization-at-scale-with-the-nfl-sunday-ticket-on-youtube-33268.md>)

Original publisher: [Read original article](<https://8thlight.com/insights/from-vhs-to-interactive-streams-customization-at-scale-with-the-nfl-sunday-ticket-on-youtube-2>)

Author: Shawn DeVries

Published: 2026-01-23T23:05:00Z

Content type: article

Language: en

Sources: [8th Light Insights](<https://devfeed.tech/sources/8th-light-insights.md>)

Topics: [Streaming](<https://devfeed.tech/topics/streaming.md>), [personalization](<https://devfeed.tech/topics/personalization.md>), [Sports](<https://devfeed.tech/topics/sports.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Playback](<https://devfeed.tech/topics/playback.md>), [ui](<https://devfeed.tech/topics/ui.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>)

Tags: [customization](<https://devfeed.tech/tags/customization.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [personalization](<https://devfeed.tech/tags/personalization.md>), [platform-innovation](<https://devfeed.tech/tags/platform-innovation.md>), [playback](<https://devfeed.tech/tags/playback.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [scale](<https://devfeed.tech/tags/scale.md>), [sports](<https://devfeed.tech/tags/sports.md>), [streams](<https://devfeed.tech/tags/streams.md>), [ui](<https://devfeed.tech/tags/ui.md>)

### AI overview

This article examines how NFL Sunday Ticket on YouTube moved live sports viewing from a fixed broadcast toward personalized, interactive streams. It describes custom Multiview layouts, fantasy integrations, spoiler controls, playback options, and interfaces that work across TVs, mobile devices, and tablets.

### Source excerpt

It's the mid-90s, it's Sunday morning, and you're about to set your VCRs to record on your NFL game of choice You'd capture everything, commercials, dead time, halftime filler, and hope the tape didn't cut out in overtime. It was static. One-size-fits-all. Then TiVo arrived. That pause button changed the game. Suddenly, fans could freeze a field goal, run to grab game day food, and unpause just in time for the kick. Control entered the living room. Fast forward to NFL Sunday Ticket on YouTube. Fans are now building their own broadcast in real time. The cultural shift is clear: live sports have moved from passive consumption to personalized control over the gameday experience. Raising the Stakes For nearly three decades, NFL Sunday Ticket lived only on DirecTV. It was a premium cable-era product; expensive, exclusive, and tied to satellite hardware. Fans outside their home market had little choice but to buy into the bundle if they wanted every game. That era is over. When YouTube secured the Sunday Ticket package, it leapt from the satellite dish into the streaming stack. And with that leap came a redefinition of expectations: reliability is still required, but now the baseline includes interactivity and personalization at a massive scale. Inside Sunday Ticket's interactive layer: Custom Multiview Fans can build their own layout with two, three, or four games running in parallel. Local broadcasts integrate seamlessly for YouTube TV base subscribers. Multiview works across TVs, mobile, and tablets, keeping the experience consistent. Fantasy View Integration Users can link NFL Fantasy and Yahoo Fantasy accounts. This allows fantasy stats and team updates surface directly in the stream. Spoiler Mode & Playback Features Hide scores until you're ready to see them. Advanced playback controls such as broadcast delay toggle All the features create more ways to personalize the live feed. Improved UI & Side-by-Side Experience Dual-column layouts show live action next to stats

## Trusting AI agents: A reinsurance case study

DevFeed: [Trusting AI agents: A reinsurance case study](<https://devfeed.tech/articles/trusting-ai-agents-a-reinsurance-case-study-36082.md>)

Original publisher: [Read original article](<https://temporal.io/blog/trusting-ai-agents-a-reinsurance-case-study>)

Author: Sophia Barnes

Published: 2026-01-22T00:00:00Z

Content type: article

Language: en

Sources: [Temporal Blog](<https://devfeed.tech/sources/temporal-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [decision-making](<https://devfeed.tech/topics/decision-making.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [file](<https://devfeed.tech/topics/file.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [automate](<https://devfeed.tech/tags/automate.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [excel](<https://devfeed.tech/tags/excel.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [insurance](<https://devfeed.tech/tags/insurance.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [risk](<https://devfeed.tech/tags/risk.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

This case study explains how a multi-agent AI system with human-in-the-loop safeguards automates reinsurance data workflows. The system parses unstandardized Excel submission packs, matches catastrophe events with historical records, creates cedant loss records, and flags changes to existing data.

### Source excerpt

Learn how to build a reliable multi-agent AI system with human-in-the-loop safeguards using Temporal. A detailed case study on automating complex reinsurance data workflows.

## Packing Matrix-Vector Multiplication in Fully Homomorphic Encryption

DevFeed: [Packing Matrix-Vector Multiplication in Fully Homomorphic Encryption](<https://devfeed.tech/articles/packing-matrix-vector-multiplication-in-fully-homomorphic-encryption-40487.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2024/09/06/packing-matrix-vector-multiplication-in-fhe/>)

Published: 2024-09-07T04:18:09Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [homomorphic encryption](<https://devfeed.tech/topics/homomorphic-encryption.md>), [FHE](<https://devfeed.tech/topics/fhe.md>), [Encryption](<https://devfeed.tech/topics/encryption.md>), [layout](<https://devfeed.tech/topics/layout.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [arithmetic](<https://devfeed.tech/tags/arithmetic.md>), [code](<https://devfeed.tech/tags/code.md>), [cryptography](<https://devfeed.tech/tags/cryptography.md>), [data](<https://devfeed.tech/tags/data.md>), [encryption](<https://devfeed.tech/tags/encryption.md>), [fhe](<https://devfeed.tech/tags/fhe.md>), [github-repository](<https://devfeed.tech/tags/github-repository.md>), [homomorphic-encryption](<https://devfeed.tech/tags/homomorphic-encryption.md>), [layout](<https://devfeed.tech/tags/layout.md>), [linear-algebra](<https://devfeed.tech/tags/linear-algebra.md>), [lwe](<https://devfeed.tech/tags/lwe.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [packing](<https://devfeed.tech/tags/packing.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [programming](<https://devfeed.tech/tags/programming.md>), [python](<https://devfeed.tech/tags/python.md>), [rlwe](<https://devfeed.tech/tags/rlwe.md>), [simd](<https://devfeed.tech/tags/simd.md>), [strategies](<https://devfeed.tech/tags/strategies.md>)

### AI overview

This article explains packing for SIMD-style fully homomorphic encryption. It describes how to arrange plaintext data in RLWE ciphertexts so matrix-vector multiplication requires fewer alignment multiplications and rotations, then introduces two basic packing techniques and a computational model.

### Source excerpt

In my recent overview of homomorphic encryption, I underemphasized the importance of data layout when working with arithmetic (SIMD-style) homomorphic encryption schemes. In the FHE world, the name given to data layout strategies is called "packing," because it revolves around putting multiple plaintext data into RLWE ciphertexts in carefully-chosen ways that mesh well with the operations you'd like to perform. By "mesh well" I mean it reduces the number of extra multiplications and rotations required merely to align data elements properly, rather than doing the actual computation you care about.

## Hello Deep Learning: Hyperparameters, inspection, parallelism, ADAM

DevFeed: [Hello Deep Learning: Hyperparameters, inspection, parallelism, ADAM](<https://devfeed.tech/articles/hello-deep-learning-hyperparameters-inspection-parallelism-adam-36445.md>)

Original publisher: [Read original article](<https://berthub.eu/articles/posts/hyperparameters-inspection-adam/>)

Published: 2023-03-30T10:00:06Z

Content type: tutorial

Language: en

Sources: [Bert Hubert's writings](<https://devfeed.tech/sources/bert-hubert-s-writings.md>)

Topics: [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [cpu](<https://devfeed.tech/tags/cpu.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [faster](<https://devfeed.tech/tags/faster.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [matrices](<https://devfeed.tech/tags/matrices.md>), [neural-network](<https://devfeed.tech/tags/neural-network.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [tensors](<https://devfeed.tech/tags/tensors.md>)

### AI overview

A Hello Deep Learning tutorial explains how neural networks can train faster through parallel computation, including batched tensor operations, GPU capacity, CPU SIMD instructions, multiple CPU cores, and distributed processing. It also begins discussing network parameter inspection and matrix multiplication.

### Source excerpt

This page is part of the Hello Deep Learning series of blog posts. You are very welcome to improve this page via GitHub! In the previous chapter we successfully trained a network to recognize handwritten letters, but it took an awfully long time. This is not just inconvenient: networks that take too long to train mean we can experiment less. Some things really are out of reach if each iteration takes 24 hours, instead of 15 minutes.

## Postgres 11 - A First Look

DevFeed: [Postgres 11 - A First Look](<https://devfeed.tech/articles/postgres-11-a-first-look-41208.md>)

Original publisher: [Read original article](<https://www.craigkerstiens.com/2018/09/20/postgresql-11-a-first-look/>)

Author: Map

Published: 2018-09-20T20:55:56Z

Content type: article

Language: en

Sources: [Craig Kerstiens](<https://devfeed.tech/sources/craig-kerstiens.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [releases](<https://devfeed.tech/topics/releases.md>), [Usability](<https://devfeed.tech/topics/usability.md>), [parallel](<https://devfeed.tech/topics/parallel.md>)

Tags: [performance](<https://devfeed.tech/tags/performance.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [release-notes](<https://devfeed.tech/tags/release-notes.md>), [usability](<https://devfeed.tech/tags/usability.md>)

### AI overview

A first look at PostgreSQL 11 highlights usability improvements, safer addition of NOT NULL columns with default values without a full table rewrite, and maturing parallelism support.

### Source excerpt

Postgres 11 is almost here, in fact the latest beta shipped today, and it features a lot of exciting improvements. If you want to get the full list of features it is definitely worth checking out the release notes, but for those who don't read the release notes I put together a run down of some what I consider the highlight features. Quitting Postgres This is a small usability feature, but so long over due. Now you can quit Postgres by simply typing quit or exit. Previously you had to use Ctrl + D or \q. As a begginer it's one thing to jump into a psql terminal, but once in if you can't figure out how to quit it's a frustrating experience. Small usability features, such as this and watch in an earlier release, are often lost in the highlighted features which talk about performance or new data types. Improvements like this really go a long way for making Postgres a better database for everyone. Fear column addition no more Brandur had a great in depth write-up on this feature already, but it falls somewhere into the category of the above as well as a performance improvement. Previously when you added a new column that was NOT NULL with a default value Postgres would have to take a lock and re-write the entire table. In a production environment on any sizable table for all practical purposes the result was an outage. The work around was to break your migrations apart to be a several step process. With Postgres 11 you can add a new column to a table that is not null with a default value. The new row will get materialized on your database without requiring a full re-write. Here is to having to think less about your migrations. Of course performance is a highlight No Postgres release would be complete without some performance improvements. This release there are really two areas that feature key improvements around performance. Parallelism continuing to mature We first saw parallelism support back in PostgreSQL 9.6. At the time it was primarily for sequential scans, whic

## Parallel commits with gitwalk

DevFeed: [Parallel commits with gitwalk](<https://devfeed.tech/articles/parallel-commits-with-gitwalk-40729.md>)

Original publisher: [Read original article](<https://radek.io/posts/parallel-commits-with-gitwalk/>)

Published: 2015-11-18T00:00:00Z

Content type: tutorial

Language: en

Sources: [Radek Pazdera](<https://devfeed.tech/sources/radek-pazdera.md>)

Topics: [Git](<https://devfeed.tech/topics/git.md>), [Repositories](<https://devfeed.tech/topics/repositories.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Script](<https://devfeed.tech/topics/script.md>), [Bash](<https://devfeed.tech/topics/bash.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [bash](<https://devfeed.tech/tags/bash.md>), [git](<https://devfeed.tech/tags/git.md>), [merge](<https://devfeed.tech/tags/merge.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [repositories](<https://devfeed.tech/tags/repositories.md>), [script](<https://devfeed.tech/tags/script.md>)

### AI overview

This tutorial explains how to use gitwalk to select and process multiple Git repositories in parallel. It demonstrates selecting repositories with expressions and using a Bash script to create, commit, and push a file across matching repositories.

### Source excerpt

A tool to manipulate multiple git repositories at the same time

## Bitsliced SipHash

DevFeed: [Bitsliced SipHash](<https://devfeed.tech/articles/bitsliced-siphash-38922.md>)

Original publisher: [Read original article](<https://idea.popcount.org/2013-01-30-bitsliced-siphash>)

Author: Marek

Published: 2013-01-29T23:00:00Z

Content type: tutorial

Language: en

Sources: [Marek Majkowski](<https://devfeed.tech/sources/marek-majkowski.md>)

Topics: [Algorithm](<https://devfeed.tech/topics/algorithm.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [implementation](<https://devfeed.tech/topics/implementation.md>), [C](<https://devfeed.tech/topics/c.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [c](<https://devfeed.tech/tags/c.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cycles](<https://devfeed.tech/tags/cycles.md>), [implementation](<https://devfeed.tech/tags/implementation.md>), [matrix](<https://devfeed.tech/tags/matrix.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [simd](<https://devfeed.tech/tags/simd.md>), [speed](<https://devfeed.tech/tags/speed.md>), [sse](<https://devfeed.tech/tags/sse.md>)

### AI overview

This article explains bitslicing through a SipHash implementation. It describes rewriting an algorithm as simple bit-level logical operations applied to wide SIMD vectors, which can reduce repeated parallel computations. It also discusses the substantial cost of transposing input and output bit matrices.

### Source excerpt

Bitsliced SipHash Few days ago I presented a Python and a C implementation of SipHash. This time for no reason whatsoever I implemented a bitsliced version of it. Bitslicing a crypto algorithm is usually done to speed it up when doing massively parallel operations. For example when trying to find a collision with brute force. Bitsliced implementation is only useful if you have a large number of exactly the same mathematical operations to be computed in parallel.

## pgloader 3: A planned Common Lisp rewrite with parallel loading and additional data sources

DevFeed: [pgloader 3: A planned Common Lisp rewrite with parallel loading and additional data sources](<https://devfeed.tech/articles/pgloader-what-s-next-34490.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2013/01/pgloader-whats-next/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2013-01-28T09:48:00Z

Content type: opinion

Language: en

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Lisp](<https://devfeed.tech/topics/lisp.md>), [MySQL](<https://devfeed.tech/topics/mysql.md>), [migration](<https://devfeed.tech/topics/migration.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [lisp](<https://devfeed.tech/tags/lisp.md>), [migration](<https://devfeed.tech/tags/migration.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [programming](<https://devfeed.tech/tags/programming.md>), [python](<https://devfeed.tech/tags/python.md>)

### AI overview

The article discusses plans for pgloader 3, including a Common Lisp implementation intended to improve loading performance, support real parallel processing, and fetch data from sources such as MySQL, HTTP, and S3. It also notes that existing Python reformatting modules would need to be ported.

### Source excerpt

pgloader is a tool to help loading data into PostgreSQL, adding some error management to the COPY command. COPY is the fast way of loading data into PostgreSQL and is transaction safe. That means that if a single error appears within your bulk of data, you will have loaded none of it. pgloader will submit the data again in smaller chunks until it's able to isolate the bad from the good, and then the good is loaded in.

## Reformatting Input Columns with pgloader

DevFeed: [Reformatting Input Columns with pgloader](<https://devfeed.tech/articles/pgloader-reformating-34444.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2011/08/pgloader-reformating/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2011-08-05T09:30:00Z

Content type: tutorial

Language: en

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [data type](<https://devfeed.tech/topics/data-type.md>), [Python](<https://devfeed.tech/topics/python.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Scripting](<https://devfeed.tech/topics/scripting.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [python](<https://devfeed.tech/tags/python.md>), [scripting](<https://devfeed.tech/tags/scripting.md>), [transformation](<https://devfeed.tech/tags/transformation.md>)

### AI overview

This tutorial explains how pgloader reformats input columns before PostgreSQL receives them. It describes configuring reformat modules and functions, and implementing the transformation in Python, including an example that converts certain MySQL timestamp representations into a PostgreSQL-readable form.

### Source excerpt

Back to our series about pgloader. The previous articles detailed How To Use PgLoader then How to Setup pgloader, then what to expect from a parallel pgloader setup. This article will detail how to reformat input columns so that what PostgreSQL sees is not what's in the data file, but the result of a transformation from this data into something acceptable as an input for the target data type.

## pgloader en parallèle

DevFeed: [pgloader en parallèle](<https://devfeed.tech/articles/pgloader-en-parallele-34443.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2011/08/pgloader-en-parall%C3%A8le/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2011-08-01T10:15:00Z

Content type: tutorial

Language: fr

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [parallel](<https://devfeed.tech/topics/parallel.md>), [configuration](<https://devfeed.tech/topics/configuration.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [parallel](<https://devfeed.tech/tags/parallel.md>)

### AI overview

This article discusses configuring parallel data loading in pgloader and refers readers to the English reference article "Parallel pgloader."

### Source excerpt

Dans la série des articles sur pgloader, nous détaillons cette fois la configuration du paraléllisme de chargement des données. Une fois de plus, je vous réfère à l'article de référence en anglais : Parallel pgloader.

## Parallel pgloader

DevFeed: [Parallel pgloader](<https://devfeed.tech/articles/parallel-pgloader-34439.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2011/08/parallel-pgloader/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2011-08-01T10:15:00Z

Content type: tutorial

Language: en

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [parallel](<https://devfeed.tech/topics/parallel.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>), [Processes](<https://devfeed.tech/topics/processes.md>), [Python](<https://devfeed.tech/topics/python.md>), [round robin](<https://devfeed.tech/topics/round-robin.md>), [Database](<https://devfeed.tech/topics/database.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [benefit](<https://devfeed.tech/tags/benefit.md>), [code](<https://devfeed.tech/tags/code.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [process](<https://devfeed.tech/tags/process.md>), [python](<https://devfeed.tech/tags/python.md>), [queues](<https://devfeed.tech/tags/queues.md>), [round-robin](<https://devfeed.tech/tags/round-robin.md>), [threading](<https://devfeed.tech/tags/threading.md>)

### AI overview

This tutorial explains how pgloader loads data in parallel. It describes loading multiple files concurrently, splitting large files among workers, and using a reader thread with worker threads and queues. It also cautions that Python's Global Interpreter Lock limits runtime parallelism and recommends testing thread configurations.

### Source excerpt

This article continues the series that began with How To Use PgLoader then detailed How to Setup pgloader. We have some more fine points to talk about here, today's article is about loading your data in parallel with pgloader.

## pg\_basebackup Adds Parallel File Fetching for PostgreSQL Base Backups

DevFeed: [pg\_basebackup Adds Parallel File Fetching for PostgreSQL Base Backups](<https://devfeed.tech/articles/pg-basebackup-34401.md>)

Original publisher: [Read original article](<https://tapoueh.org/blog/2010/11/pg_basebackup/>)

Author: Dimitri Fontaine PostgreSQL Major Contributor; Author

Published: 2010-11-07T12:45:00Z

Content type: article

Language: en

Sources: [Dimitri Fontaine](<https://devfeed.tech/sources/dimitri-fontaine.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Script](<https://devfeed.tech/topics/script.md>), [parallel](<https://devfeed.tech/topics/parallel.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>)

Tags: [jobs](<https://devfeed.tech/tags/jobs.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [processes](<https://devfeed.tech/tags/processes.md>), [script](<https://devfeed.tech/tags/script.md>)

### AI overview

The article describes an update to pg_basebackup that repeatedly fetches changed xlog files during a base backup. It adds a --jobs option to launch multiple helper processes, each using its own PostgreSQL connection to fetch backup files in compressed chunks.

### Source excerpt

Hannu just gave me a good idea in this email on -hackers, proposing that pg_basebackup should get the xlog files again and again in a loop for the whole duration of the base backup. That's now done in the aforementioned tool, whose options got a little more useful now: Usage: pg_basebackup.py [-v] [-f] [-j jobs] "dsn" dest Options: -h, --help show this help message and exit --version show version and quit -x, --pg_xlog backup the pg_xlog files -v, --verbose be verbose and about processing progress -d, --debug show debug information, including SQL queries -f, --force remove destination directory if it exists -j JOBS, --jobs=JOBS how many helper jobs to launch -D DELAY, --delay=DELAY pg_xlog subprocess loop delay, see -x -S, --slave auxilliary process --stdin get list of files to backup from stdin Yeah, as implementing the xlog idea required having some kind of parallelism, I built on it and the script now has a --jobs option for you to setup how many processes to launch in parallel, all fetching some base backup files in its own standard ( libpq) PostgreSQL connection, in compressed chunks of 8 MB (so that's not 8 MB chunks sent over).