# Network design

The physical, virtual, and logical arrangement of infrastructure in an IT network.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Building a reliable cloud native foundation for distributed AI training

DevFeed: [Building a reliable cloud native foundation for distributed AI training](<https://devfeed.tech/articles/building-a-reliable-cloud-native-foundation-for-distributed-ai-training-4603.md>)

Original publisher: [Read original article](<https://www.cncf.io/blog/2026/09/11/building-a-reliable-cloud-native-foundation-for-distributed-ai-training/>)

Author: Abhi Kulkarni and Shishir Jindal, Atlassian

Published: 2026-09-11T11:00:00Z

Content type: article

Language: en

Sources: [Cloud Native Computing Foundation](<https://devfeed.tech/sources/cloud-native-computing-foundation.md>)

Topics: [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [ai-training](<https://devfeed.tech/tags/ai-training.md>), [blog](<https://devfeed.tech/tags/blog.md>), [distributed-training](<https://devfeed.tech/tags/distributed-training.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

The article explains how to make multi-node AI training reliable by treating inter-node communication, shared storage, hardware placement, network topology, and validation as platform concerns. It identifies RDMA for GPU-node communication and Lustre for concurrent training-data and checkpoint access.

### Source excerpt

AI workloads are changing what platform teams need from infrastructure. Provisioning GPUs and standing up a cluster no longer makes a platform "AI-ready." Once training spans more than one node, the bottlenecks show up in places...

## Crypto Agility: Why PQC Is Not a One-Time Upgrade

DevFeed: [Crypto Agility: Why PQC Is Not a One-Time Upgrade](<https://devfeed.tech/articles/crypto-agility-why-pqc-is-not-a-one-time-upgrade-8419.md>)

Original publisher: [Read original article](<https://blogs.cisco.com/security/crypto-agility-why-pqc-is-not-a-one-time-upgrade/>)

Author: Hugo Vliegen

Published: 2026-09-03T15:00:56Z

Content type: article

Language: en

Sources: [Security @ Cisco Blogs](<https://devfeed.tech/sources/security-cisco-blogs.md>)

Topics: [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Vulnerabilities](<https://devfeed.tech/topics/vulnerabilities.md>)

Tags: [cisco-sd-wan](<https://devfeed.tech/tags/cisco-sd-wan.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [cryptography](<https://devfeed.tech/tags/cryptography.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [network-security](<https://devfeed.tech/tags/network-security.md>), [networks](<https://devfeed.tech/tags/networks.md>), [post-quantum](<https://devfeed.tech/tags/post-quantum.md>), [quantum-computing](<https://devfeed.tech/tags/quantum-computing.md>), [sd-wan-security](<https://devfeed.tech/tags/sd-wan-security.md>), [security](<https://devfeed.tech/tags/security.md>), [security-for-ai](<https://devfeed.tech/tags/security-for-ai.md>)

### AI overview

The article explains why crypto agility is essential for long-lived network infrastructure adopting post-quantum cryptography. It argues that organizations should design systems to update cryptography continuously as standards, threats, and implementations evolve.

### Source excerpt

Learn why crypto agility is essential for PQC-ready networks--and how adaptable infrastructure helps organizations keep pace with evolving threats.

## George Washington, the Delaware, and Direct Routes

DevFeed: [George Washington, the Delaware, and Direct Routes](<https://devfeed.tech/articles/george-washington-the-delaware-and-direct-routes-40153.md>)

Original publisher: [Read original article](<https://blog.j2sw.com/inetarch/george-washington-delaware-direct-network-routing/>)

Author: j2sw

Published: 2026-06-30T16:15:53Z

Content type: opinion

Language: en

Sources: [Justin Wilson (j2sw)](<https://devfeed.tech/sources/justin-wilson-j2sw.md>)

Topics: [Network design](<https://devfeed.tech/topics/network-design.md>), [Networks](<https://devfeed.tech/topics/networks.md>), [BGP](<https://devfeed.tech/topics/bgp.md>), [Network](<https://devfeed.tech/topics/network.md>)

Tags: [bgp](<https://devfeed.tech/tags/bgp.md>), [blog](<https://devfeed.tech/tags/blog.md>), [fd-ix](<https://devfeed.tech/tags/fd-ix.md>), [internet-architecture](<https://devfeed.tech/tags/internet-architecture.md>), [ixp](<https://devfeed.tech/tags/ixp.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [network-peering](<https://devfeed.tech/tags/network-peering.md>), [networks](<https://devfeed.tech/tags/networks.md>), [peering](<https://devfeed.tech/tags/peering.md>), [route](<https://devfeed.tech/tags/route.md>), [routers](<https://devfeed.tech/tags/routers.md>), [routing](<https://devfeed.tech/tags/routing.md>), [traffic](<https://devfeed.tech/tags/traffic.md>), [transit](<https://devfeed.tech/tags/transit.md>)

### AI overview

This commentary compares George Washington's direct route across the Delaware with network peering. It argues that direct connections between networks can reduce transit dependencies, router hops, and latency compared with longer BGP-selected transit paths.

### Source excerpt

I originally posted this over on the FD-IX Bloghttps://blog.fd-ix.com/george-washington-the-delaware-and-direct-routes/ When George Washington crossed the Delaware River on Christmas night in 1776, the goal was simple. Reach the objective by the most effective path while avoiding unnecessary delays and giving the opposing force as little warning as possible. The crossing was risky, but it created a ... Read more The post George Washington, the Delaware, and Direct Routes appeared first on Justin Wilson (j2sw).

## How Rain Affects Wireless Microwave Links: 24 GHz, 60 GHz, and 80 GHz Compared

DevFeed: [How Rain Affects Wireless Microwave Links: 24 GHz, 60 GHz, and 80 GHz Compared](<https://devfeed.tech/articles/how-rain-affects-wireless-microwave-links-24-ghz-60-ghz-and-80-ghz-compared-40174.md>)

Original publisher: [Read original article](<https://blog.j2sw.com/netops/wireless/rain-fade-microwave-links/>)

Author: j2sw

Published: 2026-06-15T09:47:43Z

Content type: tutorial

Language: en

Sources: [Justin Wilson (j2sw)](<https://devfeed.tech/sources/justin-wilson-j2sw.md>)

Topics: [Network](<https://devfeed.tech/topics/network.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Internet](<https://devfeed.tech/topics/internet.md>), [data centers](<https://devfeed.tech/topics/data-centers.md>)

Tags: [24ghz](<https://devfeed.tech/tags/24ghz.md>), [60ghz](<https://devfeed.tech/tags/60ghz.md>), [80ghz](<https://devfeed.tech/tags/80ghz.md>), [adaptive](<https://devfeed.tech/tags/adaptive.md>), [backhaul](<https://devfeed.tech/tags/backhaul.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [changes](<https://devfeed.tech/tags/changes.md>), [e-band](<https://devfeed.tech/tags/e-band.md>), [error-correction](<https://devfeed.tech/tags/error-correction.md>), [fiber](<https://devfeed.tech/tags/fiber.md>), [microwave](<https://devfeed.tech/tags/microwave.md>), [network](<https://devfeed.tech/tags/network.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [perfomance](<https://devfeed.tech/tags/perfomance.md>), [radio](<https://devfeed.tech/tags/radio.md>), [reduction](<https://devfeed.tech/tags/reduction.md>), [rf](<https://devfeed.tech/tags/rf.md>), [wireless](<https://devfeed.tech/tags/wireless.md>), [wireless-networking](<https://devfeed.tech/tags/wireless-networking.md>)

### AI overview

This article explains how rain fade affects wireless microwave links, with emphasis on 24 GHz, 60 GHz, and 80 GHz bands. It describes how precipitation reduces signal strength, causes adaptive modulation and throughput reductions, and can eventually cause a link to drop when fade margin is exhausted.

### Source excerpt

Rain can have a major impact on wireless microwave links, especially as frequencies increase. Learn how rain fade affects 24 GHz, 60 GHz, and 80 GHz circuits, and why fade margin is critical for reliable network design. The post How Rain Affects Wireless Microwave Links: 24 GHz, 60 GHz, and 80 GHz Compared appeared first on Justin Wilson (j2sw).

## Navigating uncertainty in Amazon's middle-mile network

DevFeed: [Navigating uncertainty in Amazon's middle-mile network](<https://devfeed.tech/articles/navigating-uncertainty-in-amazon-s-middle-mile-network-7604.md>)

Original publisher: [Read original article](<https://www.amazon.science/blog/navigating-uncertainty-in-amazons-middle-mile-network>)

Author: Ruth Misener; Hana Ku; Georgios Paschos

Published: 2026-05-06T13:37:38Z

Content type: article

Language: en

Sources: [Amazon Science homepage](<https://devfeed.tech/sources/amazon-science-homepage.md>)

Topics: [amazon](<https://devfeed.tech/topics/amazon.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Network](<https://devfeed.tech/topics/network.md>), [networking](<https://devfeed.tech/topics/networking.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [combinatorial-optimization](<https://devfeed.tech/tags/combinatorial-optimization.md>), [demand-forecasting](<https://devfeed.tech/tags/demand-forecasting.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [middle-mile](<https://devfeed.tech/tags/middle-mile.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [operations-research-and-optimization](<https://devfeed.tech/tags/operations-research-and-optimization.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [scot](<https://devfeed.tech/tags/scot.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [supply-chain-optimization-technologies-scot](<https://devfeed.tech/tags/supply-chain-optimization-technologies-scot.md>), [transportation-planning](<https://devfeed.tech/tags/transportation-planning.md>)

### AI overview

Amazon engineers and scientists describe how they optimize the company's middle-mile delivery network under uncertainty. The article covers demand and travel-time variability, network design, routing, inventory positioning, and mixed-integer optimization across many facilities and products.

### Source excerpt

Amazon engineers and scientists have created new tools to optimize delivery networks under uncertainty -- and keep them adapting without missing a beat.

## Homelab Hardware

DevFeed: [Homelab Hardware](<https://devfeed.tech/articles/homelab-hardware-10748.md>)

Original publisher: [Read original article](<https://eduuh.com/blog/homelab-hardware>)

Author: EduuhMuraya

Published: 2026-01-14T00:00:00Z

Content type: article

Language: en

Sources: [EduuhMuraya](<https://devfeed.tech/sources/eduuhmuraya.md>)

Topics: [Homelab](<https://devfeed.tech/topics/homelab.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>)

Tags: [amd](<https://devfeed.tech/tags/amd.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [devices](<https://devfeed.tech/tags/devices.md>), [firewall](<https://devfeed.tech/tags/firewall.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [home-lab](<https://devfeed.tech/tags/home-lab.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [intel](<https://devfeed.tech/tags/intel.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [network](<https://devfeed.tech/tags/network.md>), [opnsense](<https://devfeed.tech/tags/opnsense.md>), [pc](<https://devfeed.tech/tags/pc.md>), [performance](<https://devfeed.tech/tags/performance.md>), [proxmox](<https://devfeed.tech/tags/proxmox.md>), [self-hosted](<https://devfeed.tech/tags/self-hosted.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

An account of the mini PCs used in a homelab, covering their specifications, costs, roles, power efficiency, physical footprint, and the network changes made after part of the Kubernetes cluster was removed.

### Source excerpt

The three mini PCs I bought for a Kubernetes homelab, what they cost, and what is left of them eighteen months later.

## Changing Colors and Line Styles in netlab Graphs

DevFeed: [Changing Colors and Line Styles in netlab Graphs](<https://devfeed.tech/articles/changing-colors-and-line-styles-in-netlab-graphs-11246.md>)

Original publisher: [Read original article](<https://blog.ipspace.net/2025/09/netlab-graphs-colors-lines/>)

Published: 2025-09-22T05:38:00Z

Content type: tutorial

Language: en

Sources: [ipSpace.net blog](<https://devfeed.tech/sources/ipspace-net-blog.md>)

Topics: [Graphs](<https://devfeed.tech/topics/graphs.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [SVG](<https://devfeed.tech/topics/svg.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>)

Tags: [github](<https://devfeed.tech/tags/github.md>), [graph](<https://devfeed.tech/tags/graph.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [netlab](<https://devfeed.tech/tags/netlab.md>), [network](<https://devfeed.tech/tags/network.md>), [svg](<https://devfeed.tech/tags/svg.md>), [terminal](<https://devfeed.tech/tags/terminal.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

A tutorial on styling network topology graphs generated from netlab lab topologies. It shows how to use graph attributes and groups to change node colors and link widths across GraphViz and D2 outputs, and how to map a custom text-color attribute to GraphViz.

### Source excerpt

Last week, I explained how to generate network topology graphs (using GraphViz or D2 graphing engines) from a netlab lab topology. Let's see how we can make them look nicer (or at least more informative). We'll work with a simple leaf-and-spine topology with four nodes1: Baseline leaf-and-spine topology defaults.device: frr provider: clab nodes: [ s1, s2, l1, l2 ] links: [ s1-l1, s1-l2, s2-l1, s2-l2 ] This is the graph generated by netlab create followed by dot graph.dot -T png -o graph.png: Read more ...

## Finding End-to-End Paths: Topology and Endpoints

DevFeed: [Finding End-to-End Paths: Topology and Endpoints](<https://devfeed.tech/articles/finding-end-to-end-paths-topology-and-endpoints-11198.md>)

Original publisher: [Read original article](<https://blog.ipspace.net/2025/06/finding-paths-across-network/>)

Published: 2025-06-06T05:51:00Z

Content type: tutorial

Language: en

Sources: [ipSpace.net blog](<https://devfeed.tech/sources/ipspace-net-blog.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Network design](<https://devfeed.tech/topics/network-design.md>)

Tags: [arp](<https://devfeed.tech/tags/arp.md>), [bridging](<https://devfeed.tech/tags/bridging.md>), [dhcp](<https://devfeed.tech/tags/dhcp.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [ipv4](<https://devfeed.tech/tags/ipv4.md>), [ipv6](<https://devfeed.tech/tags/ipv6.md>), [network](<https://devfeed.tech/tags/network.md>), [networking-fundamentals](<https://devfeed.tech/tags/networking-fundamentals.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

This article explains how networks discover topology and endpoints, build forwarding tables, and adapt end-to-end paths when links or nodes fail. It contrasts complete topology views in link-state protocols with local-neighbor knowledge in distance-vector protocols, and describes learning mechanisms including bridging, ARP, DHCP, and ICMPv6 Neighbor Discovery.

### Source excerpt

We know there are three main ways to move packets across a network. However, before we can start forwarding packets, someone has to populate the forwarding tables in the intermediate devices or build the sequence of nodes to traverse in source routing. Usually, whoever is responsible for the contents of the forwarding tables must first discover the network topology. Let's start there, using the following network diagram to illustrate the discussion. Read more ...

## Network Design Lesson: Split Functionality Across Devices When Appropriate

DevFeed: [Network Design Lesson: Split Functionality Across Devices When Appropriate](<https://devfeed.tech/articles/must-read-make-two-trips-11016.md>)

Original publisher: [Read original article](<https://blog.ipspace.net/2024/05/worth-reading-make-two-trips/>)

Published: 2024-05-29T06:33:00Z

Content type: opinion

Language: en

Sources: [ipSpace.net blog](<https://devfeed.tech/sources/ipspace-net-blog.md>)

Topics: [Network design](<https://devfeed.tech/topics/network-design.md>), [Network architectures](<https://devfeed.tech/topics/network-architectures.md>)

Tags: [bugs](<https://devfeed.tech/tags/bugs.md>), [network](<https://devfeed.tech/tags/network.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [worth-reading](<https://devfeed.tech/tags/worth-reading.md>)

### AI overview

The article argues that network designs can be simpler and less costly when required functionality is divided across multiple devices instead of being crammed into one device.

### Source excerpt

Tom Limoncelli wrote another must-read masterpiece: sometimes you'll save time if you make two trips instead of one. The same lesson applies to network design: cramming too many features into a single device will inevitably result in complex, hard-to-understand configurations and weird bugs. Sometimes, it's cheaper to split the required functionality across multiple devices.

## BGP Route Reflectors in Small EVPN Data Center Fabrics

DevFeed: [BGP Route Reflectors in Small EVPN Data Center Fabrics](<https://devfeed.tech/articles/bgp-route-reflectors-considered-harmful-11001.md>)

Original publisher: [Read original article](<https://blog.ipspace.net/2024/05/bgp-rr-considered-harmful/>)

Published: 2024-05-28T06:23:00Z

Content type: article

Language: en

Sources: [ipSpace.net blog](<https://devfeed.tech/sources/ipspace-net-blog.md>)

Topics: [BGP](<https://devfeed.tech/topics/bgp.md>), [evpn](<https://devfeed.tech/topics/evpn.md>), [datacenter](<https://devfeed.tech/topics/datacenter.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Network design](<https://devfeed.tech/topics/network-design.md>)

Tags: [bgp](<https://devfeed.tech/tags/bgp.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [evpn](<https://devfeed.tech/tags/evpn.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [networking](<https://devfeed.tech/tags/networking.md>)

### AI overview

This article examines whether BGP route reflectors are necessary in reasonably small EVPN data center fabrics. It compares route-reflector and full-mesh designs, discussing scalability, configuration consistency, update timing, and the operational challenges of using dedicated or virtualized route reflectors.

### Source excerpt

The recent IBGP Full Mesh Between EVPN Leaf Switches blog post generated an interesting discussion on LinkedIn focused on whether we need route reflectors (in small fabrics) and whether they do more harm than good. Here are some of the highlights of that discussion, together with a running commentary. Please note that we're talking about BGP route reflectors in reasonably small data center fabrics. Large service provider networks with millions of customer VPN routes are a completely different story. As always, what you read in a random blog post might not apply to your network design. YMMV. Read more ...

## Unintended Consequences of IPv6 SLAAC

DevFeed: [Unintended Consequences of IPv6 SLAAC](<https://devfeed.tech/articles/unintended-consequences-of-ipv6-slaac-10980.md>)

Original publisher: [Read original article](<https://blog.ipspace.net/2024/04/ipv6-slaac-unintended-consequences/>)

Published: 2024-04-16T06:45:00Z

Content type: opinion

Language: en

Sources: [ipSpace.net blog](<https://devfeed.tech/sources/ipspace-net-blog.md>)

Topics: [Network](<https://devfeed.tech/topics/network.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [ipv6](<https://devfeed.tech/tags/ipv6.md>), [load](<https://devfeed.tech/tags/load.md>), [network](<https://devfeed.tech/tags/network.md>), [network-design](<https://devfeed.tech/tags/network-design.md>), [performance](<https://devfeed.tech/tags/performance.md>), [tcp](<https://devfeed.tech/tags/tcp.md>)

### AI overview

The article explains how IPv6 SLAAC privacy address rotation, long-running TCP sessions, and device reconnections can increase neighbor-discovery cache usage. When hardware forwarding devices exhaust that cache, packets may be handled by the CPU or dropped, reducing performance. It outlines tradeoffs involving interface limits, RFC 7217 identifiers, and DHCPv6 address allocation.

### Source excerpt

One of my friends is running a large IPv6 network and has already experienced a shortage of IPv6 neighbor cache on some of his switches. Digging deeper into the root causes, he discovered: In my larger environments, I see significant neighbor table cache entries, especially on network segments with hosts that make many long-term connections. These hosts have 10 to 20 addresses that maintain state over days or weeks to accomplish their processes. What's going on? A perfect storm of numerous unrelated annoyances: Read more ...

## Network booted, home initialized

DevFeed: [Network booted, home initialized](<https://devfeed.tech/articles/network-booted-home-initialized-35181.md>)

Original publisher: [Read original article](<https://blog.jessfraz.com/post/network-booted-home-initialized/>)

Published: 2020-01-17T15:25:24Z

Content type: article

Language: en

Sources: [Jessie Frazelle](<https://devfeed.tech/sources/jessie-frazelle.md>)

Topics: [Homelab](<https://devfeed.tech/topics/homelab.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Ethernet](<https://devfeed.tech/topics/ethernet.md>), [gateway](<https://devfeed.tech/topics/gateway.md>)

Tags: [ethernet](<https://devfeed.tech/tags/ethernet.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [home-lab](<https://devfeed.tech/tags/home-lab.md>), [like](<https://devfeed.tech/tags/like.md>), [network](<https://devfeed.tech/tags/network.md>), [setup](<https://devfeed.tech/tags/setup.md>), [unifi](<https://devfeed.tech/tags/unifi.md>)

### AI overview

The article describes building an office network based on the author's home-lab setup. It covers a 48-port switch, UniFi equipment, Cat7 cabling, a Dream Machine gateway, wireless access points, cameras, and an isolated AmpliFi Alien network for lab equipment or other devices.

### Source excerpt

I had a lot of fun writing blog posts in the past about my home lab and some of my personal infrastructure so I thought I would do the same as we built out our office. Much like moving into a new place, the first thing I always plan to have setup on move-in day is internet. We did the same with our office as well. Before we even had any real furniture, we made sure that we had a network connection. You may recognize that furniture from the garage. For the office I really wanted our network infrastructure to be off-the-charts good. Everyone knows shitty internet is a productivity killer. Since I use UniFi for my network setup at home, we used the same for the office. Here's what we got: 48 Port Switch Dream Machine 2 Wifi APs A couple of cameras Amplifi Alien The Switch We have a hard line coming from the 48 port switch to each section of desks. I cabled all this myself. As we grow we will likely segment this off to each desk having its own little 4- or 8-port network switch but for now this works. The Cables All the cables running to the desks are Cat7s from Monoprice. Every type of cable has a maximum distance. For ethernet cables, the maximum distance is the maximum upload/download speed. Cat7 gets praised for its 100 Gbps speed, but that will only work for distances up to 15 meters (slightly over 49 feet). From 15 meters up to 50 meters, a Cat7 cable downgrades to 40 Gbps. Beyond that, it drops to the same 10 Gbps speed of Cat6 and Cat6a, however it still retains its superior 600 Mhz bandwidth. We use 100ft cables to the desks and 50ft cables wherever we can reach to maximize speed. The Router The Dream Machine is acting as our gateway and controller. Before we got the other 2 APs, it was our only access point and did a great job of that. The Access Points We have a large warehouse with a lot of square feet, while the Dream Machine does have coverage to every corner, it's nice to have a strong signal from anywhere in the office. As we grow we will have more and m

## Networking: Using Linux Traffic Control for Fun and Profit Loss Prevention

DevFeed: [Networking: Using Linux Traffic Control for Fun and Profit Loss Prevention](<https://devfeed.tech/articles/networking-using-linux-traffic-control-for-fun-and-profit-loss-prevention-19706.md>)

Original publisher: [Read original article](<https://word.bitly.com/post/67486390974>)

Author: Wordbitly

Published: 2013-11-19T19:43:00Z

Content type: article

Language: en

Sources: [Bitly](<https://devfeed.tech/sources/bitly.md>)

Topics: [networking](<https://devfeed.tech/topics/networking.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [migration](<https://devfeed.tech/topics/migration.md>), [Network design](<https://devfeed.tech/topics/network-design.md>), [Ethernet](<https://devfeed.tech/topics/ethernet.md>), [Linux](<https://devfeed.tech/topics/linux.md>)

Tags: [ethernet](<https://devfeed.tech/tags/ethernet.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [linux](<https://devfeed.tech/tags/linux.md>), [migration](<https://devfeed.tech/tags/migration.md>), [network](<https://devfeed.tech/tags/network.md>), [networking](<https://devfeed.tech/tags/networking.md>)

### AI overview

A Bitly technical account of migrating a physical Hadoop cluster and the resulting network overload. A fast distcp transfer generated enough cross-cabinet traffic to cause errors, timeouts, and failed internal DNS queries for website users and API clients.

### Source excerpt

Here at bitly, we are big fans of data, tubes and especially tubes that carry data. This is a story about asking tubes to carry too much data. A physical hadoop cluster has been a significant part of bitly's infrastructure and a core tool of the bitly Data Science and Ops/Infra teams for some time. Long enough that we needed to cycle in a new cluster, copy data, and fold the old into the new. Branches were opened, work was done, servers provisioned and the new cluster was stood up. Time to take a step back from the story and flesh out some technical details: bitly operates at a consequential scale of data: At the time of this migration the hadoop cluster was just over 150TB consumed disk space of compressed stream data, that is data that is the valuable output of our various applications after having been manipulated and expanded on by other applications. bitly's physical presence is collocated with our data center partner. There are three physical chassis classes (application, storage and database) racked together in contiguous cabinets in rows. At the time of this story each chassis had three physical 1Gb Ethernet connections (each logically isolated by VLANs), frontlink, backlink and lights-out (for out of band management of the server chassis). Each connection, after a series of cabinet specific patch panels and switches, connects to our core switches over 10Gb glass in a hub and spoke topology. While bitly also operates at a consequential physical scale (hundreds of physical server chassis), we depend on our data center partner for network infrastructure and topology. This means that within most levels of the physical networking stack, we have severely limited control and visibility. Back to the story: The distcp tool bundled with hadoop allowed us to quickly copy data from one cluster to the other. Put simply, distcp tool creates a mapreduce job to shuffle data from one hdfs cluster to another, in a many to many node copy. Distcp was fast, which was good. bitl