# Quest for the Lost Home Server

DevFeed: [Quest for the Lost Home Server](<https://devfeed.tech/articles/quest-for-the-lost-home-server-30833.md>)

Original publisher: [Read original article](<https://hookrace.net/blog/quest-for-the-lost-home-server/>)

Published: 2019-10-14T22:00:00Z

Content type: article

Language: en

Sources: [Dennis Felsing](<https://devfeed.tech/sources/dennis-felsing.md>)

Topics: [Homelab](<https://devfeed.tech/topics/homelab.md>), [OpenSSH](<https://devfeed.tech/topics/openssh.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [systems](<https://devfeed.tech/topics/systems.md>), [backups](<https://devfeed.tech/topics/backups.md>)

Tags: [backups](<https://devfeed.tech/tags/backups.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [glibc](<https://devfeed.tech/tags/glibc.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [home-server](<https://devfeed.tech/tags/home-server.md>), [intel](<https://devfeed.tech/tags/intel.md>), [ssh](<https://devfeed.tech/tags/ssh.md>)

## AI overview

A remote troubleshooting account of recovering access to a home server after SSH connections and pings failed. The author traced the problem to a changed dynamic IP address, found the server by scanning the likely ISP subnet on a custom SSH port, and identified cronie's inability to spawn processes after a glibc update.

## Source excerpt

Today I lost access to my home server. As I described in a previous post I depend heavily on the server to fetch my emails, as a file server, to synchronize files, for newsbeuter and irssi sessions and many other things. As no one was going to be in proximity of the server for the next few hours, my goal for today was to solve the problem remotely. The symptom was that my SSH connection attempts failed. The server also didn't respond to pings. As the server is sitting at home behind a regular DSL connection it uses a dynamic IP address that is shuffled every 24 hours. So my first hunch was that the daily reconnect might just have happened at a different time today and I gave the server some time to broadcast its new IP address to my domain registrar. After about an hour I still couldn't connect, so I started investigating. Maybe the API of the domain registrar changed (as happened before) or my script failed for another reason? I know that my home server does nightly backups of the other servers I run. So I connected to one of them and checked the journalctl log. To my surprise no connection from the server happened last night. My worst fear was that the server was hanging due to a hardware problem, as I ran into similar problems with this Intel Bay Trail CPU before. (The issue seems to be that Intel underdesigned the power delivery on those systems, which the graphics driver is trying to work around.) But I wasn't ready to give up yet, so I tried to think of any other activities the server would do that might leave a trace. I found out that my email hoster doesn't provide easy access to the IP addresses that access the mailbox. I couldn't think of any other traces at the time, but next time I might check if my IP address is visible on some IRC server. As a last resort I remembered that my ISP usually gives me quite similar IP addresses, so I used whois on yesterday's IP address to see how large the subnet is. I got back a subnet of only 2¹⁴ addresses, which seemed