Personal VPN: a tale of Tailscale and Headscale#
I’ve been using different types of VPNs for many years for several reasons:
Public WiFi security.
Geo-IP block sidestepping.
Secure access to remote devices.
My current tools of choice:
NordVPN - paid service with good reliability and UI.
Algo - set of scripts automating secure VPN server creation.
I was recently scrolling my GitHub feed and discovered headscale - an open-source alternative to the proprietary Tailscale control center for personal self-hosted use. Which made me curious enough to finally try Tailscale itself.
I quickly registered using my Google account and added two devices - all in about five minutes - impressive!
Tailscale tracks Google account and IP addresses to provide network connectivity, which is extremely user-friendly, but leaves a weird feeling of half-way private solution. So, naturally, the next step is to replace the third-party proprietary control center with a self-hosted open-source alternative.
Headscale provides binary releases (current version is 0.17.1) but I’m not too fond of the experience of downloading and upgrading from GitHub releases, so I thought I better build it from sources.
I cloned the repo:
git clone email@example.com:juanfont/headscale.git cd headscale
And quickly realized that the build instructions assume I’m an experienced Nix user.
I’ve heard good things about Nix (mostly from Xe’s blog), so I thought it’s a good opportunity to poke it.
I fruitlessly searched for a way to install the Nix build system as an Ubuntu package, but it seems that running shell scripts from the internet with
sudo is the only supported way to install it right now.
I hesitated a bit, but not for too long, and gave it a try:
sh <(curl -L https://nixos.org/nix/install) --daemon
The installation script is friendly and does an excellent job establishing trust with the user.
The next step was to set up a development environment for the headscale.
Headscale’s README mentions running
nix develop, which seems sensible and harmless.
But, turns out, on the (default?) installation, it won’t work.
Instead, I had to activate two experimental features:
nix develop --extra-experimental-features nix-command --extra-experimental-features flakes
Once it finished, I proceeded to
make build which expectedly failed with the same error, so here’s the build command:
nix build --extra-experimental-features nix-command --extra-experimental-features flakes
After a few minutes of running tests, it finished with no other output.
I noticed a new
result symlink in the repo directory. Inside I found the binaries:
$ tree result/ result/ └── bin └── headscale 1 directory, 1 file $ ll -h result/bin/* -r-xr-xr-x 1 root root 25M Dec 31 1969 result/bin/headscale* $ sha256sum result/bin/headscale 273e4c4cd13c5903d8dd5611a8f6a43434b34e58c01a6682341370418b0fb837 result/bin/headscale
SHA sum doesn’t match the one from the official release (
e8d3d74b040bd2e3e9f049d95e4f4b759160518a1cf682ec0bb76f2fed7d77cf), but whatever.
Back to installing Headscale#
Let’s see what it does:
$ result/bin/headscale --help headscale is an open-source implementation of the Tailscale control server https://github.com/juanfont/headscale Usage: headscale [command] Available Commands: apikeys Handle the Api keys in Headscale completion Generate the autocompletion script for the specified shell debug debug and testing commands generate Generate commands help Help about any command mockoidc Runs a mock OIDC server for testing namespaces Manage the namespaces of Headscale nodes Manage the nodes of Headscale preauthkeys Handle the preauthkeys in Headscale routes Manage the routes of Headscale serve Launches the headscale server version Print the version. Flags: -c, --config string config file (default is /etc/headscale/config.yaml) --force Disable prompts and forces the execution -h, --help help for headscale -o, --output string Output format. Empty for human-readable, 'json', 'json-line' or 'yaml' Use "headscale [command] --help" for more information about a command. $ result/bin/headscale version v422d124 $ result/bin/headscale help 2023-01-06T20:23:04-05:00 WRN Failed to read configuration from disk error="Config File \"config\" Not Found in \"[/etc/headscale ~/.headscale ~/headscale]\"" 2023-01-06T20:23:04-05:00 FTL github.com/juanfont/headscale/cmd/headscale/cli/root.go:43 > Error loading config error="fatal error reading config file: Config File \"config\" Not Found in \"[/etc/headscale ~/.headscale ~/headscale]\""
Seems functional. I uploaded the binary to a cloud VM to set it as an external login server. I uploaded my binary to the server, and… bummer! It can’t run on Ubuntu 20.04 VM!
$ ./headscale -bash: ./headscale: No such file or directory
I have no idea what’s wrong there. The file is undoubtedly present and even starts with
ELF magic bytes. But it’s missing when I try to run it…
Screw this. I downloaded the official binaries:
wget https://github.com/juanfont/headscale/releases/download/v0.17.1/headscale_0.17.1_linux_amd64 sudo mv headscale_0.17.1_linux_amd64 /usr/local/bin/headscale sudo chmod 555 /usr/local/bin/headscale sudo chown headscale:headscale /usr/local/bin/headscale
That fixed the “No such file or directory” issue.
In the middle of the headscale README, I found a link to docs. Following the docs, I added:
CNAME DNS record.
Nginx pass-through configuration.
Expanded Let’s encrypt’s certificate.
The service successfully launched.
$ sudo systemctl status headscale ● headscale.service - headscale controller Loaded: loaded (/etc/systemd/system/headscale.service; enabled; vendor preset: enabled) Active: active (running) since Sat 2023-01-07 03:29:51 UTC; 23h ago Main PID: 727153 (headscale) Tasks: 9 (limit: 1151) Memory: 21.2M CGroup: /system.slice/headscale.service └─727153 /usr/local/bin/headscale serve
Nice! Where do I go from here? Let’s connect my Tailscale to the new headscale. There’s not much documentation on how it should look for the end user. I figured I needed to create an authentication key on the server:
$ headscale --namespace net preauthkeys create --reusable --expiration 24h 21c91befde206632883d0049cf3b81296dc1586a9b21e265
I copied the key and tried to use it to authenticate my laptop:
tailscale up --login-server https://headscale.demin.dev --authkey 21c91befde206632883d0049cf3b81296dc1586a9b21e265 --force-reauth
The command disabled the existing Tailscale connection and hanged for a few minutes until I stopped it.
Hmm… Not really what I was looking for. The headscale log on the server didn’t show anything useful.
curl http://127.0.0.1:8080, which returned an empty 200 response.
At this point, I realized that headscale is not at the stage where I want to entrust it with my private VPN.
Back to installing Tailscale#
The free Tailscale account experience is an absolute delight.
I added my cloud VM to the same account using
tailscale up in a minute (after adding Tailscale’s repo following these instructions):
sudo apt install tailscale sudo tailscale up
And it immediately got access to my home server using a nice ts.net domain name. I switched to this solution instead of a combination of Google Cloud Firewall Updater (gcpfwup) and ssh tunnel.
Tailscale revolutionized the virtual private network setup. At least for a personal self-hosted home server setup.
On the other hand, headscale’s user experience could be better at the moment (as of January 2023, version 0.17.1).