Caddy chokes if it dies or systemd timeout kills the process ungracefully as it can't deal with a left over unix file socket. Ensure the unit always deletes the socket as a post exit cleanup strategy.