Move socket setup to set_socket(), called before the uid/gid change.