Without thinking too carefully about this, it feels as if there must be something blockchain-like that could be used. A widely-distributed-and-duplicated sequence of contact details, where the most recent entry signed with your private key is the correct way to contact you, and revokes any previous entry?