How should the two parts of an SSH key pair be handled?
Keep the public key secret and copy the private key to each server.
Keep the private key secret and place the public key on servers that should accept it.
Publish both keys so either side can authenticate.
Discard the private key after copying the public key.