I’m not using docker. I have the ssh keys on the vps.
I can successfully ssh to the server without any issue.