Upon reading this again I realized I forgot to tell you that you should try to replace hostname with socket_dir.
…Though judging by that Postgrex PR – by @hauleth – it seems that hostname should work as well. Or I am reading it wrong, maybe the hostname support is only through specifying the PGHOST variable, not necessarily the hostname config key.
