How to efficiently send data between nodes?

It will be important to quantify what “huge” means here concretely. It is also important to understand how much memory each node has.