Distributing compiled elixir packages?

Not always, this is configurable via :env option
For example, {:my_dep, "~> 1.0", env: :test}