Not always, this is configurable via :env option For example, {:my_dep, "~> 1.0", env: :test}
:env
{:my_dep, "~> 1.0", env: :test}