Elixir OTP 24 doesn't apply custom Logger backend

Did the :logger application started? That may be the source of the problem, as kernel.logger is updated only when Logger application starts. Just beware, that logger configuration is not applied during compilation, it is only runtime thing.