Hi!, I have the Mac Studio and I want to use the GPU on it with EXLA. I made the project that has config like below. import Config config :nx, :default_backend, EXLA.Backend with iex , Nx.tensor [1,2,3,4] , it show [info] TfrtCpuClient created. #Nx.Tensor< s64[4] EXLA.Backend<host:0, 0.118…

We don’t currently support mac GPUs unfortunately. There’s ongoing work on migrating EXLA to an MLIR-based implementation that will in the future enable support, though. Torchx is closer to that, altough Pytorch still has a few issues to go on the ways of API coverage for Apple Metal.

Ah, there’s something else you should also configure, the default defn compiler! config :nx, :default_defn_options, compiler: EXLA should make your code quite a bit faster too

[image] polvalente: config :nx, :default_defn_options, compiler: EXLA Thank you so much! Following your advice, adding the “config :nx, :default_defn_options, compiler: EXLA” setting dramatically reduced the computation time. It went down from 220 seconds to 13 seconds. That’s really amazin…

Elixir Programming Language Forum

Does EXLA support the Apple Silicon GPU (MPS)?

Questions & Help Questions

polvalente January 30, 2024, 12:58am 5

Awesome!