Better way to run local embeddings with Apple Metal than Ollama?

EMLX with Nx 0.11 should work great for most things.

I have work in progress for even faster execution times, bringing back the original attempts at a compiled mode.
It didn’t work back then because of a bug in Nx that has been solved in the latest release.

Also, with Nx.runtime_call you can interleave external non-Nx code into your Nx computations, so you can do a best-of-both-worlds approach