Using Pow for simple API authentication?

You do not need Pow for that. I would just use Plug.Session with proper Plug.Session.Store.