Callback execution mode is on main GitHub - ccarvalho-eng/aludel: LLM Evaluation for Phoenix Apps · GitHub
Now you can run your AI app’s real production workflow inside Aludel, instead of calling
providers directly from the library.
In :callback mode, your app provides an Aludel.Executor implementation and Aludel calls back into it for runs and eval suites. Aludel still handles prompt/version context, inputs, assertions, persistence, history, exports, and provider-based comparisons, while your app stays in control of the actual execution path.
This is useful if your app already has its own orchestration, retrieval, tool use, guardrails, or response pipeline and you want to evaluate that real path instead of a simplified direct LLM call.
