Using Llama 2 With Bumblebee

Questions & Help Questions
, ,
11

You can go ahead and do the bindings for llama.cpp yourself. Check out Erlang NIFs.

Otherwise, docs for LLaMA have been added here: https://hexdocs.pm/bumblebee/llama.html