Openai_ex - OpenAI API client library

[restlessronin]

@darwin67

LangChain is pretty helpful when it can chunk large texts and do a map reduce kind of aggregation.
That’s one use case, and there are more.

This functionality seems helpful and worth copying.

@darwin67

LangChain is more like a tool for people who want to use LLMs.
LangChain overview - Docs by LangChain

More like a nice helper library / wrapper to make interacting with LLMs easier instead of you having to go develop all the functions yourself to get a better response from models.

Providing an abstraction layer for different LLM’s in Elixir, is interesting, but it’s not the first thing I would do.

Partly, it’s a chicken and egg problem. LangChain can work because all LLM providers already have API bindings in python and node.js. Someone would have to provide those for elixir. Secondly, there will likely be only 2-3 “winners” in the LLM space, and it will be more important to support them comprehensively, rather than supporting every possible LLM partially.

I’d be interested in implementing an application level project like AutoGPT in Elixir, starting with OpenAI, adding the “higher-level” LangChain-like functionality, if it proves necessary. Does that sound interesting?