RAG with Elixir

Chat & Discussions Discussions
, ,
1

Hi, I’m trying to build system similar to https://github.com/zylon-ai/private-gpt in Elixir. After looking through multiple resources a RAG four major components

  1. Ingestion
  2. Embeddings
  3. Query
  4. LLM (Prompt using Context Window)

I have written a blog post about it, also have shared the code for this. Currently, the code is very basic and only reads the Reddit S-1 document. I plan to incorporate file uploads, embeddings selectio, llm models selection down the road.

Just wanted to share my learnings to the community and want to see how far I can take Elixir with RAG with this project.

Hackernews

4 Likes
2

Exciting! Do you accept contributions? I would like to participate.

3

If you are after creating agents, it might be worthwhile to have a look at prior art

https://github.com/nileshtrivedi/autogen

1 Like
4

Definitely Yes!

Currently, I’m just working on the boilerplate code for uploads and embeddings, once that is done it will be easier to accept contributions. Currently the code is pretty basic right now, and just replies to a single file (Reddit S-1 filing)

1 Like