RAG with Elixir

Hi, I’m trying to build system similar to https://github.com/zylon-ai/private-gpt in Elixir. After looking through multiple resources a RAG four major components

  1. Ingestion
  2. Embeddings
  3. Query
  4. LLM (Prompt using Context Window)

I have written a blog post about it, also have shared the code for this. Currently, the code is very basic and only reads the Reddit S-1 document. I plan to incorporate file uploads, embeddings selectio, llm models selection down the road.

Just wanted to share my learnings to the community and want to see how far I can take Elixir with RAG with this project.

Hackernews

4 Likes