Splitting the final Consumer stage and having a Buffer/Consumer pair as a pipeline for each connected user would absolutely work, but at that point I feel like I am not really gaining anything over taking the N GenServer approach. It was something I’d considered doing, but was hoping to find a way to pipe everything into a single bounded set of consumers while still meeting my requirements.
I’m very excited at all of the fantastic software being build up with/around Elixir, and I’m looking forward to finding a use case that makes sense with and can leverage GenStage, but this doesn’t seem to be it. Just feels like it would be a case of using something because it is flashy and new rather than because it provides a concrete benefit for the specific use case. I have some thoughts around doing some log processing though…
