I recently started a blog series called “Open-source Deep Dive” where I analyse open-source projects & share my findings about them and I have published my second article in this series!
In this second installment, Broadway takes center stage! Broadway is an Elixir library for building data processing pipelines for data sources like message queues.
The article is broken down into two parts.
- Part one goes over the general concepts used in Broadway like message queues and concurrency in Elixir. It also breaks down the architecture of a pipeline.
- Part two dives into the implementation of certain features like rate limiting and graceful shutdowns.
Any feedback would be amazing! Thanks! ![]()






















