How big the CSV is? What is the policy on failure and restarts of the server, meaning do you need persistence in processing?
If you don’t have any special requirements, I would just recommend to use Oban. You can just simply stream the file contents into small to medium jobs, then process them concurrently with Oban without having to care about anything else, you will have features like rate-limiting and persistence out of the box.


















