What strikes me is that almost every task seems several times slower programmed in Elixir than with Python or Perl. Examples are: traversing a directory and read file modification times, read a CSV file line by line and do some basic processing with them etc.
If possible I’d first like to take a look at your elixir code. Sometimes there are ways to improve it a bit.
