Parse / Pattern match large binary data

[CharlesO]

@NobbZ

Another problem might be, that you are appending to your accumulator all the time… This requires rebuilding the list all the time, eg:

defp _r(<<"LI", 1::32, ";", b::bits>>, val), do: _r(b, val ++ [nil])

I see your point.

The mistake might be in trying to build out / parse the entire file into memory in one go.

What you pointed out should not be an issue, say if i was processing each row of data and dumping row by row in the database, instead of parsing all rows first., before dumping to the DB, like i do now.