Data processing in Parallel (Hackathon project)

thanks for the hint !
I have tried with 100 000 000 rows but only 62 733 738 have been imported.

I got some errors like:

01:14:22.102 [info] MyXQL.Connection (#PID<0.302.0>) disconnected: ** (DBConnection.ConnectionError) client #PID<0.726857.0> exited

01:14:22.096 [error] MyXQL.Connection (#PID<0.227.0>) failed to connect: ** (MyXQL.Error) (1040) Too many connections

I think I will have to tune better the pool (100) and the number of max_concurrency (100).

I will play a bit with it.

What do you think about the questions I asked in my previous answer regarding the namespace and configuration?