Data processing in Parallel (Hackathon project)

Looks like you don’t have a detection of duplicates so you’re constantly inserting the same records.

Your next step is to add an unique index on the name (or another field) to make sure you don’t duplicate so much.

And it would have been useful for you to mention your exact steps before. We’re not mind readers. :smiley:

I consider this thread completed. Mark one of my answers as the solution (if you don’t mind) and if you have other problems, they are for a new thread IMO.