# Data processing in Parallel (Hackathon project)

**URL:** <https://forum.elixirforum.com/t/data-processing-in-parallel-hackathon-project/60424>\
**Category:** Questions\
**Tags:** phoenix, flow, broadway\
**Created:** [December 17, 2023, 6:12pm UTC](https://forum.elixirforum.com/t/data-processing-in-parallel-hackathon-project/60424 "2023-12-17T18:12:57Z")\
**Posts on this page:** 1\
**Showing post:** 37

<div class="post-metadata">

**Author:** ![dimitarvp](https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/dimitarvp/32/38664_2.png) [@dimitarvp](https://forum.elixirforum.com/u/dimitarvp)\
**Post date:** [January 5, 2024, 12:12pm UTC](https://forum.elixirforum.com/t/data-processing-in-parallel-hackathon-project/60424/37 "2024-01-05T12:12:04Z")

</div>

Oh btw, one final thing you can try just so we’re 100% sure:

Don’t do parallelism. Just stream the CSV file records and insert them one by one and see if you get 10M records.

BTW the amount above is mind-blowingly different… you expect 10M records but get almost 110M? Something is super weird, man, you must have overlooked something in the code.

I say make a public GitHub project with all your code and include a link to where the big CSV file can be downloaded (outside GitHub) so people can try and help you.

---

_[View the full topic](https://forum.elixirforum.com/t/data-processing-in-parallel-hackathon-project/60424)._