Why is hackney consuming so much resources?

[Fl4m3Ph03n1x]

@rvirding

Does the memory usage keep growing? So for example in the next minute would it have reason above 900 Mb? Is the number of processes growing? This you can see on the first System page.

Yes, the memory keeps growing. However the number of processes seems to be stable at arround 24% - 26%. What does it mean?

The MsgQ for hackney_pool:init does seem to grow without bound however.

@alco

Back to your question, hackney’s pool implementation has known faults. See https://github.com/benoitc/hackney/issues/510 , https://github.com/benoitc/hackney/issues/549 . It doesn’t look like hackney’s maintainer has enough interest or time to get if fixed properly, so I would advice on disabling hackney’s pool and setting up your own pool of processes where each process performs a single HTTP request.

Mmmmm, would you recommend any articles on doing such? I am usually weary of re-inventing the wheel all on on my own :S