Consume a Stream with side effects without leaking memory?

[dimitarvp]

@tim.jarratt

Why does consuming the stream result in increasing the heap size if we are only going to take the last value from the stream ? I’d love to understand the stdlib Stream implementation better

To be fair, no, sorry.

@tim.jarratt

Does anyone have any clever ideas for how we can consume the stream without causing a memory leak while still returning the last value ?

Seeing as you are inserting stuff in DB then why can’t you just fetch the record that has the most recent value in inserted_at? It would achieve the same without having to change a stream accumulator millions of times.