Background I have the following code, which takes a string, converts it to a charlist and then maps over it. defmodule RotationalCipher do @alphabet_size 26 defguard is_lower?( char ) when char in ?a..?z defguard is_upper?( char ) when char in ?A..?Z def rotate(text, shift) do text …

Name: GenStage and Flow - José Valim (Lambda Days 2017)
Uploaded: 2018-10-09T10:55:47Z
Description: Maybe this could help for processing text in parallel [GenStage and Flow - José Valim (Lambda Days 2017)]

Maybe this could help for processing text in parallel [GenStage and Flow - José Valim (Lambda Days 2017)]

You could use Stream instead of Enum in your example, like this text |> String.to_charlist() |> Stream.map( &IO.inspect(&1) ) # I just changed this line to test in my console |> Enum.to_list |> to_string() I added an Enum.to_list near the end.

That will unfortunately not bring any benefit at all since I am converting to a list of chars, to a stream, back to a list of chars back to a string. I was hoping for an approach more like in the discussion bellow: [image] Emulate File.stream! for a string variable Questions …

Doesn’t that work? StringIO.open(text) |> elem(1) |> IO.stream(:line) |> Stream.map(&spin(&1, shift)) # your processing here # ... more of your processing here |> Enum.join The last line directly combines all string pieces into a big string. But you can always use any Enum function istead of t…

Don’t stream just because you heard that it is faster. This is not true! In many cases streams make it slower! Please benchmark your use case, before blindly applying a stream. In a case where you iterate a single time, a stream will probably cost, as you have some overhead during dispatching. I…

[image] NobbZ: Don’t stream just because you heard that it is faster. This is not true! In many cases streams make it slower! Please benchmark your use case, before blindly applying a stream. This is an interesting claim, that goes literally against everything I have read thus far. Streams …

I thought similar to you about a year ago. I learned the hard way during advent of code that streams have a cost. I learned by benchmarks that they only give a benefit in the above described situations and on very large input that would trigger many GCs when processed using Enum. A stream always i…

[image] NobbZ: I learned by benchmarks that they only give a benefit in the above described situations and on very large input that would trigger many GCs when processed using Enum . But that’s usually what happens when you have several processing stages of incoming data? I haven’t benchmarke…

Elixir Programming Language Forum

How to use streams with char lists?

Questions & Help Questions

kokolegorille October 9, 2018, 10:55am 4

Maybe this could help for processing text in parallel