Feature request: Function equivalent to elixir's `Task.async_stream`
TanklesXL opened this issue · comments
As previously discussed, this would be a nice & useful function to have.
Great suggestion. Initial thoughts:
The name isn't very clear- what would be clearer?
The Elixir function is lazy, which makes me think it spawns a process per element requested in order to avoid leaking processes if you never reach the end. Would a version that always processes the entire collection but uses a work pool be advantageous?
In keeping with the original intent of async_stream maybe a name like concurrent_map, parallel_map? Might be nice to have an alternative that works on a list of thunks as well maybe?
parallel_map sounds nice and descriptive. What do you mean about thunks?
With regards to thunks I was mostly looking for a way to run a list of fn() -> a concurrently without needing to do something like
l
|> list.map(task.async)
|> list.map(task.await_*...)
Maybe an api like ocaml's parmap lib might be nice?
https://rdicosmo.github.io/parmap/doc/parmap/Parmap/index.html
I'm not sure how that would translate into Gleam as we don't have module functors. Keen to see what you have in mind
Oh that's a good point, hmm this definitely requires more thought.
Might be worth opening a discussion around this issue? I'd be interested in seeing if anyone has ideas.
My link to parmap was originally for inspiration in the sense of what useful functions might be wanted and things like being able to parametrize by desired number of workers and such, not really for the underlying implementation