why in tumbling_local_aggregator module, rx not equal to tx?
javacoderxxp opened this issue · comments
Hi there! Thanks for the question. What's happening is that the tumbling local aggregator does some partial aggregation before sending data onto the downstream node. As that edge is a shuffle, it will, in general, cross a network boundary, requiring serialization and deserialization. This is similar to the combiner that you see in some map-reduce systems, including Hadoop.
Hope this answers your question!
Hi there! Thanks for the question. What's happening is that the tumbling local aggregator does some partial aggregation before sending data onto the downstream node. As that edge is a shuffle, it will, in general, cross a network boundary, requiring serialization and deserialization. This is similar to the combiner that you see in some map-reduce systems, including Hadoop.
Hope this answers your question!
Thank u.