-
Notifications
You must be signed in to change notification settings - Fork 11
Configuration
xitep edited this page May 3, 2017
·
7 revisions
Euphoria Flink Executor
-
euphoria.flink.streaming.windowing.only.after.shuffle
: Normally RBK and RSBK operator's input elements are windowed and transformed before shuffle to reduce the amount of data being transferred. However, under certain circumstances, it can be beneficial to do this only after shuffling the original input elements. See #47 for more information. Note that the time-sliding windowing mentioned in that ticket received a very efficient serialization implementation. -
euphoria.flink.streaming.descriptors.cache.max.size
: The euphoria flink streaming executor uses the underlying storage provider through Flink itself and therefore must translate the euphoria storage descriptors into Flink native descriptors. The result of this translation is cached since creating Flink native storage descriptors is actually expensive. The number of storage descriptors in a program is typically very small since these are meant to be statically defined. This configuration option defines a threshold to make euphoria flows fail if the mentioned cache grows beyond the defined value prevent accidental out of memory upon dynamic allocation of descriptors.