You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To be more precise, source_rate_limit will control the source rate limit with connections for this source/table in relation to the external system's source rate limit.
Meanwhile, streaming_rate_limit will control the rate limit between the MV/sink being created and its upstream, which also includes the situation when an MV is created on a source. In this case, I believe that a minimum value should be taken between streaming_rate_limit and the source_rate_limit. This is because when the Kafka source's read.offset=oldest, the scenario is the same as with backfill.
source_rate_limit
will limit the upstream side of the downstream executors.streaming_rate_limit
will limit the backfill rate.with options
.The text was updated successfully, but these errors were encountered: