Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit for concurrently running pipelines #131

Closed
jakubklimek opened this issue Aug 22, 2014 · 1 comment
Closed

Limit for concurrently running pipelines #131

jakubklimek opened this issue Aug 22, 2014 · 1 comment

Comments

@jakubklimek
Copy link

image

This would not stop or pause running pipelines.
Lets say the number will be 2.
When there is no running pipeline and someone clicks run/debug, the pipeline will run.
There will be 1 running pipeline.
When there is 1 running pipeline and someone clicks run/debug, the pipeline will run.
There will be 2 running pipelines.
When there are 2 or more running pipelines and someone clicks run/debug, the pipeline will be queued.
When some pipeline finishes and there would be less running pipelines than the number (2), one of the queued ones will run.

The number will be changeable in the Execution monitor and the scheduler will react accordingly. Also there should be "Unlimited" option.

  • Add "Force" button for queued pipelines so that they can be forcefully ran ignoring this limit.

My image of an ideal frontend interface is one that looks like uTorrent, including priorities and pause/start, but lets start with this simple feature.

@skrchnavy
Copy link

Based on above requirements, we can think about scheduler with priority queues.

  • there will be set of queues with defined priority and pipeline will be scheduled (configured) to belong to a priority.
  • the goal of scheduler will be to clean queues with pipelines from highest to lowest priority in limited number of running pipelines.
  • special queue (VIQ - Very Important Queue) will be defined where limit will not be accepted and pipelines from this queue will be started instantly.

Please comment.

@ghost ghost assigned mvi-eea-sk and unassigned ghost Sep 19, 2014
@skrchnavy skrchnavy changed the title Number of concurrently running pipelines Limit for concurrently running pipelines Oct 28, 2014
@skrchnavy skrchnavy added this to the Release v1.4.0 milestone Jan 27, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants