Each job should be interruptible to cancel executing pipeline when new one is created