The human-centric platform for production ML & AI

Outerbounds

Is it currently possible to add `spec.ttlSecondsAfterFinished` or `spec.completions`  to kubernetes jobs? I'm happy to open a PR if we need one

hi! what's the use case for adding `spec.completions` ?

Just to keep the number of jobs active in k8s to a manageable amount.

`spec.completions` manages number of instances of the same job.

are you looking into limiting how many jobs are making active progress at any point in time?

No, what I’m trying to avoid is a situation where after my flowspec is done running, I have hundreds of kubernetes jobs in a Completed state. They don’t take up any compute so it’s not terrible, but it does make debugging other kubernetes jobs more difficult because of the clutter when running kubectl get jobs

ah i see - i don't think `completions` will help with that. `ttlSecondsAfterFinished` will be a better fit - you can set this cluster wide instead and that's what we recommend doing.