Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow MAX_ATTEMPTS configurable #2279

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

dhpikolo
Copy link

@dhpikolo dhpikolo commented Feb 19, 2025

In this PR, I allow configuration of MAX_ATTEMPTS envar

  • Add to the metaflow_config file
  • Mount the new envar to kubermetes, argo-workflows, airflow and aws-batch plugins.

New Behaviour

User can set METAFLOW_MAX_ATTEMPTS to configure MAX_ATTEMPTS internal envvar.

Resolves: #2276

@dhpikolo dhpikolo marked this pull request as draft February 19, 2025 14:56
@romain-intel
Copy link
Contributor

I'll take a look a bit closer but one thing I can say already is that we probably want to min it with what is already there because otherwise if it is decreased, the client may misbehave. Related to that, I don't know if we can dis-associate it totally from the run in the client because again, otherwise, the client may misbehave.

@dhpikolo dhpikolo marked this pull request as ready for review February 24, 2025 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow configuration of max attempts for a task
2 participants