Hi Outerbounds. We’re getting close to an implementation of Airflow + EKS for metaflow and have a question about scheduling multiple configs. Is there a way to schedule multiple Airflow config runs for the same model training dag? Say I have a training flow that trains 1 model for 1 brand, and i want to run that dag once a week for brand 1 and for brand 2. Note that when we have

core.dag_run_conf_overrides_params = False

, we can’t override the run config in Airflow (at least not in the UI) cc: @cold-actor-8608 @quiet-waiter-82239 @wide-battery-59962

stay tuned for an answer. It's a new feature so need to double-check first 🙂

@aloof-application-80784 there doesn't seem to be a way to enable this behavior in Airflow currently (Airflow's limitation unfortunately) without creating two separate DAGs.

Thanks guys! Looking forward to the new feature.