Hi, I have a quick question about how the metaflow UI gets updated when running a long process in a given step.
For context, one of my steps needs to run a subprocess which will take a long time to complete. One thing I've noticed is that the metaflow UI will sometimes mark a job as failed but the subprocess is still running without issue. If I stop the run, I see that flow is running and I see the flow gets shut down with no issue.
In these scenarios where you have a long running process, do you need to do some dummy operations e.g increase a counter in the step or log that the process is running so that the metaflow UI doesn't show that the flow has failed?