Hey everyone,
I am using metaflow with aws batch and I wanted to know what would be the best way to refactor a large step into smaller functions/steps.
I have a step which runs on aws batch and uses a custom image. But the problem is it has a lot of lines and those can be split up but depend on the dependencies in the custom image.
What would be the best way to refactoring this? Can I use the same aws batch instance in multiple steps or how can I break the step into functions?
Thanks for the help.