Hi, what would be the best way to have some steps ...
# ask-metaflow
s
Hi, what would be the best way to have some steps always run locally (e.g. because they have to load local files) and others remotely? Specifying
@resources
for possibly-remote steps and using
--with batch
would be ideal, but this means everything runs remotely (including steps without
@resources
). There was some talk of an @local decorator here, is this still being considered? Otherwise, I can only see commenting out @batch decorators as needed, which doesn't feel great. Thanks!
1
s
You can create pure python decorators to mimic the
@local
functionality. Here is an example - https://github.com/jacopotagliabue/recs-at-resonable-scale/blob/main/src/custom_decorators.py#L48