Hi there! I'm running metaflow on AWS batch, and I...
# ask-metaflow
g
Hi there! I'm running metaflow on AWS batch, and I'm getting the following log on every step that includes the
@card
decorator:
Copy code
Card render failed with error : 
Object not found:
Task('TrainingFlow/1725991069291779/train_fold/12') does not exist
This doesn't block the flow from running. Everything works fine when running locally. Any ideas?
1
h
hey Santiago! have you deployed a metadata service in your Metaflow deployment ? (docs for it are here) It seems you have a "local metadata provider" meaning all the metadata about you execution is being written on your local machine; Because of which batch execution is unable to create the card. A work around can be that you can create one more Metaflow
@step
that runs locally and follows your
@batch
step. You can set the
@card
on that locally run step and you should be able to access the card for that.
g
I used the CloudFormation template to create a stack to run the flow using
--with batch
. I set up this env variable:
Copy code
METAFLOW_SERVICE_URL=<https://jza9cty78i.execute-api.us-east-1.amazonaws.com/api/>
The value is one of the outputs from the stack. Wouldn't that set up the service? Is there anything else I need to do for that service to work?
h
that should setup the service. But it seems that your execution didn't use the service. Do you have a metaflow configuration file ?
g
hmmm, that must be it. Let me look into this and report back. Thanks!
Fixed. Thanks @hallowed-glass-14538!
👌 1