Hi! Requesting for some help. Was running process_...
# ask-metaflow
f
Hi! Requesting for some help. Was running process_demo.py run - - with batch(chapter 4) and had an error: AWS Batch error: 2023-01-10 210726.950 [15/start/31 (pid 31166)] AWS Batch error: 2023-01-10 210726.950 [15/start/31 (pid 31166)] CannotPullContainerError: Error response from daemon: pull access denied for n/python, repository does not exist or may require 'docker login': denied: requested access to the resource is denied This could be a transient error. Use @retry to retry. 2023-01-10 210727.065 [15/start/31 (pid 31166)] 2023-01-10 210727.424 [15/start/31 (pid 31166)] Task failed. 2023-01-10 210727.694 Workflow failed. 2023-01-10 210727.694 Terminating 0 active tasks... 2023-01-10 210727.694 Flushing logs... Step failure: Step start (task-id 31) failed. When i made the configuration of CloudFormation template I set: apibasicauth:false Enable sagemaker: false Enable ui: false Where can the problem be? Thanks in advance!
1
a
can you paste the
process_demo.py
file? it seems that the flow is trying to use
n/python
image that doesn't exist.
f
Sure! from metaflow import FlowSpec, step import os global_value = 5 class ProcessDemoFlow(FlowSpec): @step def start(self): global global_value global_value = 9 print('process ID is', os.getpid()) print('global_value is', global_value) self.next(self.end) @step def end(self): print('process ID is' , os.getpid()) print('global_value is', global_value) if name == '__main__': ProcessDemoFlow()
However, it worked without - - with batch. And the same error keeps appearing in every run with different archives. I guess it might be an AWS permission issue of some sort.
a
and what does your metaflow config look like? If you peer into
~/.metaflowconfig/config.json
is there any value that's set to
n/python
?
f
There is a “metaflow_batch_container_registry” : ”n”. Should I change that? I cant see any configuration in aws outputs that resembles to that.
a
yeah - you can nuke that entire line
👍 1
s
the flows should run without any issues after that
👍 1
f
Thank you very much! That appears to solve the issue.