I try to run a batch job that very simply (POCing)...
# ask-metaflow
h
I try to run a batch job that very simply (POCing) tries to unzip some files in a S3 bucket folder. I get: botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied so it must be a permission issue. Which metaflow roll requires adjustment and how (started to adjust metaflow-xxx-batch-execution)? Is there documentation? Guess the services will have to be restarted? Would adjustment like this be baked into the teraform or the like? Thanks.
1
a
if you're using terraform modules, that would be this role, which is used as job role in the batch task definition. Its not the (confusingly named) "execution role", the latter is only used by ecs/batch agent to push logs and pull secrets and such
h
thanks. just to double check it is this one?: METAFLOW_ECS_S3_ACCESS_IAM_ROLE will try tomorrow.
this works great btw. thanks!
a
great!