I try to run a batch job that very simply (POCing) tries to unzip some files in a S3 bucket folder. I get:
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied
so it must be a permission issue. Which metaflow roll requires adjustment and how (started to adjust metaflow-xxx-batch-execution)? Is there documentation? Guess the services will have to be restarted? Would adjustment like this be baked into the teraform or the like? Thanks.
✅ 1
a
average-beach-28850
05/29/2023, 2:24 PM
if you're using terraform modules, that would be this role, which is used as job role in the batch task definition. Its not the (confusingly named) "execution role", the latter is only used by ecs/batch agent to push logs and pull secrets and such
h
happy-wolf-7852
05/29/2023, 3:04 PM
thanks. just to double check it is this one?:
METAFLOW_ECS_S3_ACCESS_IAM_ROLE
will try tomorrow.