clever-pencil-68951
02/19/2023, 8:32 PMclever-pencil-68951
02/20/2023, 6:25 AMvictorious-lawyer-58417
02/20/2023, 7:33 AMconfig.json by default but you can use config_poc.json by specifying METAFLOW_PROFILE=pocvictorious-lawyer-58417
02/20/2023, 7:35 AMaws s3 ls <s3://metaflow-s3-poc/> on this same instance to check that AWS permissions are working correctly?clever-pencil-68951
02/20/2023, 8:32 AMclever-pencil-68951
02/20/2023, 1:24 PMclever-pencil-68951
02/20/2023, 1:28 PMclever-pencil-68951
02/20/2023, 1:42 PMclever-pencil-68951
02/20/2023, 2:37 PMvictorious-lawyer-58417
02/20/2023, 6:52 PMMETAFLOW_PROFILE only configures things pertaining to Metaflow, like where its data should be stored, where to find the metadata service etc
⢠To make Metaflow work, you need to have IAM roles and credentials set up so that you can access the buckets and other resources specified in the Metaflow config (through METAFLOW_PROFILE). This is where AWS_PROFILE comes in.victorious-lawyer-58417
02/20/2023, 6:55 PMvictorious-lawyer-58417
02/20/2023, 6:56 PMaws s3 ls <s3://metaflow-s3-poc/> fails too as you showed above, it seems your credentials don't allow you to access the metaflow-s3-poc bucketvictorious-lawyer-58417
02/20/2023, 6:58 PM~/.aws/credentials and attach a policy to the role that grants it access to metaflow-s3-poc . Or you can do S3FullAccess default policy, if that's ok in your environmentclever-pencil-68951
02/21/2023, 11:39 AM