I just successfully setup AWS support using the cloudformati Outerbounds #ask-metaflow

I just successfully setup AWS support using the cl...

creamy-stone-99746

01/26/2023, 8:10 PM

I just successfully setup AWS support using the cloudformation template. Everything seems to work so far. However I've noticed that it seems to take 10-20 seconds to start my flows.

Copy code

Metaflow 2.7.19 executing HelloAWSFlow for user:mike
Validating your flow...
    The graph looks good!
Running pylint...
    Pylint is happy!

It sits here for 20secs then works as expected. Not a big problem but wondering if there is anything I can configure to make it faster.

✅ 1

ancient-application-36103

01/26/2023, 9:15 PM

is this flow running on Batch or just locally?

ancient-application-36103

01/26/2023, 9:15 PM

just it run quicker if you specify

--metadata=local

--datastore=local

creamy-stone-99746

01/26/2023, 9:15 PM

Just locally but using the service

ancient-application-36103

01/26/2023, 9:16 PM

it could very well be service latency - highly dependent on a variety of factors like your wifi 😞

creamy-stone-99746

01/26/2023, 9:25 PM

This is running in an EC2 instance.

creamy-stone-99746

01/26/2023, 10:08 PM

It's consistently 20 seconds where does the service run? Does it need to spin up?

square-wire-39606

01/26/2023, 11:02 PM

the service is running as a fargate task

square-wire-39606

01/26/2023, 11:02 PM

you should be able to find it in the ec2 console

creamy-stone-99746

01/26/2023, 11:03 PM

Oh thats what that is. Cool thanks. If it gets worse I'll ping you again.

👍 1

ambitious-bird-15073

01/27/2023, 4:23 AM

Are you running the flow in the root directory?

8 Views

Open in Slack

Previous Next