Hi, we are trying to use arm64 arch for our develo...
# ask-metaflow
m
Hi, we are trying to use arm64 arch for our developments with metaflow. Currently, we are always experiencing an error : exec /bin/bash: exec format error. Our compute environment has c6g, m6g, r6g machines. We built multi-arch images with buildx. The only thing we noticed is by looking to aws docs (https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ecs-arm64.html) the ecs task should have the parameter runtimePlatform which we don’t see in the task registered by metaflow. Then my question, would you have any tutorial showing step by step how to setup metaflow with arm64 architecture. Thanks in advance for any answer you could provide. Regards, Frédéric
1
👍🏽 1
👍 2
a
Unfortunately i haven't seen anyone trying arm64 with batch so far, maybe we could add an argument for runtimePlatform for the AWS Batch plugin, if that's all it needs
m
Would be extremely interested. Arm machines are around 20% till 40% cheaper. Do you think that it would be that simple ?
a
hmm now that I think about it, with AWS Batch you don't have direct control over task spec, just the AWS Batch job definition. I don't see that field there 🤔 But they mention arm a few times in the docs
I wonder if you try to use arm64-only image, would that work
m
Hi, we use arm64 image built with buildx but we are stuck with the error message mentioned above. Unfortunately, it isn’t very clear and therefore I was looking for a tutorial in case I would miss anything. Currently, we were just trying to run the helloworld script. Works without any issue with amd64 image. I continue to investigate how to create a 1st MVP. Thanks.
Hi, I confirm that the issue was related to our arm64. When properly built, metaflow on arm works like a breeze. Cross compiling was just not properly carried out on our side. Regards, Frédéric
a
thanks for the update!