Hello I am trying to deploy metaflow on AWS with k...
# ask-metaflow
d
Hello I am trying to deploy metaflow on AWS with kubernetes along with Argo. https://github.com/wmaiouiru/terraform-aws-metaflow/pull/1/files#diff-8b23cdddce8e6f767a86153d9a809f867221756be25a3f91c715e88488fdde7aR74 I have attempted to add
module "metaflow-ui"
to the terraform template, but the service doesn't show up. What is the best way to deploy metaflow-ui on AWS with kubernetes? To get around the EC2 size issue, I am attempting to use kubernetes instead of managed AWS service. https://outerbounds-community.slack.com/archives/C02116BBNTU/p1726541942260849?thread_ts=1672740816.558449&cid=C02116BBNTU
👀 2
✅ 1
With a long running loop we ran into an issue with step functions and batch as well:
The execution reached the maximum number of history events (25000).
on AWS with 5000 foreach https://docs.metaflow.org/metaflow/basics#foreach
h
Hey @dazzling-rocket-38979 I think it would be better if you split the step functions question into a separate thread. I can try to help with deploying metaflow UI on this thread. You mentioned that the metaflow UI service is not coming up. I am not exactly sure what you mean by that. However, looking at the code you linked I see that you are specifying two private subnets for the module. This will likely cause an issue because the UI module attempts to deploy an LB in order to server the website. You will need to specify public subnets if you are trying to access the UI via the open internet. If not, you will likely need to copy the ui module and modify it so it deploys a private LB and access that through some VPN or other method.
💡 1
d
Hello @hundreds-zebra-57629 Thank you for the advice and taking a look at my code. Let me give changing the private subnets and specifying a public subnet a try!