https://outerbounds.com/ logo
Join Slack
Powered by
Hello, is this image safe to use for metadata-serv...
# ask-metaflow
f
Hello, is this image safe to use for metadata-service instead of netflixoss(
netflixoss/metaflow_metadata_service:v2.3.9
)? 
public.ecr.aws/outerbounds/metaflow_metadata_service:2.3.7-obp
✅ 1
s
yes, indeed
f
what does 
obp
means?
a
oh missed the 
obp
tag. you can use the images that don't have the obp tag.
obp images are a different set of images that power the outerbounds platform
f
There is no 
2.3.8
without 
OBP
in ecr. But there is 
2.3.6
will it be fine to run metadata-service on it?
And for metaflow-ui is it necessary to use 
public_ip
?
s
@average-beach-28850 can you assist here?
a
@fancy-mouse-14245 can you check again in a few mins, somehow it didn't get built but 2.3.8 should be there now
f
ok. Also wanted to know, I haven’t run any flow yet. And 
metaflow-ui-backend
is throwing error.
Copy code
psycopg2.errors.UndefinedTable: relation "public.flows_v3" does not exist
Is it because the service is looking for a flow_id and it doesn’t have any?
a
this is usually because db migrations didn't run
there is a command to run them, but how its triggered depends on how you deployed this (helm / terraform / cloudformation / manual)
f
Im using terraform to deploy.
a
it should run hte migrations after it first comes up. I would first focus on making sure you can run flows and metadata-service is running
If you get this error and you haven't run any important flows yet, it may be the easiest to try to redeploy first (tf destroy and apply again)
f
is it necessary for metaflow-ui to use 
public_ip
?
Answering to you question, I was not using public ip for metadata service. So, it wasn’t able to pull the public image. Hence, the service was not up.
a
By default, service sits behind API gateway for auth, and API gateway endpoint is public. This is probably 90% of use cases. UI has only very rudimentary auth using an allowlist of public IPs. Its possible to run this whole thing on private subnets without public IP, but in this case our terraform module leaves it to you to figure out how you would connect to it (maybe you already have a VPN solution, or something like that)
f
Yes, we have VPN setup. That’s why I was looking for UI to be accessed only under VPN
a
gotcha, it should work, but not the most commonly used version. Also I think most/all people using this option still have NAT gw / IGW configured for private subnets so they can connect to the public internet to pull images
Now, in theory, aside from container images, it can work without outside internet access too but thats even further off the beaten path
12 Views
Open in Slack
PreviousNext
Powered by