Hi I'm looking to set up logical replication for ...
# dev-metaflow
m
Hi I'm looking to set up logical replication for the metaflow UI. I was wondering whether this doc is the best source of information for setting that up? Also, is there any tooling for these database commands is in one of the Metaflow services? I guess the rest I will just do through terraform.
1
Also, these docs suggest that logical replication should be turned off when not needed. As this will not be possible in this case, I guess some appropriate monitors should be put in place instead?
d
if you use aurora, it is likely you won’t need logical replication. We have not tested it with Aurora though (we are actually doing that now internally). The point of logical replication was to prevent runaway queries from the UI (or too many queries), if you do have appropriate monitors, that hsould warn you. It is unlikely it happens though.
m
We are using aurora, yes. Everything seems to be working fine. 🙂 So that I understand, why do you think logical replication would not be necessary in this case? Because it comes with monitoring and auto-scaling functionality?
d
correct. Ideally you would redirect the UI to use the read endpoints for aurora.
the main use of the metadata service while running is write and the idea behind replication was to make sure that massive reads from the ui wouldn’t bother the writes. if you use aurora and things go to the read endpoint, that is scalable and won’t bug the writes.
the issue is that some requests are writes (mostly listen/notify type of things). But glad to know this is working. @User FYI ^.
m
ok, cool. Makes sense. I'll try to set up the UI to use the read endpoints.
Seems much simpler than setting up logical replication, so all good. 🙂
thanks for the help!
d
yep, definitely simpler 🙂. We didn’t have aurora setup at the time but are moving towards that now.
u
yes thats correct. We are moving to an Aurora based setup internally. As @dry-beach-38304 mentioned, the UI backend needs to perform some writes. If it helps, I can share my UI branch with you.
m
@User If you could, that would be great! Thanks