Hi
I'm looking to set up logical replication for ...
# dev-metaflowm
mammoth-rainbow-82717
12/06/2022, 2:24 PMHi
I'm looking to set up logical replication for the metaflow UI. I was wondering whether this doc is the best source of information for setting that up?
Also, is there any tooling for these database commands is in one of the Metaflow services? I guess the rest I will just do through terraform.
✅ 1
mammoth-rainbow-82717
12/06/2022, 2:26 PMAlso, these docs suggest that logical replication should be turned off when not needed.
As this will not be possible in this case, I guess some appropriate monitors should be put in place instead?
d
dry-beach-38304
12/06/2022, 5:11 PMif you use aurora, it is likely you won’t need logical replication. We have not tested it with Aurora though (we are actually doing that now internally). The point of logical replication was to prevent runaway queries from the UI (or too many queries), if you do have appropriate monitors, that hsould warn you. It is unlikely it happens though.
m
mammoth-rainbow-82717
12/06/2022, 5:18 PMWe are using aurora, yes. Everything seems to be working fine. 🙂
So that I understand, why do you think logical replication would not be necessary in this case? Because it comes with monitoring and auto-scaling functionality?
d
dry-beach-38304
12/06/2022, 5:19 PMcorrect. Ideally you would redirect the UI to use the read endpoints for aurora.
dry-beach-38304
12/06/2022, 5:19 PMthe main use of the metadata service while running is write and the idea behind replication was to make sure that massive reads from the ui wouldn’t bother the writes. if you use aurora and things go to the read endpoint, that is scalable and won’t bug the writes.
dry-beach-38304
12/06/2022, 5:20 PMthe issue is that some requests are writes (mostly listen/notify type of things). But glad to know this is working. @User FYI ^.
m
mammoth-rainbow-82717
12/06/2022, 5:21 PMok, cool. Makes sense. I'll try to set up the UI to use the read endpoints.
mammoth-rainbow-82717
12/06/2022, 5:21 PMSeems much simpler than setting up logical replication, so all good. 🙂
mammoth-rainbow-82717
12/06/2022, 5:21 PMthanks for the help!
d
dry-beach-38304
12/06/2022, 5:49 PMyep, definitely simpler 🙂. We didn’t have aurora setup at the time but are moving towards that now.
u
user
12/06/2022, 6:42 PMyes thats correct. We are moving to an Aurora based setup internally. As @dry-beach-38304 mentioned, the UI backend needs to perform some writes. If it helps, I can share my UI branch with you.
m
mammoth-rainbow-82717
12/06/2022, 7:15 PM@User If you could, that would be great! Thanks