Hello everybody!
I have a question about MetaFlow...
# ask-metaflowe
elegant-carpenter-7681
04/02/2023, 1:25 PMHello everybody!
I have a question about MetaFlow + Dashboard:
We have deployed MetaFlow on GCP with Kubernetes (and Argo). Everything is working very well.
We want to monitor 2 things:
• Pipelines Health (running, success, failure)
• ML Metrics (when training a model, AUC score, for example)
I initially decided to create my own Google DataStudio Dashboard by pushing pipeline data to BigQuery and connecting the dashboard to big query.
I know that there are many vendors outside.
What do you suggest? Any recommendations?
✅ 1
a
average-beach-28850
04/02/2023, 6:35 PMhonestly bigquery + data studio would be my first choice on GCP as well given how easy it is to set up, especially for ML metrics
average-beach-28850
04/02/2023, 6:36 PMfor pipeline operational metrics Argo also exposes some metrics in prometheus format so you could use google managed prometheus if you want, but its a bigger investment to set it up
e
elegant-carpenter-7681
04/04/2023, 3:49 AMThanks a lot, @narrow-lion-2703!
2 Views