How are people handling logging with Metaflow? We ...
# ask-metaflow
a
How are people handling logging with Metaflow? We would like to capture fully structured logs into Loki, which requires them to be in JSON format, which in turn makes them unreadable in the Metaflow UI. We ended up writing our own logging library that has 2 outputs: One that pushes JSON directly to Loki, skpping the stdout/stderr, and one that logs to stdout/stderr so stuff gets surfaced in the Metaflow UI. Our only problem with this approach is that now we’re getting double logs into Loki because we are unable to prevent Metaflow from logging into CloudWatch (all CloudWatch logs automatically get pushed to Loki in our case). Does anyone know how to have stdout/stderr only go into the Metaflow UI, but not into CloudWatch?
👍 1