Hi, I am using a customized version of this <docke...
# ask-metaflow
c
Hi, I am using a customized version of this docker-compose to run metaflow locally. If i have an
otlp endpoint
available, how do config
the metaflow services
to send
Opentelemetry traces
to my endpoint?
a
@thankful-ambulance-42457 thoughts?
t
what kind of traces are you looking to send? For the time being the metaflow services do not have any hooks for opentelemetry yet, apart from an extremely minor subsection: • The metaflow UI backend uses the
metaflow client
under the hood for reading certain artifact values. In essence it is only used as an established API to access the datastore. As such, the opentelemetry tooling that is available for the client library, can also be configured for the ui_backend service. Note though that this will by no means give a complete picture on what is happening in the service If you have traces in mind that you would like to see as part of the services, feel free to open a Github issue on it to outline the use case. I do agree that having support for pushing out traces for the services could be a useful feature to have.
c
Thanks for the reply. I am looking for the opentelmetry trace. From this task.py implementation trace_id = get_trace_id() it seems to refer to this opentelemetry tracing module I was hoping that if i run this
Copy code
python hello_flow.py run
metaflow will forward traces to my collector.
You can trace the issue back to this threat here 1 year ago, when we have a working otel traces forwarding to our collector using the batch module. Somehow, we don't the traces in our collector (sumologics) anymore. And i am trying to reproduce this in local, using docker-compose, to figure out what did i miss.