Hi, Im trying to setup a ml workflow with metaflow...
# ask-metaflow
h
Hi, Im trying to setup a ml workflow with metaflow. After the initial flow is completed, im expecting the deployjob to triggered (using
@trigger_on_finish
decorator), but the i dont see the flow running. In the logs of the initial triggered(manually) flow, i see the event being published.
Copy code
local.user.sln.projectflow-x2t9b-start-3826449337: Setting up task environment.
local.user.sln.projectflow-x2t9b-start-3826449337: Downloading code package...
local.user.sln.projectflow-x2t9b-start-3826449337: Code package downloaded.
local.user.sln.projectflow-x2t9b-start-3826449337: Task is starting.
local.user.sln.projectflow-x2t9b-start-3826449337: project name: local
local.user.sln.projectflow-x2t9b-start-3826449337: project branch: user.sln
local.user.sln.projectflow-x2t9b-start-3826449337: is this a production run? False
local.user.sln.projectflow-x2t9b-start-3826449337: Argo Event (metaflow.local.user.sln.ProjectFlow.start) published.
local.user.sln.projectflow-x2t9b-start-3826449337: time="2024-02-02T14:52:13 GMT+5:30" level=info msg="sub-process exited" argo=true error="<nil>"
local.user.sln.projectflow-x2t9b-start-3826449337: time="2024-02-02T14:52:13 GMT+5:30" level=info msg="no need to save parameter - on overlapping volume: /mnt/out/task_id" argo=true
local.user.sln.projectflow-x2t9b-end-161317768: Setting up task environment.
local.user.sln.projectflow-x2t9b-end-161317768: Downloading code package...
local.user.sln.projectflow-x2t9b-end-161317768: Code package downloaded.
local.user.sln.projectflow-x2t9b-end-161317768: Task is starting.
local.user.sln.projectflow-x2t9b-end-161317768: Argo Event (metaflow.local.user.sln.ProjectFlow.end) published.
local.user.sln.projectflow-x2t9b-end-161317768: time="2024-02-02T14:52:57 GMT+5:30" level=info msg="sub-process exited" argo=true error="<nil>"
I have created an evensource aswell.
Copy code
apiVersion: <http://argoproj.io/v1alpha1|argoproj.io/v1alpha1>
kind: EventSource
metadata:
  name: projectflow
spec:
  service:
    ports:
      - port: 12000
        targetPort: 12000
  webhook:
    # event-source can run multiple HTTP servers. Simply define a unique port to start a new HTTP server
    projectflow:
      # port to run HTTP server on
      port: "12000"
      # endpoint to listen to
      endpoint: /projectflow
      # HTTP request method to allow. In this case, only POST requests are accepted
      method: POST
I see sensor pod aswell. Still the deployjob flow is not running. Is there something im missing?