Hi everyone, thank you for this awesome service. I really like the concept. I have a question about UI and Service. Because our company has no ability to store, process data outside our contour, we are using local clusters and services without internet connection. So that s3 is not our option. When we have upped service and ui, I can't see my artefacts in ui. File in the attachment. And I understand this problem, that is because using local datastore. But do you have any other options for this case?

you can use Minio locally. See e.g. this thread https://outerboundsco.slack.com/archives/C02116BBNTU/p1658180557762169

Oh, thank you for quick response. Am I understanding clearly, that it is only for artifacts storage? Processing will be realised locally, not in Kubernetes.

correct. You can run locally and use Minio just for storage. In this case Metaflow service will track all your runs and you can see them in the UI

Thank you so much. I will try.

let us know if you can't get it up and running easily. We are happy to help 🙂

I want to continue in this thread. So I have upped minio in metaflow-service docker-compose. The config looks like this:

minio:
    image: minio/minio
    ports:
      - "9000:9000"
      - "9001:9001"
    
    environment:
      MINIO_ACCESS_KEY: minio_bigdata
      MINIO_SECRET_KEY: h4fuisjf#4jd
    volumes:
      - minio_data:/data
      - minio_config:/root/.minio
    command: server --console-address ":9001" /data