Hey team, Is it possible to upload artifacts from...
# ask-metaflow
g
Hey team, Is it possible to upload artifacts from historical local runs to a remote datastore in S3? I have some runs stored on my local disk that I would like to persist to our remote datastore; however, I can’t simply just run the Flow again since our source data gets updated daily and we don’t have a way of specifying which day of data we want.
1
a
Hi Winston, these historical runs - were they executed with the
datastore
set to
s3
- either through the cli -
--datastore=s3
or in the metaflow config
METAFLOW_DEFAULT_DATASTORE=s3
?
g
No, the datastore was not set to
s3
unfortunately
They are stored locally on my computer
s
And were you using the metadata service for those local runs?
g
I was not
a
unfortunately there isn't an easy way to sync your local state to s3/rds at the moment
g
Ah okay, thanks for the help!
Just curious though, could I configure my Metaflow to point to the remote datastore and run the
resume
command on the previous runs? Would that make the artifacts of that run get stored to the remote dataset?
a
Not really - resume only works when the config is the same for the resumed flow
thankyou 1
g
Ah okay