cuddly-rocket-69327
09/20/2021, 7:13 PMparams
fields in `current`:
class ExampleFlow(FlowSpec):
date_key = Parameter("date_key", default="2020-07-23")
data_path = Parameter("data_path", default="<s3://aip-example-stage/data/>")
@datasets.input(name="train_data", path=f"{current.params.data_path}/date={current.params.date_key}")
@step
def start(self):
pass
average-beach-28850
09/20/2021, 7:25 PMaverage-beach-28850
09/20/2021, 7:28 PMdefault=
for Parameter, and that callable would be called by metaflow latercuddly-rocket-69327
09/20/2021, 7:29 PMself
? Or must we introduce a current.param
field?average-beach-28850
09/20/2021, 7:30 PMcuddly-rocket-69327
09/20/2021, 7:33 PMcurrent.params
🙂average-beach-28850
09/20/2021, 7:35 PMparameters.py
i believeaverage-beach-28850
09/20/2021, 7:39 PMaverage-beach-28850
09/20/2021, 7:39 PMpath=f"{current.params.data_path}/date={current.params.date_key}"
before params are even parsed, so a bit of a 🐔 🥚 problem herecuddly-rocket-69327
09/20/2021, 9:58 PMpath="{current.params.data_path}/date={current.params.date_key}"
average-beach-28850
09/20/2021, 10:03 PMdatasets.input
implementation in this case. That is, it would be part of datasets.input
contract (not general Metaflow decorator contract) that you can a template string as a path
parameter and it'll do parameter substitution therecuddly-rocket-69327
09/20/2021, 10:05 PMpath="{self.params.data_path}"