I am running into several initialization challenge...
# ask-metaflow
m
I am running into several initialization challenges with a custom step decorator that can run remote tasks in Azure Batch. I tried to use the batch_decoratory.py from metaflow.plugins.aws.batch module as a template (see attached code). However, when I use this in flowspec, I get errors such as: MyAzureBatchDecorator is not callable ImportError: cannot import name 'my_azure_batch' from 'custom_metaflow.plugins.decorators.my_azure_decorator' AttributeError: 'MyAzureDecorator' object has no attribute '__func__'. Did you mean: '__doc__'?
d
Building extensions to metaflow is certainly possible but you need to follow a template for it: • here is a semi up to date empty template: https://github.com/Netflix/metaflow-extensions-template • here is a fully functional one: https://github.com/Netflix/metaflow-nflx-extensions • a simpler one: https://github.com/outerbounds/metaflow-ray (caveat) It’s not a fully supported pattern (ie: we may change things and have a few times in the past) but it is heavily relied on so you are probably fairly safe developing using something like this. I haven’t looked at your code in detail at all but just looking at hte basic structure, it doesn’t respect the template so fixing that may go a long way.