https://outerbounds.com/ logo
Join Slack
Powered by
Hi team, since `@tensorflow_parallel` hasn't been ...
# ask-metaflow
f
Hi team, since 
@tensorflow_parallel
hasn't been released, is there anyway to install it through an experimental plugin? I would like to play around it.
✅ 1
a
You can install it from here - 
pip install git+<https://github.com/netflix/metaflow.git@refs/pull/872/head>
If it works for you, we are happy to dress up the PR and publish it
f
Thanks! I will update in this thread
among us party 1
Hi @square-wire-39606 , I installed by the command 
pip install git+<https://github.com/netflix/metaflow.git@refs/pull/872/head>
But when I try to run a flow I get an error
Copy code
File "/Users/linz1/miniconda3/envs/tf_parallel/lib/python3.9/site-packages/metaflow/plugins/__init__.py", line 139, in <module>
    from .frameworks.pytorch import PytorchParallelDecorator
ModuleNotFoundError: No module named 'metaflow.plugins.frameworks'
It seems we still lack some dependency packages. Do you have some ideas about how to solve this? Thanks!
Here is the complete error message
Copy code
(tf_parallel) linz1@ADSKTR2CQ24X50 metaflow % python flow.py run                                                        
Traceback (most recent call last):
  File "/Users/linz1/Team/onboarding/metaflow/flow.py", line 1, in <module>
    from metaflow import (
  File "/Users/linz1/miniconda3/envs/tf_parallel/lib/python3.9/site-packages/metaflow/__init__.py", line 214, in <module>
    _import_plugin_decorators(globals())
  File "/Users/linz1/miniconda3/envs/tf_parallel/lib/python3.9/site-packages/metaflow/decorators.py", line 504, in _import_plugin_decorators
    from .plugins import STEP_DECORATORS, FLOW_DECORATORS
  File "/Users/linz1/miniconda3/envs/tf_parallel/lib/python3.9/site-packages/metaflow/plugins/__init__.py", line 139, in <module>
    from .frameworks.pytorch import PytorchParallelDecorator
ModuleNotFoundError: No module named 'metaflow.plugins.frameworks'
👀 1
c
Hi @fast-dog-88545. This afternoon I was able to run a helloworld with 
@tensorflow_parallel
after moving some files from PR 872 around. A Metaflow branch with the minor changes required to run the helloworld using the latest OSS Metaflow is here if you'd like to try it out for experimental purposes. Here is a flow you can run to test (same as the one Savin linked above). Let us know if this becomes a serious use case for you, I'd recommend we test this quite a bit more if so.
Sorry for being less than clear above @fast-dog-88545. You can install the commit on my branch with 
pip install git+<https://github.com/emattia/metaflow.git@4e8baa290e8eac8a0a7e062d923125820cca7e92>
Open in Slack
PreviousNext
Powered by