Internal error Traceback (most recent call last): ...
# ask-metaflow
a
Internal error Traceback (most recent call last): File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/cli.py", line 1172, in main start(auto_envvar_prefix="METAFLOW", obj=state) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 829, in call return self.main(args, kwargs) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 782, in main rv = self.invoke(ctx) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, ctx.params) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 610, in invoke return callback(args, kwargs) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/_vendor/click/decorators.py", line 33, in new_func return f(get_current_context().obj, args, kwargs) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 166, in create flow = make_flow( File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 349, in make_flow obj.package = MetaflowPackage( File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/package.py", line 74, in init self.blob = self._make() File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/package.py", line 172, in _make self._add_info(tar) File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/package.py", line 154, in _add_info env = self.environment.get_environment_info(include_ext_info=True) TypeError: get_environment_info() got an unexpected keyword argument 'include_ext_info' I am using Metaflow version 2.8.3.
1
a
what is the version of metaflow that you are on?
a
2.8.3
a
if you downgrade to
2.8.2
- do you still see this issue?
a
ok let me see if that works
a
also, are you using any metaflow extensions?
a
not using any extensions
metaflow==2.8.3 kubernetes==26.1.0
@square-wire-39606 looks like version 2.8.2 works!!!
a
can you try reinstalling
2.8.3
? I am unable to reproduce this issue.
Screen Shot 2023-04-17 at 3.42.41 PM.png
a
ok will reinstall 2.8.3
Also for version 2.8.2 it looked like the command executed correctly but when I tried to run the argoworkflow I got numpy dependency error. Here is the log of the command for version 2.8.2
I am getting the same error with version 2.8.3
File "/home/asif/miniconda3/envs/metaflow38/lib/python3.8/site-packages/metaflow/package.py", line 154, in _add_info env = self.environment.get_environment_info(include_ext_info=True) TypeError: get_environment_info() got an unexpected keyword argument 'include_ext_info'
a
How are you installing the package?
Ah it seems you are using the Netflix extensions. Can you remove those and try again?
a
how do i remove netflix extensions? sorry
s
what's the output of
pip freeze | grep nflx
?
a
just executed the above command on bash and there is no output
s
try
pip freeze | grep metaflow
?
a
pip uninstall metaflow-netflixext is this the command to uninstall netflix extension?
s
correct
that should do the trick
a
ok let me try to uninstall the extension
Ok that worked!!!
So we do not need those extensions any more?
a
unless you are using any specific functionality from those extensions, then no
👍 1
a
thanks!!!
one last question where can i read more about the extensions?
a
a
ok I do not get any dependency error now when I trigger argoworkflow. however I get another error when I trigger argoworkflow time="2023-04-17T230445.997Z" level=info msg="capturing logs" argo=true Setting up task environment. Downloading code package... Code package downloaded. Task is starting. Bootstrapping environment... Environment bootstrapped. /bin/bash: line 1: metaflow_TaskOptimization_linux-64_19b5cb2ef4211072f397394c86523ac5d65570e0/bin/python: No such file or directory time="2023-04-17T230517.007Z" level=info msg="sub-process exited" argo=true error="<nil>" time="2023-04-17T230517.007Z" level=info msg="no need to save parameter - on overlapping volume: /mnt/out/task_id" argo=true Error: exit status 127
Looks like the error is caused because no python is found. Do I need to do anything to include python?
d
I’ll update that extension too. That change was recent so didn’t yet have it there.
this is fixed in 0.1.0 in case you still need it.