Hi team, I'm running metaflow ray example on Mac a...
# ask-metaflowb
bumpy-orange-22261
03/04/2025, 5:24 PMHi team, I'm running metaflow ray example on Mac arm and facing this error
FileNotFoundError: [Errno 2] No such file or directory: '$MF_ARCH/5e78d8136bd30a8/bin/python -s'AWS_ACCESS_KEY_ID=minioadmin AWS_SECRET_ACCESS_KEY=minioadmin python basic_counter/flow.py --no-pylint --environment=pypi runa
ancient-application-36103
03/04/2025, 5:25 PMhi! let me check! meanwhile can you use a slightly older version of metaflow?
ancient-application-36103
03/04/2025, 5:26 PMmaybe 2.14.4?
ancient-application-36103
03/04/2025, 5:27 PMcan you help me with your local setup so that i can try to reproduce?
b
bumpy-orange-22261
03/04/2025, 5:27 PMyes, I will try with this version
bumpy-orange-22261
03/04/2025, 5:28 PMI setup docker container with metaflow service + metaflow-ui and config datastorage as local s3 with minio
a
ancient-application-36103
03/04/2025, 5:28 PMbtw we have a brand new feature that sets it up for you out of the box
ancient-application-36103
03/04/2025, 5:28 PMb
bumpy-orange-22261
03/04/2025, 5:44 PMseems, not exist version 2.14.4. I tried with 2.14.3 and get same problem but different error
FileNotFoundError: [Errno 2] No such file or directory: 'linux-64/5e78d8136bd30a8/bin/python -s'a
ancient-application-36103
03/04/2025, 5:45 PMcan you help me with your flow definition?
b
bumpy-orange-22261
03/04/2025, 5:46 PMjust a simple step like this, almost same with example on github
Copy code
@metaflow_ray
@pypi(packages={"ray": "2.39.0"})
@step
def execute(self):
self._do_ray_job()
self.next(self.join)bumpy-orange-22261
03/04/2025, 5:55 PMah, I found the root cause. in this function need to set `num_parallel=1`seems metaflow ray does not support multi node on mac local ?
Copy code
@step
def start(self):
self.next(self.execute, num_parallel=1)h
hallowed-glass-14538
03/04/2025, 5:56 PMcan try setting num_parallel > 1 ?
b
bumpy-orange-22261
03/04/2025, 5:57 PMdefault value in example code = 2 and I get the error. if I set 1, the flow run successfully
b
brainy-truck-72938
03/04/2025, 7:10 PMit is written in the readme
Copy code
However, when using the @metaflow_ray decorator in a standalone manner, the value of num_parallel cannot be greater than 1 (on Windows and macOS) because locally spun up ray clusters do not support multiple nodes unless the underlying OS is linux based.👍 1
b
bumpy-orange-22261
03/05/2025, 8:11 AM@brainy-truck-72938 I get same error if run multiple node on ubuntu host machine
Copy code
2025-03-05 15:10:01.160 [5/execute/17 (pid 13516)] File "/home/cuong007/micromamba/envs/metaflow/linux-64/1628e0b9cd19bf2/lib/python3.10/subprocess.py", line 1863, in _execute_child
2025-03-05 15:10:01.160 [5/execute/17 (pid 13516)] raise child_exception_type(errno_num, err_msg, err_filename)
2025-03-05 15:10:01.160 [5/execute/17 (pid 13516)] FileNotFoundError: [Errno 2] No such file or directory: '$MF_ARCH/1628e0b9cd19bf2/bin/python -s'b
brainy-truck-72938
03/05/2025, 8:13 AMCan you paste your flow if it is not confidential? Otherwise you can paste a dummy flow with the same structure
b
bumpy-orange-22261
03/05/2025, 8:14 AMI run this flow , just remove
@kubernetes👀 1
b
brainy-truck-72938
03/05/2025, 8:27 AMcan you try deleting the local environment that metaflow created..
Copy code
rm -rf ~/micromamba/envs/metaflow/linux-64/*b
bumpy-orange-22261
03/05/2025, 8:29 AMstill error 😂
b
brainy-truck-72938
03/05/2025, 8:34 AMcan you check if the following file exists..
~/micromamba/envs/metaflow/linux-64/1628e0b9cd19bf2/bin/pythonb
bumpy-orange-22261
03/05/2025, 8:36 AMyes, it exists.
👍 1
b
brainy-truck-72938
03/05/2025, 8:36 AMthe issue is that
MF_ARCHlinux-64b
bumpy-orange-22261
03/05/2025, 8:39 AMseems the change relates to
@pypi@condab
brainy-truck-72938
03/05/2025, 8:40 AMYeah, no harm in trying once
b
bumpy-orange-22261
03/05/2025, 8:44 AM😂 same error with
@condab
brainy-truck-72938
03/05/2025, 8:46 AMThanks, this is likely a bug, we will have a look.
👍 1
2 Views