Hey all I m trying to read the logs of a step using Python t Outerbounds #ask-metaflow

Hey all, I'm trying to read the logs of a step usi...

many-processor-72561

08/16/2023, 5:49 PM

Hey all, I'm trying to read the logs of a step using Python, this step had 2 attempts. Using the following I can access the log, BUT only for the second attempt. What I'm missing? Thanks 🙏

Copy code

for task in Step(f'{flow_name}/{run_id_}/{step_name}'):
    for log_line in task.loglines(stream="stdout"):
        log_text = log_line[1]
        print(log_text)

✅ 1

ancient-application-36103

08/17/2023, 3:25 PM

Task(

task_path_spec

, attempt=

attempt=0

).stdout will get you the stdout logs for the first attempt

many-processor-72561

08/17/2023, 3:29 PM

what do you mean by

task_path_spec

ancient-application-36103

08/17/2023, 3:30 PM

{flow_name}/{run_id_}/{step_name}/{task_id}

many-processor-72561

08/17/2023, 4:11 PM

Thats works, but if I run

Copy code

t = Task(f'{flow_name}/{run_id_}/{step_name}/{task_id}', attempt=0)
    for log_line in t.loglines(stream="stdout"):
        log_text = log_line[1]
        print(log_text)

Copy code

t = Task(f'{flow_name}/{run_id_}/{step_name}/{task_id}', attempt=1)
    for log_line in t.loglines(stream="stdout"):
        log_text = log_line[1]
        print(log_text)

I still get the logs for the first attempt insteaad of getting the logs for the second attempt when I use

attempt=1

ancient-application-36103

08/17/2023, 4:13 PM

do you see different output with

Task(f'{flow_name}/{run_id_}/{step_name}/{task_id}', attempt=1)

and

Task(f'{flow_name}/{run_id_}/{step_name}/{task_id}')

ancient-application-36103

08/17/2023, 4:13 PM

assuming the task only had 2 attempts

many-processor-72561

08/17/2023, 4:27 PM

🤦‍♂️ my bad, I was overwritten the attempt in my code. That works thanks

3 Views

Open in Slack

Previous Next