Why cant we see real-time logs of the step? Why the logs are printed only when the step is completed? Is there any work around?

the logs should be printed in near real-time - they are buffered a bit, so if your step runs only for a brief duration, it might give the perception that the logs are not real-time.

2023-01-19 12:52:45.468 1 task is running: avro_processing (1 running; 0 done).
2023-01-19 12:52:45.468 No tasks are waiting in the queue.
2023-01-19 12:52:45.468 end step has not started

This logs are produced by metaflow on fixed intervals, right?

Those are run time logs which are emitted if the task hasn't emitted any logs in a while to indicate to the user that the flow is still making progress.

ok thanks