Hey Metaflowers, Ever wondered how much CPU, memory, GPU, disk, or network traffic your Metaflow steps actually use? Or how to optimize resource allocation based on empirical data? Look no further! 😊 With just a simple step decorator, you can now: • Track resource usage of steps (both process-level and system-wide) with a 1-sec sampling rate (by default). • Auto-generate HTML cards with detailed time-series charts, aggregated stats (including historical runs), and

@resources

recommendations. • Find the most cost-efficient cloud servers from multiple vendors for execution. • ... and more! The open-source

resource-tracker

Python package has zero dependencies (at least on Linux, you need

psutil

on other OS), and integrates seamlessly with Metaflow. Read more at https://sparecores.com/article/metaflow-resource-tracker, and I truly appreciate any feedback 🙇 Thread in Slack Conversation