thanks for your patience! Here's an example how to synchronize full directories to/from S3 efficiently using

metaflow.S3

. (sharing with the channel since this is a FAQ) This parallelizes all uploads and downloads, so it should be very fast. When downloading files locally, there's no unnecessary local disk IO since all files are just moved to the right place.