Regarding the RDS setup by CloudFormation, how do its costs scale? Do I understand correctly that this RDS is to coordinate batch instances during flow execution?

not exactly coordinate - just to collect metadata. Thanks to Metaflow's architecture, relatively little pressure is put on the RDS instance, so you can get far with small and medium-size instances