So I intended to run this “pseudo code”, which is hopefully self explanatory, in parallel using --batch

…
self.next(self.train_and_score_model, foreach='fold_number_list')
…
@step
    def train_and_score_model(self):
…
@step
    def join(self, inputs):
        print("Rejoining from the folds.")
        self.next(self.end)

I only realised that AWS batch works sequentially using a queue as far as I know. Curious, how can I run train_and_score_model in parallel for all folds in fold_number_list? Can I not utilise the several vCPUs as well in AWS batch as stated in the resources not available locally? python Bla.py --with batch:cpu=16,memory=30720,queue=amazing_queue --environment=conda run