Hello, I've trying for a long time to execute a pipeline in GKE with managed composer. All the pipelines seem to fail because de

airflow-xcom-sidecar

container dies between steps. Any idea why could something like this happen?

pod/start-j49vmaw9                                         Container base exceeded its local ephemeral storage limit "10Mi".

Hey Eduardo! This seems like the sidecar container is crashing because it's unable to get enough disk. Currently it seems to be set to 10 mebibytes. You can change the value of ephemeral storage. There is a slightly involved way to configuring this. There are defaults set for the xcom container over here. You can override these values by updating the

airflowLocalSettings

in the helm chart or update the

airflow_local_settings.py

with the modifications you need for the

PodDefaults.SIDECAR_CONTAINER

. There is a GH issue that talks about this; Now to do this in cloud composer, there is a Stackoverflow issue that talks about how one can override this file in cloud composer. maybe a good place to start there ?