The PostCommit Python Xlang IO Dataflow job is flaky

[github-actions]

The PostCommit Python Xlang IO Dataflow is failing over 50% of the time.
Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_Python_Xlang_IO_Dataflow.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs.
See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=8&var-Workflow=PostCommit%20Python%20Xlang%20IO%20Dataflow

[ahmedabu98]

Green for the past few runs, closing now

[github-actions]

Reopening since the workflow is still flaky

[ahmedabu98]

@chamikaramj I tried a local run and the Managed Iceberg test is failing with this error:

INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:203 2024-12-16T19:43:49.788Z: JOB_MESSAGE_BASIC: Managed transform(s) ref_AppliedPTransform_Managed-Write-ICEBERG-SchemaAwareExternalTransform-beam-transform-managed-v1_16(beam:schematransform:org.apache.beam:iceberg_write:v1) are being processed by Dataflow. This may take a few minutes.

ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:207 2024-12-16T19:49:33.668Z: JOB_MESSAGE_ERROR: Dataflow is unable to process managed transform(s) ref_AppliedPTransform_Managed-Write-ICEBERG-SchemaAwareExternalTransform-beam-transform-managed-v1_16(beam:schematransform:org.apache.beam:iceberg_write:v1) due to an internal error. Rejecting the new job or the update request since upgrading failed. If the issue persists, please contact Google Cloud Support.

job: 2024-12-16_11_43_48-9336703639939757998 in the clouddfe project