# Job submitted via Cylc fails, but runs fine with direct sbatch

**URL:** <https://cylc.discourse.group/t/job-submitted-via-cylc-fails-but-runs-fine-with-direct-sbatch/1240>\
**Category:** Cylc Support\
**Created:** [August 28, 2025, 12:07pm UTC](https://cylc.discourse.group/t/job-submitted-via-cylc-fails-but-runs-fine-with-direct-sbatch/1240 "2025-08-28T12:07:33Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![prajeeshag](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/prajeeshag/32/212_2.png) [@prajeeshag](https://cylc.discourse.group/u/prajeeshag)\
**Post date:** [August 28, 2025, 12:07pm UTC](https://cylc.discourse.group/t/job-submitted-via-cylc-fails-but-runs-fine-with-direct-sbatch/1240/1 "2025-08-28T12:07:33Z")

</div>

I’m running into an issue where a multinode job submitted through Cylc fail with the error:  
“cxil\_map: write error”

However, if I take the exact job script generated by Cylc and submit it directly with sbatch, the job runs without any problem.

I am using Cylc version 8.5.1.

I’d appreciate any help in debugging this issue.

Thanks in Advance.

---

<div class="post-metadata">

**Author:** ![oliver.sanders](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/oliver.sanders/32/110_2.png) [@oliver.sanders](https://cylc.discourse.group/u/oliver.sanders)\
**Post date:** [August 28, 2025, 12:42pm UTC](https://cylc.discourse.group/t/job-submitted-via-cylc-fails-but-runs-fine-with-direct-sbatch/1240/2 "2025-08-28T12:42:51Z")

</div>

Hi,

We haven’t had a report of this yet.

Could you provide the full error from the scheduler log and `job-activity.log` files incase it contains anything helpful.

An AI assistant gave me this response for the error message:

> The “cxil\_map: write error” typically occurs during inter-node GPU-aware MPI communication, often due to system misconfigurations or insufficient disk space. Ensure your system is updated and check your disk space to resolve this issue.

---

<div class="post-metadata">

**Author:** ![prajeeshag](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/prajeeshag/32/212_2.png) [@prajeeshag](https://cylc.discourse.group/u/prajeeshag)\
**Post date:** [August 30, 2025, 7:31am UTC](https://cylc.discourse.group/t/job-submitted-via-cylc-fails-but-runs-fine-with-direct-sbatch/1240/3 "2025-08-30T07:31:46Z")

</div>

Hi,

Thanks for the response. I was able to resolve the issue by adding

export FI\_CXI\_RX\_MATCH\_MODE=hybrid

to the job script. The problem wasn’t directly related to Cylc, but for some reason only the jobs submitted via Cylc were failing while the same script submitted manually with sbatch worked fine. My guess is that this is due to a difference in the environment when jobs are launched through Cylc verses manually to sbatch from the shell.

Thanks again.
