# Jobs show as 'submitted' on Cylc GUI but actually they have failed

**URL:** <https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649>\
**Category:** Cylc Support\
**Created:** [May 11, 2023, 8:16am UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649 "2023-05-11T08:16:05Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![soi521](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/soi521/32/257_2.png) [@soi521](https://cylc.discourse.group/u/soi521)\
**Post date:** [May 11, 2023, 8:16am UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649/1 "2023-05-11T08:16:05Z")

</div>

Dear Cylc,

I have found that for some of my Cylc jobs the Cylc GUI says they have status ‘submitted’ when according to sacct they are actually ‘failed’ (see screenshot on [https://www.tobymarthews.com/uploads/1/1/3/1/11315558/sacct\_status.png](https://www.tobymarthews.com/uploads/1/1/3/1/11315558/sacct_status.png) ).

I guess either they are failed (in which case the Cylc GUI is wrong) or not (in which case sacct is wrong). Can anyone help me resolve this? What am I missing?

Thanks very much for any comments.

Toby Marthews

---

<div class="post-metadata">

**Author:** ![oliver.sanders](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/oliver.sanders/32/110_2.png) [@oliver.sanders](https://cylc.discourse.group/u/oliver.sanders)\
**Post date:** [May 11, 2023, 8:45am UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649/2 "2023-05-11T08:45:35Z")

</div>

It is possible that the submissions disappeared from the Slurm queue, try polling the submissions using `cylc poll`.

---

<div class="post-metadata">

**Author:** ![dpmatthews](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/dpmatthews/32/26_2.png) [@dpmatthews](https://cylc.discourse.group/u/dpmatthews)\
**Post date:** [May 11, 2023, 10:24am UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649/3 "2023-05-11T10:24:39Z")

</div>

In your `job.err` files you will find:

```auto
ERROR: cylc-7.8.1-dirty not found in /apps/jasmin/metomi

```

You appear to be using a very old, non-standard, version of Cylc which is not available on the compute nodes.

---

<div class="post-metadata">

**Author:** ![soi521](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/soi521/32/257_2.png) [@soi521](https://cylc.discourse.group/u/soi521)\
**Post date:** [May 12, 2023, 8:47am UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649/4 "2023-05-12T08:47:27Z")

</div>

Thank you for the comments. I have restarted my example and managed to get the sacct status to change from “failed” to “pending”, but the jobs still do not ever start so I am in more or less the same position as before. New screenshot: [https://www.tobymarthews.com/uploads/1/1/3/1/11315558/screenshot.png](https://www.tobymarthews.com/uploads/1/1/3/1/11315558/screenshot.png)

- dpmatthews: I have upgraded to Cylc 7.8.12 (the latest installed by the managers of the platform I am using). I have requested an upgrade to Cylc 8.1.3, but it seems I am the first user to request this, so when they will do it I don’t know. I don’t have installation rights myself.

- oliver.sanders: Thank you for the advice. However, I don’t get any information from cylc poll (see below). Am I using this right? Could you please give an example?

[tmarthews@cylc1 ~]$ sacct --format=JobID%20,JobName%60,Partition,AllocCPUS%5,State%10,Submit%20,Start%20,End%20,Elapsed,ExitCode  
JobID JobName Partition Alloc State Submit Start End Elapsed ExitCode

* * *

```
        50334743 vn7.2_elevq.fcm_make_debug.1 par-multi 1 PENDING 2023-05-12T00:37:13 Unknown Unknown 00:00:00 0:0
        50334744 vn7.2_elevq.fcm_make_mpi.1 par-multi 1 PENDING 2023-05-12T00:37:13 Unknown Unknown 00:00:00 0:0
        50334745 vn7.2_elevq.fcm_make_mpi_rivers-only.1 par-multi 1 PENDING 2023-05-12T00:37:13 Unknown Unknown 00:00:00 0:0

```

[tmarthews@cylc1 ~]$ cylc poll vn.2\_elevq.fcm\_make\_debug.1  
Contact info not found for suite “vn.2\_elevq.fcm\_make\_debug.1”, suite not running?  
[tmarthews@cylc1 ~]$ cylc poll vn.2\_elevq.fcm\_make\_debug  
Contact info not found for suite “vn.2\_elevq.fcm\_make\_debug”, suite not running?  
[tmarthews@cylc1 ~]$ cylc poll vn.2\_elevq  
Contact info not found for suite “vn.2\_elevq”, suite not running?  
[tmarthews@cylc1 ~]$ cylc poll 50334745  
Contact info not found for suite “50334745”, suite not running?  
[tmarthews@cylc1 ~]$

---

<div class="post-metadata">

**Author:** ![dpmatthews](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/dpmatthews/32/26_2.png) [@dpmatthews](https://cylc.discourse.group/u/dpmatthews)\
**Post date:** [May 12, 2023, 2:15pm UTC](https://cylc.discourse.group/t/jobs-show-as-submitted-on-cylc-gui-but-actually-they-have-failed/649/5 "2023-05-12T14:15:26Z")

</div>

I maintain the Cylc installation on JASMIN (and Cylc 8.1.4 is installed).  
Your suite appears to be running OK - the fact that the jobs are queuing is not a Cylc issue.  
I’ll send you an email.