# Cylc tui and web ui not detecting running jobs?

**URL:** <https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832>\
**Category:** Cylc Support\
**Created:** [December 11, 2023, 1:41am UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832 "2023-12-11T01:41:03Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![jonnyhtw](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/jonnyhtw/32/232_2.png) [@jonnyhtw](https://cylc.discourse.group/u/jonnyhtw)\
**Post date:** [December 11, 2023, 1:41am UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/1 "2023-12-11T01:41:03Z")

</div>

hey,

a few hours ago, several of my cylc jobs either failed, or went to submit-failed. the jobs themselves are still running however and producing data.

is there a way to get cylc to ‘reconnect’ to the running jobs?

i’ve tried polling them but this doesn’t do anything.

thanks

jonny

---

<div class="post-metadata">

**Author:** ![hilary.j.oliver](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/hilary.j.oliver/32/4_2.png) [@hilary.j.oliver](https://cylc.discourse.group/u/hilary.j.oliver)\
**Post date:** [December 11, 2023, 7:22am UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/2 "2023-12-11T07:22:06Z")

</div>

Polling a supposedly-failed task should return it to running or succeeded status, if it did not in fact fail.

I suspect something has got wrong on our system recently that causes incorrect poll results. I will investigate tomorrow…

---

<div class="post-metadata">

**Author:** ![jonnyhtw](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/jonnyhtw/32/232_2.png) [@jonnyhtw](https://cylc.discourse.group/u/jonnyhtw)\
**Post date:** [December 11, 2023, 10:30pm UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/3 "2023-12-11T22:30:32Z")

</div>

thanks @hilary.j.oliver, as you mentioned in our local Teams chat, it seems the same as what happened last week to another NIWA user.

---

<div class="post-metadata">

**Author:** ![andrewp](https://avatars.discourse-cdn.com/v4/letter/a/df788c/32.png) [@andrewp](https://cylc.discourse.group/u/andrewp)\
**Post date:** [December 13, 2023, 9:39pm UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/4 "2023-12-13T21:39:53Z")

</div>

I think I have just run into this same issue on Maui. I have jobs that are still running and producing output, but showing Failed in the Web UI. Interestingly, the box in the Workflows sidebar is still blue, but if I click on the running suite it shows Failed.

---

<div class="post-metadata">

**Author:** ![hilary.j.oliver](https://yyz2.discourse-cdn.com/free1/user_avatar/cylc.discourse.group/hilary.j.oliver/32/4_2.png) [@hilary.j.oliver](https://cylc.discourse.group/u/hilary.j.oliver)\
**Post date:** [December 14, 2023, 3:57am UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/5 "2023-12-14T03:57:19Z")

</div>

I haven’t been able to reproduce the problem here. If you think it’s reproducible for you, please get in touch with me directly. However, I suspect it is a symptom of recent Slurm problems on our HPC.

---

<div class="post-metadata">

**Author:** ![andrewp](https://avatars.discourse-cdn.com/v4/letter/a/df788c/32.png) [@andrewp](https://cylc.discourse.group/u/andrewp)\
**Post date:** [December 14, 2023, 4:10am UTC](https://cylc.discourse.group/t/cylc-tui-and-web-ui-not-detecting-running-jobs/832/6 "2023-12-14T04:10:32Z")

</div>

Thanks @hilary.j.oliver, my conversation with NeSI support suggests it’s probably the Slurm controller issues. I’ll let you know if it doesn’t resolve once that is fixed.