Skip to content

do not judge a queued PBS worker as stalled; bump version to 3.0.27 - #62

Merged
zaihuaji merged 1 commit into
mainfrom
hua-work-dsquasar
Nov 2, 2026
Merged

zaihuaji merged 1 commit into
mainfrom
hua-work-dsquasar

Conversation

@zaihuaji

@zaihuaji zaihuaji commented Nov 2, 2026

Copy link
Copy Markdown
Collaborator

worker_progress_stalled() now returns False unless the dscheck status is 'R'.

The dscheck daemon sets pid to the PBS job id and stttime to the submit time already at qsub, and rdaps lists a queued job as alive. So a worker 1 waiting in the PBS queue longer than GATHGRACE (2h) read as a running job with nothing done, and the next cron submit added a useless -w 2 worker into the same stuck queue (seen 2026-11-02: check 4173333 queued 4h25m, then 4173901 -w 2). init_dscheck sets status 'R' and resets stttime once the batch job really starts, so real stalls are still detected.

Bumps version to 3.0.27.

🤖 Generated with Claude Code

worker_progress_stalled() now returns False unless the dscheck status is 'R'.
The dscheck daemon sets pid to the PBS job id and stttime to the submit time
already at qsub, and rdaps lists a queued job as alive, so a worker 1 waiting
in the PBS queue longer than GATHGRACE read as running with nothing done and
the next cron submit added a useless -w 2 worker into the same queue.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@zaihuaji
zaihuaji merged commit f7a848d into main Nov 2, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant