Job Pending Reasons¶
Overview¶
When a job is in PENDING (queued) state, the system displays the reason why the job cannot run immediately. You can view the pending reason using cqueue or ccontrol show job commands to understand why the job is waiting.
Viewing Pending Reasons¶
Using cqueue¶
Example output:
JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON)
101 CPU job1 user1 PD 0:00 2 (Priority)
102 CPU job2 user1 PD 0:00 4 (Resource)
103 GPU job3 user2 PD 0:00 1 (Dependency)
104 CPU job4 user1 PD 0:00 2 (Held)
Using ccontrol show job¶
Example output:
Pending Reason Descriptions¶
Pending reasons are listed in judgment order from top to bottom. If a job satisfies multiple conditions simultaneously, the reason that appears first will be displayed.
| Reason | Description | When It Appears |
|---|---|---|
Held |
Job is held | Job was submitted in held state or set to held, requires manual release |
BeginTime |
Start time not reached | Job has a delayed start time (--begin parameter), waiting for specified time |
DependencyNeverSatisfied |
Dependency can never be satisfied | Required dependent job to succeed, but it actually failed, dependency conditions cannot be met |
Dependency |
Waiting for dependency | Job dependencies have not been satisfied (dependent jobs not completed, not started, etc.) |
Resource changed |
Resource configuration changed | Node resources changed during job scheduling, waiting for rescheduling |
Reservation deleted |
Reservation was deleted | Reservation originally allocated to the job has been deleted |
Reservation changed |
Reservation was changed | Reservation changed during scheduling, waiting for rescheduling |
License |
Insufficient licenses | Currently insufficient license resources requested by the job |
Resource |
Insufficient resources | Cluster does not have enough resources (CPU, memory, GPU, etc.) to satisfy job requirements |
Resource Reserved |
Resources are reserved | Resources needed by the job are reserved by other reservations in future time periods |
Priority |
Insufficient priority | Job priority is lower than other queued jobs, or concurrent job limit reached |