Job Data Schema
ClusterCockpit Job Data Schema Reference
The following schema in its raw form can be found in the ClusterCockpit GitHub repository.
Manual Updates
Changes to the original JSON schema found in the repository are not automatically rendered in this reference documentation.Last Update: 02.02.2024Job metric data list
Title: Job metric data list
Description: Collection of metric data of a HPC job
1. [Required] Property Job metric data list > mem_used
Description: Memory capacity used
1.1. [Required] Property Job metric data list > mem_used > node
| |
---|
Type | object |
Required | Yes |
Additional properties | [Any type: allowed] |
Defined in | job-metric-data.schema.json |
Description: Metric data of a HPC job
1.1.1. [Required] Property Job metric data list > mem_used > node > unit
Description: Metric unit
1.1.1.1. [Required] Property Job metric data list > mem_used > node > unit > base
| |
---|
Type | enum (of string) |
Required | Yes |
Description: Metric base unit
Must be one of:
- “B”
- “F”
- “B/s”
- “F/s”
- “CPI”
- “IPC”
- “Hz”
- “W”
- “°C”
- ""
1.1.1.2. [Optional] Property Job metric data list > mem_used > node > unit > prefix
| |
---|
Type | enum (of string) |
Required | No |
Description: Unit prefix
Must be one of:
1.1.2. [Required] Property Job metric data list > mem_used > node > timestep
Description: Measurement interval in seconds
1.1.3. [Optional] Property Job metric data list > mem_used > node > thresholds
Description: Metric thresholds for specific system
1.1.3.1. [Optional] Property Job metric data list > mem_used > node > thresholds > peak
1.1.3.2. [Optional] Property Job metric data list > mem_used > node > thresholds > normal
1.1.3.3. [Optional] Property Job metric data list > mem_used > node > thresholds > caution
1.1.3.4. [Optional] Property Job metric data list > mem_used > node > thresholds > alert
1.1.4. [Optional] Property Job metric data list > mem_used > node > statisticsSeries
Description: Statistics series across topology
1.1.4.1. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > min
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
min items | - |
1.1.4.1.1. Job metric data list > mem_used > node > statisticsSeries > min > min items
1.1.4.2. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > max
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
max items | - |
1.1.4.2.1. Job metric data list > mem_used > node > statisticsSeries > max > max items
1.1.4.3. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > mean
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
mean items | - |
1.1.4.3.1. Job metric data list > mem_used > node > statisticsSeries > mean > mean items
1.1.4.4. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles
1.1.4.4.1. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 10
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
10 items | - |
1.1.4.4.1.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 10 > 10 items
1.1.4.4.2. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 20
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
20 items | - |
1.1.4.4.2.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 20 > 20 items
1.1.4.4.3. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 30
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
30 items | - |
1.1.4.4.3.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 30 > 30 items
1.1.4.4.4. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 40
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
40 items | - |
1.1.4.4.4.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 40 > 40 items
1.1.4.4.5. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 50
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
50 items | - |
1.1.4.4.5.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 50 > 50 items
1.1.4.4.6. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 60
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
60 items | - |
1.1.4.4.6.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 60 > 60 items
1.1.4.4.7. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 70
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
70 items | - |
1.1.4.4.7.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 70 > 70 items
1.1.4.4.8. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 80
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
80 items | - |
1.1.4.4.8.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 80 > 80 items
1.1.4.4.9. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 90
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
90 items | - |
1.1.4.4.9.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 90 > 90 items
1.1.4.4.10. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 25
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
25 items | - |
1.1.4.4.10.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 25 > 25 items
1.1.4.4.11. [Optional] Property Job metric data list > mem_used > node > statisticsSeries > percentiles > 75
| |
---|
Type | array of number |
Required | No |
| Array restrictions |
---|
Min items | 3 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
Each item of this array must be | Description |
---|
75 items | - |
1.1.4.4.11.1. Job metric data list > mem_used > node > statisticsSeries > percentiles > 75 > 75 items
1.1.5. [Required] Property Job metric data list > mem_used > node > series
| |
---|
Type | array of object |
Required | Yes |
| Array restrictions |
---|
Min items | N/A |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
1.1.5.1. Job metric data list > mem_used > node > series > series items
1.1.5.1.1. [Required] Property Job metric data list > mem_used > node > series > series items > hostname
1.1.5.1.2. [Optional] Property Job metric data list > mem_used > node > series > series items > id
1.1.5.1.3. [Required] Property Job metric data list > mem_used > node > series > series items > statistics
Description: Statistics across time dimension
1.1.5.1.3.1. [Required] Property Job metric data list > mem_used > node > series > series items > statistics > avg
Description: Series average
1.1.5.1.3.2. [Required] Property Job metric data list > mem_used > node > series > series items > statistics > min
Description: Series minimum
1.1.5.1.3.3. [Required] Property Job metric data list > mem_used > node > series > series items > statistics > max
Description: Series maximum
1.1.5.1.4. [Required] Property Job metric data list > mem_used > node > series > series items > data
| Array restrictions |
---|
Min items | 1 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
1.1.5.1.4.1. At least one of the items must be
2. [Required] Property Job metric data list > flops_any
Description: Total flop rate with DP flops scaled up
2.1. [Optional] Property Job metric data list > flops_any > node
Description: Metric data of a HPC job
2.2. [Optional] Property Job metric data list > flops_any > socket
Description: Metric data of a HPC job
2.3. [Optional] Property Job metric data list > flops_any > memoryDomain
Description: Metric data of a HPC job
2.4. [Optional] Property Job metric data list > flops_any > core
Description: Metric data of a HPC job
2.5. [Optional] Property Job metric data list > flops_any > hwthread
Description: Metric data of a HPC job
3. [Required] Property Job metric data list > mem_bw
Description: Main memory bandwidth
3.1. [Optional] Property Job metric data list > mem_bw > node
Description: Metric data of a HPC job
3.2. [Optional] Property Job metric data list > mem_bw > socket
Description: Metric data of a HPC job
3.3. [Optional] Property Job metric data list > mem_bw > memoryDomain
Description: Metric data of a HPC job
4. [Required] Property Job metric data list > net_bw
Description: Total fast interconnect network bandwidth
4.1. [Required] Property Job metric data list > net_bw > node
Description: Metric data of a HPC job
5. [Optional] Property Job metric data list > ipc
Description: Instructions executed per cycle
5.1. [Optional] Property Job metric data list > ipc > node
Description: Metric data of a HPC job
5.2. [Optional] Property Job metric data list > ipc > socket
Description: Metric data of a HPC job
5.3. [Optional] Property Job metric data list > ipc > memoryDomain
Description: Metric data of a HPC job
5.4. [Optional] Property Job metric data list > ipc > core
Description: Metric data of a HPC job
5.5. [Optional] Property Job metric data list > ipc > hwthread
Description: Metric data of a HPC job
6. [Required] Property Job metric data list > cpu_user
Description: CPU user active core utilization
6.1. [Optional] Property Job metric data list > cpu_user > node
Description: Metric data of a HPC job
6.2. [Optional] Property Job metric data list > cpu_user > socket
Description: Metric data of a HPC job
6.3. [Optional] Property Job metric data list > cpu_user > memoryDomain
Description: Metric data of a HPC job
6.4. [Optional] Property Job metric data list > cpu_user > core
Description: Metric data of a HPC job
6.5. [Optional] Property Job metric data list > cpu_user > hwthread
Description: Metric data of a HPC job
7. [Required] Property Job metric data list > cpu_load
Description: CPU requested core utilization (load 1m)
7.1. [Required] Property Job metric data list > cpu_load > node
Description: Metric data of a HPC job
8. [Optional] Property Job metric data list > flops_dp
Description: Double precision flop rate
8.1. [Optional] Property Job metric data list > flops_dp > node
Description: Metric data of a HPC job
8.2. [Optional] Property Job metric data list > flops_dp > socket
Description: Metric data of a HPC job
8.3. [Optional] Property Job metric data list > flops_dp > memoryDomain
Description: Metric data of a HPC job
8.4. [Optional] Property Job metric data list > flops_dp > core
Description: Metric data of a HPC job
8.5. [Optional] Property Job metric data list > flops_dp > hwthread
Description: Metric data of a HPC job
9. [Optional] Property Job metric data list > flops_sp
Description: Single precision flops rate
9.1. [Optional] Property Job metric data list > flops_sp > node
Description: Metric data of a HPC job
9.2. [Optional] Property Job metric data list > flops_sp > socket
Description: Metric data of a HPC job
9.3. [Optional] Property Job metric data list > flops_sp > memoryDomain
Description: Metric data of a HPC job
9.4. [Optional] Property Job metric data list > flops_sp > core
Description: Metric data of a HPC job
9.5. [Optional] Property Job metric data list > flops_sp > hwthread
Description: Metric data of a HPC job
10. [Optional] Property Job metric data list > vectorization_ratio
Description: Fraction of arithmetic instructions using SIMD instructions
10.1. [Optional] Property Job metric data list > vectorization_ratio > node
Description: Metric data of a HPC job
10.2. [Optional] Property Job metric data list > vectorization_ratio > socket
Description: Metric data of a HPC job
10.3. [Optional] Property Job metric data list > vectorization_ratio > memoryDomain
Description: Metric data of a HPC job
10.4. [Optional] Property Job metric data list > vectorization_ratio > core
Description: Metric data of a HPC job
10.5. [Optional] Property Job metric data list > vectorization_ratio > hwthread
Description: Metric data of a HPC job
11. [Optional] Property Job metric data list > cpu_power
Description: CPU power consumption
11.1. [Optional] Property Job metric data list > cpu_power > node
Description: Metric data of a HPC job
11.2. [Optional] Property Job metric data list > cpu_power > socket
Description: Metric data of a HPC job
12. [Optional] Property Job metric data list > mem_power
Description: Memory power consumption
12.1. [Optional] Property Job metric data list > mem_power > node
Description: Metric data of a HPC job
12.2. [Optional] Property Job metric data list > mem_power > socket
Description: Metric data of a HPC job
13. [Optional] Property Job metric data list > acc_utilization
Description: GPU utilization
13.1. [Required] Property Job metric data list > acc_utilization > accelerator
Description: Metric data of a HPC job
14. [Optional] Property Job metric data list > acc_mem_used
Description: GPU memory capacity used
14.1. [Required] Property Job metric data list > acc_mem_used > accelerator
Description: Metric data of a HPC job
15. [Optional] Property Job metric data list > acc_power
Description: GPU power consumption
15.1. [Required] Property Job metric data list > acc_power > accelerator
Description: Metric data of a HPC job
16. [Optional] Property Job metric data list > clock
Description: Average core frequency
16.1. [Optional] Property Job metric data list > clock > node
Description: Metric data of a HPC job
16.2. [Optional] Property Job metric data list > clock > socket
Description: Metric data of a HPC job
16.3. [Optional] Property Job metric data list > clock > memoryDomain
Description: Metric data of a HPC job
16.4. [Optional] Property Job metric data list > clock > core
Description: Metric data of a HPC job
16.5. [Optional] Property Job metric data list > clock > hwthread
Description: Metric data of a HPC job
17. [Optional] Property Job metric data list > eth_read_bw
Description: Ethernet read bandwidth
17.1. [Required] Property Job metric data list > eth_read_bw > node
Description: Metric data of a HPC job
18. [Optional] Property Job metric data list > eth_write_bw
Description: Ethernet write bandwidth
18.1. [Required] Property Job metric data list > eth_write_bw > node
Description: Metric data of a HPC job
19. [Required] Property Job metric data list > filesystems
| |
---|
Type | array of object |
Required | Yes |
Description: Array of filesystems
| Array restrictions |
---|
Min items | 1 |
Max items | N/A |
Items unicity | False |
Additional items | False |
Tuple validation | See below |
19.1. Job metric data list > filesystems > filesystems items
19.1.1. [Required] Property Job metric data list > filesystems > filesystems items > name
19.1.2. [Required] Property Job metric data list > filesystems > filesystems items > type
| |
---|
Type | enum (of string) |
Required | Yes |
Must be one of:
- “nfs”
- “lustre”
- “gpfs”
- “nvme”
- “ssd”
- “hdd”
- “beegfs”
19.1.3. [Required] Property Job metric data list > filesystems > filesystems items > read_bw
Description: File system read bandwidth
19.1.3.1. [Required] Property Job metric data list > filesystems > filesystems items > read_bw > node
Description: Metric data of a HPC job
19.1.4. [Required] Property Job metric data list > filesystems > filesystems items > write_bw
Description: File system write bandwidth
19.1.4.1. [Required] Property Job metric data list > filesystems > filesystems items > write_bw > node
Description: Metric data of a HPC job
19.1.5. [Optional] Property Job metric data list > filesystems > filesystems items > read_req
Description: File system read requests
19.1.5.1. [Required] Property Job metric data list > filesystems > filesystems items > read_req > node
Description: Metric data of a HPC job
19.1.6. [Optional] Property Job metric data list > filesystems > filesystems items > write_req
Description: File system write requests
19.1.6.1. [Required] Property Job metric data list > filesystems > filesystems items > write_req > node
Description: Metric data of a HPC job
19.1.7. [Optional] Property Job metric data list > filesystems > filesystems items > inodes
Description: File system write requests
19.1.7.1. [Required] Property Job metric data list > filesystems > filesystems items > inodes > node
Description: Metric data of a HPC job
19.1.8. [Optional] Property Job metric data list > filesystems > filesystems items > accesses
Description: File system open and close
19.1.8.1. [Required] Property Job metric data list > filesystems > filesystems items > accesses > node
Description: Metric data of a HPC job
19.1.9. [Optional] Property Job metric data list > filesystems > filesystems items > fsync
Description: File system fsync
19.1.9.1. [Required] Property Job metric data list > filesystems > filesystems items > fsync > node
Description: Metric data of a HPC job
19.1.10. [Optional] Property Job metric data list > filesystems > filesystems items > create
Description: File system create
19.1.10.1. [Required] Property Job metric data list > filesystems > filesystems items > create > node
Description: Metric data of a HPC job
19.1.11. [Optional] Property Job metric data list > filesystems > filesystems items > open
Description: File system open
19.1.11.1. [Required] Property Job metric data list > filesystems > filesystems items > open > node
Description: Metric data of a HPC job
19.1.12. [Optional] Property Job metric data list > filesystems > filesystems items > close
Description: File system close
19.1.12.1. [Required] Property Job metric data list > filesystems > filesystems items > close > node
Description: Metric data of a HPC job
19.1.13. [Optional] Property Job metric data list > filesystems > filesystems items > seek
Description: File system seek
19.1.13.1. [Required] Property Job metric data list > filesystems > filesystems items > seek > node
Description: Metric data of a HPC job
Generated using json-schema-for-humans on 2024-02-02 at 14:36:54 +0100