Nodes

Node Based Metric Information of one Cluster

Node Overview

Nodes View

Nodes View. This example shows the last two hours of the ‘clock’ metric of eight nodes. Node ‘f0147’ of the ‘main’ partition has an average below the configured ‘alert’ threshold, and is colored in red.

The node overview is always called in respect to one specified cluster. It displays the current state of all nodes in that cluster in respect to one selected metric, rendered in form of metric plots, and independent of job meta data, i.e. without consideration for job start and end timestamps.

Overview Selection Bar

Nodes View

Selections regarding the display, and update, of the plots rendered in the node table can be performed here:

  • Find Node:: Filter the node table by hostname. Partial queries are possible.
  • Displayed Timerange: Select the timeframe to be rendered in the node table
    • Custom: Select timestamp from and to in which the data should be fetched. It is possible to select date and time.
    • 15 Minutes, 30 Minutes, 1 Hour, 2 Hours, 4 Hours, 12 Hours, 24 Hours
  • Metric:: Select the metric to be fetched for all nodes. If no data can be fetched, messages are displayed per node.
  • (Periodic) Reload: Force reload of fresh data from the backend or set a periodic reload in specified intervals
    • 30 Seconds, 60 Seconds, 120 Seconds, 5 Minutes

Node Table

Nodes (hosts) are ordered alphanumerically in this table, rendering the selected metric in the selected timeframe.

Each heading links to the singular node view of the respective host.

Node List

Nodes List Data

Nodes View.

The node list view is also always called in respect to one specified cluster, and optionally, subCluster. It displays the current state of all nodes in that cluster (or subCluster) in respect to a selectable number, and order, of metrics. Plots are rendered in form of metric plots, and are independent of job meta data, i.e. without consideration for job start and end timestamps.

The always visible “Node Info”-Card displays the following information. “List”-Bottons will lead to according views with preset filters.

FieldExampleDescriptionDestination
Card HeaderNode a0421 Alex A40Hostname and ClusterNode View
Status IndicatorStatus ExclusiveIndicates the host state via keywords, see below-
Activity2 JobsNumber of Jobs currently running on hostJob List
Users2 UsersNumber and IDs of users currently running jobsUser Table
Projects1 ProjectNumber and IDs of projects currently running jobsProject Table

In order to give an idea of the currentnode state, the following indicators are possible:

Node StatusTypeDescription
ExclusiveJob-InfoOne exclusive job is currently running, utilizing all of the nodes’ hardware
SharedJob-InfoOne or more shared jobs are currently running, utilizing allocated amounts of the nodes’ hardware
AllocatedFallbackIf more jobs than one are running, but all jobs are marked as ’exclusive’, this fallback is used
IdleJob-InfoNo currently active jobs
WarningWarningAt least one of the selected metrics does not return data successfully. Can hint to configuration problems.
UnhealthyWarningNone of the selected metrics return data successfully. Node could be offline or misconfigured.

List Selection Bar

Nodes List Header

Nodes List Header Options.

The selection header allows for configuration of the displayed data in terms of selected metrics or timerange.

FieldExampleDescription
Metrics4 SelectedMenu for and Number of Metrics currently selected
Resolution600Resolution of the metric plots rendered for each node
Find Node(s)a0421Filter for hostnames
RangeLast 12hrsTime range to be displayed as X-Axis
Refresh60 SecondsEnable automatic refresh of metric plots
FieldExampleDescriptionDestination
Job Id123456The JobId of the job assigned by the scheduling daemon. The icon on the right allows for easy copy to clipboard.Job View

Extended Legend

Extended Legend

Nodes List Extended Legend. Usernames and Job-IDs are shown in addition to the Resource-ID for shared resources.

For nodes with multiple jobs running on them, accelerator metrics are extended by the username and the job-id currently utilizing this hardware ID. This is based on the ID information sent during job-start to cc-backend (Database resources-column).