Skip to content

6.1. Nodes

The resource status of every monitored node at a glance, and how to install the node agent.

The node list screen

Overview

The Nodes menu lists every node in the Kubernetes cluster along with its live resource usage. You can compare the headline metrics — CPU usage, memory usage, network traffic, load average — directly in the list, and click a node to see its detailed metric charts.

A node without the node agent (openmaru-node-agent) installed appears in the list as No agent. The node agent is part of the Helm chart and is deployed to every node in the cluster automatically (see the Installation chapter).

Open this screen from the Nodes menu in the left sidebar.


The node list

Screen layout

The node list table

The Nodes screen is made up of the following.

AreaDescription
Search fieldAt the top right of the screen. Type a node name or IP address to filter the list quickly (it also matches other column values such as role and state).
Node list tableEach node's state and resource usage, by column.

Node list columns

ColumnDescription
NodeThe node's name, with a colour icon for its state. Click it to open that node's detail page.
RoleThe node's Kubernetes role (control-plane, worker and so on).
IP addressThe node's IP address. Click it to open that node's detail page.
StateThe node's current state, as a colour dot.
UptimeHow long the node has run without interruption (days, hours, minutes).
CoresThe number of CPU cores.
MemoryTotal memory capacity.
GPUThe number of GPUs. Nodes without one show -.
CPUCurrent CPU usage (%), as a bar and a figure.
MemoryCurrent memory usage (%), as a bar and a figure.
Load average (1, 5, 15 min)The 1-minute load average (primary) with the 5- and 15-minute values (secondary), shown with a bar.
Network inCurrent network receive (Rx) traffic, with a down arrow icon.
Network outCurrent network transmit (Tx) traffic, with an up arrow icon.

Node states

Node states are as follows.

StateColourDescription
UpGreenThe node agent is working and metrics are being collected
DownRed (blinking)No metrics are arriving. The node or the agent may have failed
No agent (unknown)Red (blinking)The node exists in the Kubernetes cluster but the node agent is not installed

Note: the CPU and memory usage bars change colour with the level of use, from normal (green) to warning (orange) to critical (red). CPU turns to warning at 70% and critical at 85%; memory turns to warning at 75% and critical at 90%. The load average turns to warning (orange) at 1× the core count and critical (red) at 2×.


Main features

Searching for a node

To find a particular node quickly:

  1. Type a node name or IP address into the search field at the top right (it also matches other column values such as role and state).
  2. Only the nodes matching your text remain in the list.
  3. Click the x button to the right of the search field to reset the search.

Sorting columns

To sort the nodes by a particular metric:

  1. Click a column header at the top of the table (CPU, Memory, Load average (1, 5, 15 min) and so on).
  2. Click the same header again to switch between ascending and descending.
  3. You can sort by several columns at once.

Tip: sorting the CPU column descending gets you quickly to the nodes with the highest CPU usage.

Installing the node agent

The node agent is part of the main Helm chart and is deployed automatically to every node in the cluster as a DaemonSet. Installing the Helm chart puts the agent on each node; there is nothing to do in the UI. For installation and configuration (including setting the Observability URL and API key), see the Installation chapter.

Note: a node without the node agent appears in the list as No agent, and no detailed metrics such as CPU and memory are collected for it. Where you see this, check that the node agent DaemonSet pod deployed correctly on that node.

Going to a node's detail page

To see a particular node's detailed metrics:

  1. Click the node name or IP address in the list.
  2. That node's detail page opens.

The node detail page

The node detail page

The node detail page carries the selected node's system information and its time-series metric charts.

Header and basic information

The node's basic information appears at the top of the page.

ItemDescription
Node nameThe name of the selected node
IP addressThe node's IP address
CoresThe number of CPU cores
MemoryTotal memory capacity
GPUThe number of GPUs (shown only where the node has one)
StateThe node's current state (up, down, no agent)

Click the node name dropdown in the breadcrumb area to switch to another node quickly. Click the Nodes link to return to the node list.

Note: where the query time range is longer than three days, it is limited automatically to the last three days. The time range bar at the top shows the range actually being queried, with a 3-day limit badge where the limit applied.

Where a node is not responding (powered off, disconnected from the network) or has no node agent installed, a message explains that the node exists in the Kubernetes cluster but its metrics cannot be collected.


System tab

The node details — System tab

The System tab carries the node's system resource metrics.

Node information

The Node information section is expanded by default; click its header to collapse or expand it. It carries the following.

ItemDescription
NodeThe node name and IP address
RoleThe node's Kubernetes role (control-plane, worker and so on)
Kernel versionThe Linux kernel version
Kubelet versionThe Kubernetes kubelet version
Container runtime versionThe container runtime (containerd, for example)
OS imageThe operating system image name (Rocky Linux 9.5, for example)
Cloud providerThe cloud environment, where applicable
Availability zoneThe cloud availability zone, where applicable
Instance typeThe cloud instance type, where applicable

System metric sections

Click a section header to expand or collapse its charts.

SectionMetrics included
CPUOverall CPU usage (%), CPU usage detail (user, nice, system, iowait, steal, irq, softirq and so on), top CPU processes, and the load average (1, 5, 15 min) time series
MemoryMemory usage and free space over time
NetworkReceive and transmit traffic per network interface
DiskDisk read and write throughput, disk usage, and I/O utilization

Tip: the CPU, memory, network and disk sections are expanded by default. Leaving only the sections you need expanded helps you concentrate on the metrics you want.

For how to work the charts (zoom, legend toggling, full screen and so on), see Using charts.


GPU tab

The node details — GPU tab

The GPU tab is enabled only on nodes fitted with a GPU. A badge beside the tab gives the number of GPUs.

The GPU tab carries the following GPU metric charts.

MetricDescription
GPU utilizationGPU core utilization (%) over time
GPU memory utilizationGPU memory utilization (%) over time
GPU temperatureGPU temperature over time
GPU powerGPU power consumption over time
Top GPU processesUsage per process using the GPU
Top GPU memory processesUsage per process using GPU memory

Note: on nodes without a GPU, the GPU tab is disabled.


  • Dashboard — overall cluster resource status
  • Using charts — working the charts (zoom, legend, full screen and so on)
  • Settings — managing the node agent API key
  • Installation — the agent installation guide