Skip to content

fix(alerts): exclude erofs/squashfs from KubernetesNodeReadOnlyRootFilesystem alert - #50

Merged
ibakshay merged 3 commits into
cloudoperators:mainfrom
jeoffzheng:fix/readonly-filesystem-alert-erofs
Aug 21, 2026
Merged

ibakshay merged 3 commits into
cloudoperators:mainfrom
jeoffzheng:fix/readonly-filesystem-alert-erofs

Conversation

@jeoffzheng

@jeoffzheng jeoffzheng commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Description

during the recently KVM upgrade, we observed that the KubernetesNodeReadOnlyRootFilesystem alert fires false positives because erofs filesystems are read-only by design

erofs and squashfs filesystems are read-only by design (e.g. Garden Linux
uses erofs on /dev/loop0 mounted at /). The previous rule matched these,
causing false-positive alerts on healthy nodes.

Observed on node001-bb629 in cc-b0-eu-de-1: /dev/loop0 (erofs) fires the
alert even though the node is fully operational.

Signed-off-by: jeoffzheng <101314942+jeoffzheng@users.noreply.github.com>
Signed-off-by: jeoffzheng <101314942+jeoffzheng@users.noreply.github.com>
@jeoffzheng
jeoffzheng requested a review from a team as a code owner August 6, 2026 12:41
Copilot AI lite review requested due to automatic review settings August 6, 2026 12:41

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adjusts the KubernetesNodeReadOnlyRootFilesystem Prometheus alert to avoid false positives on Garden Linux nodes where the root filesystem can be read-only by design (e.g., erofs), and bumps the Helm chart/plugin versions for release.

Changes:

  • Excludes read-only-by-design filesystem types (erofs, squashfs, iso9660) from the root filesystem read-only alert expression.
  • Bumps Helm chart version from 1.3.1 to 1.3.2.
  • Updates the plugin definition to reference version 1.3.2.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File Description
charts/kubernetes-operations/alerts/kubernetes-node.yaml Updates alert PromQL to exclude specific read-only-by-design fstypes.
charts/kubernetes-operations/Chart.yaml Bumps chart version to 1.3.2.
charts/kubernetes-operations/plugindefinition.yaml Updates plugin and referenced chart version to 1.3.2.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread charts/kubernetes-operations/alerts/kubernetes-node.yaml Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Signed-off-by: jeoffzheng <101314942+jeoffzheng@users.noreply.github.com>
@jeoffzheng

Copy link
Copy Markdown
Contributor Author

@viennaa would you mind to review it again? thanks.

@viennaa viennaa left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

@jeoffzheng

Copy link
Copy Markdown
Contributor Author

@viennaa mmm, not sure why, but i can not merge it ( no merge button appear for me), would you mind to merge it? thx

@ibakshay
ibakshay merged commit 98c2e26 into cloudoperators:main Aug 21, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants