Summary
Add fence_pve as a STONITH agent alongside the existing fence_scsi. Currently only fence_scsi is configured, which revokes SCSI reservations but does not power-cycle the VM. This leaves the fenced node running with hung NFS/iSCSI sessions, causing stale connections on Talos nodes and requiring manual intervention (just restart-deployments-with-pvc).
Problem
When Pacemaker fences a NAS node via fence_scsi:
- SCSI reservations are revoked (data integrity protected ✓)
- But the VM stays running with hung
zpool export, stale NFS kernel server, and iSCSI target remnants
- Talos nodes hold stale iSCSI sessions to the fenced node — I/O errors until manually restarted
- The fenced node may sit in this zombie state for hours until manually rebooted
Solution
Add fence_pve which talks to the Proxmox API to hard-stop/reboot the VM:
fence-nas-01 → connects to pve-01, targets VMID 103
fence-nas-02 → connects to pve-02, targets VMID 107
Both fence agents run together: fence_scsi for SCSI-level protection, fence_pve for actual VM power-cycle.
Setup steps
- Install
fence-agents-pve on both NAS nodes
- Create Proxmox API user/token with
VM.PowerMgmt + VM.Audit privileges
- Create two STONITH resources with location constraints (each node fences the other)
- Test with
--action=status before enabling
Setup details documented in NAS install notes (section 7b).
Summary
Add
fence_pveas a STONITH agent alongside the existingfence_scsi. Currently onlyfence_scsiis configured, which revokes SCSI reservations but does not power-cycle the VM. This leaves the fenced node running with hung NFS/iSCSI sessions, causing stale connections on Talos nodes and requiring manual intervention (just restart-deployments-with-pvc).Problem
When Pacemaker fences a NAS node via
fence_scsi:zpool export, stale NFS kernel server, and iSCSI target remnantsSolution
Add
fence_pvewhich talks to the Proxmox API to hard-stop/reboot the VM:fence-nas-01→ connects topve-01, targets VMID 103fence-nas-02→ connects topve-02, targets VMID 107Both fence agents run together:
fence_scsifor SCSI-level protection,fence_pvefor actual VM power-cycle.Setup steps
fence-agents-pveon both NAS nodesVM.PowerMgmt+VM.Auditprivileges--action=statusbefore enablingSetup details documented in NAS install notes (section 7b).