Make kvm domain persistent when unmanaged from CS by sudo87 · Pull Request #11541 · apache/cloudstack · GitHub

Description

CS creates transient KVM domain.xml. When instance is unmanaged from CS, explicit dump of domain has to be taken to manage is outside of CS.

With this PR

domainXML gets backed up and becomes persistent for further management of Instance.
Stopped instance also can be unmanaged, last host for instance is considered for defining domain
hostid param is supported in unmanageVirtualMachine API for KVM hypervisor and for stopped Instances
hostid field in response of unmanageVirtualMachine, representing host used for unmanage operation
Disable unmanaging instance with config drive, can unmanage from API using forced=true param for KVM

Doc PR:
apache/cloudstack-documentation#562

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)
build/CI
test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Major
Minor

Bug Severity

BLOCKER
Critical
Major
Minor
Trivial

Screenshots (if appropriate):

In above screenshot, "i-2-3-VM" is no longer managed by CS and is brought down. It is still listed in response of:

virsh list --all

API payload and response:

How Has This Been Tested?

For Running Instance:

Created an instance and verified listing it using 'virsh list --all'
Unmanage the instance, xml is found in "/etc/libvirt/qemu" directory (persistent domains location)
Brought that instance down with 'virsh destory '
It is seen in response of 'virsh list --all'
Imported KVM instance in the CS to manage

For Stopped Instance:

Created an instance and verified listing it using 'virsh list --all'
Stop the VM, confirm that domain disappears with virsh
Unmanage the instance, xml gets registered in "/etc/libvirt/qemu" directory (persistent domains location)
Start the instance with 'virsh start '
Import KVM instance in the CS to manage

How did you try to break this feature and the system with this change?

@blueorangutan package

Codecov Report

❌ Patch coverage is 55.50847% with 105 lines in your changes missing coverage. Please review.
✅ Project coverage is 17.53%. Comparing base (ec533cd) to head (4e36aa1).
⚠️ Report is 18 commits behind head on main.

Files with missing lines	Patch %	Lines
...wrapper/LibvirtUnmanageInstanceCommandWrapper.java	32.91%	51 Missing and 2 partials ⚠️
...ck/api/command/admin/vm/UnmanageVMInstanceCmd.java	0.00%	13 Missing ⚠️
...a/com/cloud/agent/api/UnmanageInstanceCommand.java	50.00%	12 Missing ⚠️
...n/java/com/cloud/vm/VirtualMachineManagerImpl.java	88.37%	5 Missing and 5 partials ⚠️
...stack/api/response/UnmanageVMInstanceResponse.java	0.00%	6 Missing ⚠️
.../src/main/java/com/cloud/vm/UserVmManagerImpl.java	58.33%	5 Missing ⚠️
.../apache/cloudstack/vm/UnmanagedVMsManagerImpl.java	61.53%	0 Missing and 5 partials ⚠️
...va/com/cloud/agent/api/UnmanageInstanceAnswer.java	66.66%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #11541      +/-   ##
============================================
+ Coverage     17.42%   17.53%   +0.10%     
- Complexity    15336    15461     +125     
============================================
  Files          5892     5897       +5     
  Lines        526521   527054     +533     
  Branches      64293    64359      +66     
============================================
+ Hits          91767    92430     +663     
+ Misses       424401   424231     -170     
- Partials      10353    10393      +40

Flag	Coverage Δ
uitests	3.61% <ø> (ø)
unittests	18.59% <55.50%> (+0.11%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 14798

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✖️ el8 ✖️ el9 ✖️ debian ✖️ suse15. SL-JID 14812

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 14813

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@sudo87 Looks interesting use-case but I'm bit concerned about making stopped VMs persistent.
Current approach of preparing and saving domain definition seems logical but we may have to make sure there are no differences in the definition when compared to a Running VM.
Will need a good amount of testing

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 14848

@sudo87 , will this be symetric? (haven’t reviewed fully yet, forgive me) I mean will a persisted domain be removed on managing the VM?

@sudo87 , will this be symetric? (haven’t reviewed fully yet, forgive me) I mean will a persisted domain be removed on managing the VM?

CS always manages transient VMs, so yes. Once Instance is managed again with CS, domain looses Persistent property.

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15172

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15215

@blueorangutan package

@sudo87 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✖️ debian ✔️ suse15. SL-JID 15221

@blueorangutan test

@sudo87 a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[SF] Trillian test result (tid-14478)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 54275 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11541-t14478-kvm-ol8.zip
Smoke tests completed. 148 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

Tested
LGTM

CS creates transient KVM domain.xml. When instance is unmanaged from CS, explicit dump of domain has to be taken to manage is outside of CS. With this PR domainXML gets backed up and becomes persistent for further management of Instance. Stopped instance also can be unmanaged, last host for instance is considered for defining domain hostid param is supported in unmanageVirtualMachine API for KVM hypervisor and for stopped Instances hostid field in response of unmanageVirtualMachine, representing host used for unmanage operation Disable unmanaging instance with config drive, can unmanage from API using forced=true param for KVM

persist kvm domain when unmanaged from CS

88333b3

boring-cyborg Bot added component:api component:compute component:kvm component:orchestration labels Sep 1, 2025

fetch domainxml from vm

b8901a1

Merge branch 'main' into persistentKVM

097583f

cleanup code

c9bfec1

sudo87 changed the title persist kvm domain when unmanaged from CS Persist kvm domain when unmanaged from CS Sep 2, 2025

sudo87 changed the title Persist kvm domain when unmanaged from CS Make kvm domain persistent when unmanaged from CS Sep 2, 2025

rescontruct vmspec to unmanage Stopped VM

be93681

shwstppr reviewed Sep 4, 2025

View reviewed changes

shwstppr requested review from weizhouapache and yadvr September 4, 2025 12:05

weizhouapache reviewed Sep 4, 2025

View reviewed changes

Comment thread ...ypervisors/kvm/src/main/java/com/cloud/hypervisor/kvm/resource/LibvirtComputingResource.java Resolved

Comment thread engine/orchestration/src/main/java/com/cloud/vm/VirtualMachineManagerImpl.java Resolved

weizhouapache added this to the 4.22.0 milestone Sep 4, 2025

DaanHoogland added the status:needs-testing label Sep 19, 2025

github-actions Bot added the status:has-conflicts label Sep 25, 2025

sudo87 added 2 commits September 25, 2025 20:53

fix unmanage stopped instance in vmware

d5e4259

merge main changes

9604964

boring-cyborg Bot added the component:UI label Sep 25, 2025

github-actions Bot removed the status:has-conflicts label Sep 25, 2025

Use forced true to unmanage instance with config drive

c5d6b2f

sudo87 closed this Sep 29, 2025

sudo87 reopened this Sep 29, 2025

include import unmanaged instance fix from apache#11753

4e36aa1

rajujith approved these changes Oct 7, 2025

View reviewed changes

harikrishna-patnala merged commit 9bcd988 into apache:main Oct 7, 2025

harikrishna-patnala deleted the persistentKVM branch October 7, 2025 05:02

DaanHoogland removed the status:needs-testing label Jan 28, 2026

Make kvm domain persistent when unmanaged from CS by sudo87 · Pull Request #11541 · apache/cloudstack · GitHub

Repository navigation

Make kvm domain persistent when unmanaged from CS - #11541

Make kvm domain persistent when unmanaged from CS#11541harikrishna-patnala merged 20 commits intoapache:mainapache/cloudstack:mainfrom shapeblue:persistentKVMshapeblue/cloudstack:persistentKVMCopy head branch name to clipboard

Conversation

sudo87 commented Sep 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Types of changes

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Bug Severity

Screenshots (if appropriate):

How Has This Been Tested?

For Running Instance:

For Stopped Instance:

How did you try to break this feature and the system with this change?

Uh oh!

sudo87 commented Sep 1, 2025

Uh oh!

codecov Bot commented Sep 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

sudo87 commented Sep 1, 2025

Uh oh!

blueorangutan commented Sep 1, 2025

Uh oh!

blueorangutan commented Sep 1, 2025

Uh oh!

sudo87 commented Sep 2, 2025

Uh oh!

blueorangutan commented Sep 2, 2025

Uh oh!

blueorangutan commented Sep 2, 2025

Uh oh!

sudo87 commented Sep 2, 2025

Uh oh!

blueorangutan commented Sep 2, 2025

Uh oh!

blueorangutan commented Sep 2, 2025

Uh oh!

sudo87 commented Sep 4, 2025

Uh oh!

blueorangutan commented Sep 4, 2025

Uh oh!

shwstppr left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

blueorangutan commented Sep 4, 2025

Uh oh!

DaanHoogland commented Sep 19, 2025

Uh oh!

sudo87 commented Sep 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Sep 25, 2025

Uh oh!

sudo87 commented Sep 25, 2025

Uh oh!

blueorangutan commented Sep 25, 2025

Uh oh!

blueorangutan commented Sep 25, 2025

Uh oh!

sudo87 commented Sep 29, 2025

Uh oh!

blueorangutan commented Sep 29, 2025

Uh oh!

blueorangutan commented Sep 29, 2025

Uh oh!

sudo87 commented Sep 29, 2025

Uh oh!

blueorangutan commented Sep 29, 2025

Uh oh!

Make kvm domain persistent when unmanaged from CS#11541
harikrishna-patnala merged 20 commits into
apache:mainfrom
shapeblue:persistentKVM

sudo87 commented Sep 1, 2025 •
edited
Loading

codecov Bot commented Sep 1, 2025 •
edited
Loading

sudo87 commented Sep 22, 2025 •
edited
Loading