Migrating VMs with shared or multi-writer disks
Shared Disks Overview
467x296
Shared or multi-writer disks are used with clustering application that manage access to the shared data within the application itself. For instance, Microsoft WSFC and Oracle RAQ. When disks are set to shared or multi-writer, storage vMotion is not available while the VMs in the application cluster are powered on. Then the question arises, "How do you migrate a VM using shared or multi-writer flags"? It's similar to how I demoed migrating off RDMs to either clustered VMDK or vVols, but you're not changing the disk type.
Example of multi-writer setup:
Migrating VMs with shared disks.
It's not difficult, just requires a few extra steps and precautions. Always make sure you have a successful backup.
Detailed Process for migrating VMs with shared disks.
- The first requirement is all the VMs in the application cluster must be powered off. vSphere will not allow you to migrate a powered on VM using any form or shared disk.
- Once the VMs have been powered off, you will remove, NOT DELETE, the shared disks from all secondary nodes in the application cluster. This way when migrating the primary node, it is the only VM attached to the shared disks. You do not need to, and should not change, the shared disk option. IE Do not change the multi-writer to unshared or change SCSI bus sharing.
- With the VMs still powered off, you migrate the VMs to the new datastore, primary node first. Make sure to keep the disk format the same during the migration. Multi-writer and clustered VMDKs disks must remain eager thick.
-
- After all of the VMs have been migrated, you will re-attach the shared disks to all secondary nodes in the application cluster. Make sure to attach the disks the same way they were attached previously. IE. Same SCSI controller and channel or disk number.
- Once all shared disks are attached to all secondary nodes, you may power on the primary and secondary node in the application cluster.
Simple outline for migrating VMs with shared disks.
- Power off all VMs in application cluster.
- Removed shared disks from secondary nodes.
- Migrate VMs to new destination datastore.
- Re-attach shared disks to secondary nodes.
- Power on primary and secondary VMs in application cluster.
I have had a few requests for how to do this so it made sense to create a quick blog on the process. I've also provided several resource links for more details on multi-writer, shared disks, and application clusters.
Resources:
KB Articles:
- Enabling or disabling simultaneous write protection provided by VMFS using the multi-writer flag (1034165) (vmware.com)
- Using Oracle RAC on a vSphere 6.x vSAN Datastore (2121181) (vmware.com)
- Powering on the virtual machine fails with the error: Thin/TBZ disks cannot be opened in multiwriter mode (1033570) (vmware.com)
- Attempts to enable the multi-writer virtual disk option on an NFS datastore fail (2147691) (vmware.com)
- Microsoft Windows Server Failover Clustering (WSFC) with shared disks on VMware vSphere 7.x: Guidelines for supported configurations
- Microsoft Windows Server Failover Clustering (WSFC) with shared disks on VMware vSphere 6.x: Guidelines for supported configurations (2147661)
Blogs:
- Migrate a WSFC Cluster on RDMs to vVols | VMware
- vSphere 7 RDM to Shared VMDK Migration | VMware
- VMware vSAN Knowledge Base and Resources for Shared Virtual disks