Ey SAPNote 2913410 - SAP HANA on VMware vSphere with Persistent Memory Component: HAN-DB (SAP HANA Database), Version: 8, Released On: 05.04.2022 | Symptom ‘You want to use persistent memory in virtualized SAP HANA environments on VMware vSphere. | Other Terms ESXi, vSphere, VMware, PMEM, Intel Optane DC persistent memory, DCPMM | Reason and Prerequisites Only server platforms which are SAP HANA supported and certified and listed on VMware Compatibility Guide with “Persistent Memory” feature can get used. The CPU and memory prerequisites of vSphere must be fulfilled as a prerequisite. For details refer to ‘https://launchpad supportsap.com/#/notes/2393917, SAP HANA on VMware vSphere 6.7 and 7.0 in produetion. General questions and boundary conditions about SAP HANA and persistent memory are addressed in SAP Note 2700084 and VMware KB 78004. | Solution Support is granted! for SAP HANA 2 SPS 4 (or later) on vSphere version ESXi 6.7 (min, ESXi 6.7 EP14 or later versions) and ESXi 7.0 (min. ESXi 7.0 Pot or later versions, incl. U1) for Intel Cascade Lake 2 and 4 socket servers (Intel glueless architecture only). The maximum DRAM plus DCPMM host memory configurations can be up to 15 TB (up to 16 TB without PMEM) and must follow the hardware vendors PMEM configuration guidelines ‘The maximum VM size with vSphere 6.7 and vSphere 7.0 is limited to 256 vCPUs and 6 TB of memory. This results in SAP HANA VM sizes of 6 TB maximum for OLTP and 3 TB VM sizes for OLAP workloads (Class L.). vSphere 7.0 supports OLAP workloads up to 6 TB (Class M). Supported DRAM:PMEM ratios are 2:1, 1:1, 1:2, and 1:4. Please refer to SAP note 2700084 for further details, use cases, and assistance in determining whether PMEM is applicable at all for your specific SAP HANA workload. Supported PMEM Module sizes are 128, 256 and 512 GB. Supported maximal host memory DRAM-PMEM configurations are listed below. Up to two SAP HANA VMs are supported per CPU socket. Ratio[DRAM:DCPMM] DRAM [TB] DCPMM{TB] Total Host Memory [TB] DRAM Module Size [GB] |DCPMM Module Size [' 1 6 9 256 128 1 1 6 6 2 256 256 1 1 3 3 6 128 128 1 3 6 ° 128 256 1 2 15 3 45 64 128 1 4 3 32 45 128 512 1 4 35 6 18 64 256 1 4 078 3 3.75 32 128 ‘VMware vMotion and VMware DRS are supported vSphere features with SAP HANA PMEM VMs.‘VMware implemented VMware HA support for PMEM enabled VM in vSphere 7.0 U2 and it is now possible to protect SAP HANA vSphere 7.0 U2 or later VMs with VMware HA. Nevertheless, PMEM HA does not allow an automated restart "out-of-the-box" of SAP HANA when PMEM gets used. PMEM is configured as a local storage (DAX) device inside the OS and the DAX device configuration needs to get restored prior SAP HANA can get started. This involves OS commands, which VMware HA has no control over. In this blog, VMware describes a solution and possible work-arounds, e. g. via manual configuration or seripting. SAP does not provide any support or consultancy regarding this blog, In addition, VMware PMEM HA was not validated by SAP. However, vSphere can be configured to restart SAP HANA PMEM VMs automatically on the same host in case of a VM failure. To configure this, please enable vSphere HA on the cluster and enable VM monitoring. For SAP HANA DRAM only ‘VMs vSphere HA can get used without limitations. References: + ESXi build numbers: ups://kh.vmware.com/s/article/2143832 + VMware “Persistent Memory” supported servers: VMware Compatibility Guide + VMware KB 78094, NVDIMM configuration parameters + SAP HANA best practices parameter list + VMware KB 2145179, using CPU affinities + Configuration Guide: Intel® OptaneTM DC Persistent Memory and SAP HANA® Platform Configuration «+ SAP note 2700084 - FAQ; SAP HANA Persistent Memory + SAP Note 2303017- SAP HANA on VMware vSphere 6.7 in production, + SAP Note 2937606 SAP HANA on VMware vSphere 7.0 in production SAP HANA Administration Guide for SAP HANA Platform - PMEM | Attributes Key Value Other Components 1HC-OP-LNX-ESX (Linux on VinWare ESX)