You are on page 1of 14

HP 3PAR OS 3.2.

1 MU1
Rev. 14.41

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
Objectives

After completing this course, you should be able to discuss the following HP 3PAR technology:
• Thin deduplication

2 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
What is deduplication?

Space reduction technique


• Identifies redundant or duplicate data
• Maintains only a single copy of that data for all redundant copies
Aid for reducing price of SSDs
• Enables less storage utilization due to no redundant copies
• Extends life of SSDs by limiting writes
• Supported only on VVs stored on SSDs
Base OS suite
• No additional cost
• Announced for 7450 and 7200 all-flash starter kit
• New volume type—TDVV
• TDVV cannot be used with AO

3 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
HP 3PAR Thin Deduplication with Express Indexing

True Inline Deduplication with instant metadata lookups


1. hash signatures generated
inline by the ASIC

0001100 0001100

0001101 0001101

1111100 1111100
Gen 4 ASIC
provides only Bit-by-bit Scalable, not
HP 3PAR Express 16 KB 0001100
solution in the compare limited to max
Indexing for granularity , 3. only unique data is
industry to use offloaded to the amount of RAW
silicon-based
instant metadata
ASIC upon a match sweet-spot for 1111100 written to SSD
lookups capacity on a
hash key of signature host I/O size
system 2. bit-to-bit compare on
generation
match offloaded to ASIC

4 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
HP 3PAR Express Indexing

Fast metadata lookups


• Uses metadata tables
• Compares signatures of incoming request to stored signatures
• If signatures match, duplicate request is flagged
− Pointer is added to metadata table to existing blocks
• ASIC performs bit-to-bit comparison of data
− Before any new write is marked as duplicate
− Prevents hash collisions

Most scalable all-flash array available


• Up to 460 TB of raw capacity
• Up to 1.3 PB of usable all-flash capacity

5 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
3PAR Thin Deduplication
Accelerated by the ASIC and Express Indexing

1. Host write
0001101

2. ASIC computes hash 3. Fast metadata


lookup with Express 4. (On match) Data is compared against
Indexing the existing potential deduped page
and the ASIC used for a bit-by-bit 6. A dedupe match will result in
LBA
xxx yyy zzz compare using inline XOR operation XOR outcome being a page of
zeros, which is detected inline by
Hash L1 0001101 the ASIC
5. XOR = 0000000
Hash L2

L1 Table 0001101
Hash L3
L2 Table

L3 Table

6 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
Deduplication terminology

DDC―Deduplication client volume


• Appears as TDVV
• User-created and host-visible volume
DDS―Deduplication store
• Automatically created by system
• Additional DDCs use the same DDS
GC―Garbage collector
• Frees unreferenced pages in the DDS
CRC―Cyclic redundancy check
• CRC32 implemented by ASIC

7 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
Deduplication CLI changes

Create a TDVV Create template


• createvv • createtemplate
Show final location of data VV commands
• showblock • importvv
Show store and space saving information • tunevv
• showcpg
• showspace
• showsys
• showvv

8 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
showvv

showvv displays provisioning type

# showvv
Id Name Prov Type CopyOf BsId Rd -Detailed_State- Adm Snp Usr VSize
1 .srdata full base --- 1 RW normal 0 0 81920 81920
0 admin full base --- 0 RW normal 0 0 10240 10240
9 cpvv0 full base --- 9 RW normal 0 0 10240 10240
12 tdvv0 tdvv base --- 12 RW normal 128 0 512 10240
10 tpvv0 tpvv base --- 10 RW normal 128 0 512 10240
--------------------------------------------------------------------------
5 total 256 0 103424 122880

9 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
showvv -zone

The showvv -zone command displays usage per TDVV

# showvv –zone
-(MB)- ---Adm---- ---Snp---- ---Usr---- ------Shared-------
Id Name Prov Type VVSize Zn Free_Zn Zn Free_Zn Zn Free_Zn WrSz StSz DupRatio
1 .srdata full base 81920 0 0 0 0 0 0 0 0 0
0 admin full base 10240 0 0 0 0 0 0 0 0 0
9 cpvv0 full base 10240 0 0 0 0 0 0 0 0 0
12 tdvv0 tdvv base 10240 4 3 0 0 4 2 18239 10239 1.78
10 tpvv0 tpvv base 10240 4 4 0 0 4 4 0 0 0
---------------------------------------------------------------------------------
5 total 122880 8 7 0 0 8 6 18239 10239 1.78

WrSz: total data size written to TDVV


StSz: storage space used in the DDC and DDS
DupRatio: WrSz / StSz

10 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
showcpg
# showcpg
--------------------(MB)--------------------
----Volumes---- -Usage- --- Usr --- -- Snp --- -- Adm --- ----- Shared ------ ..
Id Name Warn% VVs TPVVs TDVVs Usr Snp Total Used Total Used Total Used Total Used DupRatio ..
0 FC_r1 - 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ..
1 FC_r5 - 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ..
2 FC_r6 - 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ..
3 NL_r1 - 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ..
4 cpg0 - 3 1 1 3 0 19968 19968 23040 0 24576 2048 8704 1219 1.78 ..
--------------------------------------------------------------------------------------------- ..
5 total 3 0 19968 19968 23040 0 24576 2048 8704 1219 1.78 ..

NOTE: DupRatio = (Total size written to all TDVVs in the CPG) / (Storage space used in DDC and DDS for all TDVVs in the CPG)

11 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
3PAR Thin Deduplication at work
root@jnodec103113:~# showvv -showsysobjs|grep -v vmfarm|grep -v fsvvthin|grep -v admin|grep -v srdata
----Rsvd(MB)----- --(MB)---
Id Name Prov Type CopyOf BsId Rd -Detailed_State- Adm Snp Usr VSize
5 .sysvv_0fscpg dds base --- 5 RW normal 33280 0 124544 67108864
3 .sysvv_0usrcpg dds base --- 3 RW normal 12800 0 16384 67108864
6 fsvv ddvv base --- 6 RW normal 1024 0 2048 2097152
8 fsvvmirror tpvv base --- 8 RW normal 768 0 1055104 2097152
---------------------------------------------------------------------------------------
9 total 49152 0 1427712 144797696

# df -h /dedup Mirror of data at the file system layer from


Filesystem
dedup
size
2.0T
used
1021G
avail capacity
979G 52%
Mounted on
/dedup
a non-deduped 3PAR volume to a 3PAR thin
deduped volume

9:1 Dedupe ratio


1,200,000
1,000,000
800,000
MiB

600,000
400,000
200,000
0
FS written 3PAR VV Written 3PAR Deduped Volume Written
12 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
System Reporter
Deduplication

Changes to two commands


• srvvspace
− New columns
• SharedPhysSpace
• SharedTotalDataSize
• Dedup_Pct
• srcpgspace
− New columns
• SharedUsed
• SharedTotal
• Dedup_Pct

13 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.
Thank you

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For training purposes only.

You might also like