《HPE 3PAR数据消重解决方案.pptx》由会员分享，可在线阅读，更多相关《HPE 3PAR数据消重解决方案.pptx（56页珍藏版）》请在金锄头文库上搜索。
1、HPE3PAR数据消重解决方案 AdaptiveDataReduction HPE3PARAdaptiveDataReduction TheHPE3PARStoreServdatareductionstory Whenusedtogether theAdaptiveDataReductiontechnologieswilloperateinthisorderWewillgothroughtheminthisorderasthisisthecorrectwaytopositionthemtocustomers DeduplicationPreventstoringduplicatedata Co
2、mpressionReducedatafootprint DataPackingPackodd sizeddatatogether ZeroDetectRemovezerosinline 1 2 3 4 Deduplication 3 HPE3PARStoreServdeduplication Advancedinline in memorydeduplication Hostwritesdatatothearrayheldincachepagestoincreasewriteperformance Duplicatesareremoved onlyuniquedataisflushedtot
3、heSSDsreducingwrites The3PARASIC pairedwithExpressIndexlookuptablesprovideshighperformance low latencyinlinededuplication The3PARASIC CPUcheckstoseeifthepagesareduplicatesofexistingpages Deduplookuptable Potentialduplicatesareconfirmedwithabit for bitcheck AcceleratedbytheASICandExpressIndexing 3PAR
4、Thindeduplication 000 1101 WriteCache HostWriteWriteAcknowledgetohostASICcomputeshashASICperformsfastmetadatalookupwithExpressIndexingMatch No WritenewhostdatatothebackendYes ReaddatafromcacheorbackendandXORwithnewhostwritedatatopreventanyhashcollisionIfXORresult 0 justupdatemetadataIfXORresult 0 wr
5、itenewhostdatatobackend 1 2 3 4 000 1101 5a 000 1101 5b Translationtable Translationtable TranslationofVolumeLBAtoLDstorageforTDVVs DDCVol2addressspace LBA2 Sharedstorage HashasLBA DDSSharedaddressspace DDCVol1addressspace LBA1 Translationtable SamedatahassameCRCsomapstosameunderlyingstorage TDVV1 L
6、BA1 TDVV2 LBA2 DDC DDC DDS HPE3PARdeduplication ImplementationinHPE3PAROS3 2 x TDVV1 2 Dedup enabledTPVV Privatespace oneperdedup enabledTPVV Sharedspace oneperCPG Newincomingwriteshaveahashcalculated Ifthehashhasn tbeenseenbefore thedataisstoredinthesharedspace DDS TheDDScangrowsignificantly Ifacal
7、culatedhashmatchesanexistingone thearrayusestheASICtodetectifthenewdatamatchestheexistingdata XOR Ifitdoes nonewdataiswritten Ifthedatadoesnotmatch itisahashcollision wherethehashisthesamebutthedataisdifferent ThisdataisstoredintheVV sprivatespace Whendatainthesharedspaceisnolongerreferencedbyanyded
8、up enabledVV thespaceisfreedfromthesharedspaceandisavailablefornewdata Smallprivatespaceonlycontainscollisiondata Largesharedspacecontainsmostdata includingalargeamountofuniquedata DedupMetadataFormats TDVV1OnlyonGen4basedplatforms 7000and10000 Uses32bitCRC32hashMetadatadoesnotstoreDDSVVoffset Hash
9、ContainsReadfromDDSwilldoLDlayerI OtoDDSSDLDDefragoftheDDSisnotpossibleTDVV2OnlyonGen5basedplatforms 8000and20000 duetolargercontrolcacherequirementUses32bitsof256bitSHA 2hashMetadatacontainsapointertotheDDSVVoffset 32bitsofhash AreadfromtheDDSwillinvolveaVVlayerI OrequesttotheDDSPermitsdefragontheD
10、DSasdefragrelateddatamovementwillbetransparenttotheTDVV HPEPrivate InternalUseOnly Duplicatedata Deduplicationintherealworld Asmallamountofdataisveryheavilyduplicated 9 Duplicatedata 11 1 Uniquedata Duplicatedata 880GB 720GB 80GB 720GB 80GB 80GB 720GB 800GB 2 1 80GBx11 880GB 720GB 1 6TB rehydrated 8
11、80GB 720GB 1 6TB 1 1 Compression optimizeddeduplicationapproach Newcompression friendlyimplementation TDVV3 Allwriteswithnewhashesarewrittentotheprivatespacefirst notsharedspace Allhashesaretracked Whendataisseenforthesecondtime thedataismovedfromtheprivatespacetosharedspace BothVVsreferencethatdata
12、 asdofutureduplicatewrites Themajorityofdatabycapacitywillbeheldinprivatespacesince oncededuplicated duplicatedataaccountsforonlyasmallamountofconsumedcapacity Sharedspaceisusedmoreefficiently meaningasmalleramountofsharedspacecanofferincreaseddeduplicationscalabilitywhilereducedmetadataimprovesperf
13、omance Privatespace oneperdedup enabledTPVV Dedup enabledTPVV Sharedspace oneperCPG Smallsharedspacecontainsonlyduplicatedata Largeprivatespacesholdmajorityofdata TDVV3metadatastructure 11 L1 L2 L3 L2 L3 SDspace DDSTable SDspace DDC DedupClient PrivateSpace oneperVV DDS DedupStore SharedSpace oneper
14、CPG L1 L2 L3 VV1 VV2 Duplicatematch Deduplicationhashuse reducingback endreads Takingadvantageofthelargerhash 12 16Kcachepage 09745aed7c6fa8ab74120620efd8b8ab241d81a3f4d56278b0ed0926f3f8f4ef f3f8f4ef f4d56278b0ed0926 32 bitsUsedforDDSentryindex 64 bitsStoredinDDSforcollisiondetection DDSTable f3f8f4
15、eef4d56278b0ed0926 Ifthehashdoesn tmatch wehaveahashcollisionandwedon tneedabackendreadIfthehashmatches thenweperformareadandanXORtoverify DedupMetadataFormats TDVV3 OnallGen4andGen5basedplatformsUses96bitsofhashForGen4systemsthehashismadeupoftheCRC32oftheentire16KiBCMPplustheCRC32ofthefirst8KiBofth
16、eCMPandtheCRC32ofthesecond8KiBoftheCMPForGen5systemsthehashuses96bitsofthe256bitSHA 2ofthe16KiBCMPWhenaDDSiscreated themetadataispre allocatedfortheDDS 64GiBfora64TiBDDSTheL1pagetablefortheDDSisusedtolocatethestartoftheDDSmetadataspaceTheDDSmetadataisstaticallyallocatedsonoL2pagetablesareneededtomanageitTheTDVVmetadataforadedupedpagecontainsapointertotheDDSVVoffset 32bitsofhash PermitsdefragontheDDSasdefragrelateddatamovementwillbetransparenttotheTDVVEachentryincludesanextra64bitsofhashsignature
