Scribd Logo
Upload

Welcome to Scribd!

  • Potential Data Loss After MOB Compaction in HBase Snapshots

    Uploaded by

    psaikrish
    6 views1 page
    Taking snapshots of HBase tables with Medium Object Blob (MOB) data enabled could cause data loss after a MOB compaction in CDH and BDA releases from 5.3.0 to 5.10.0. A race condition meant the snapshot manifest may not capture all new MOB data files, so they could be deleted after compaction. Applying the fix for HBASE-16841 prevents this issue.

    Original Description:

    Document

    Original Title

    Document Display2

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Taking snapshots of HBase tables with Medium Object Blob (MOB) data enabled could cause data loss after a MOB compaction in CDH and BDA releases from 5.3.0 to 5.10.0. A race condition meant the snapshot manifest may not capture all new MOB data files, so they could be deleted after compaction. Applying the fix for HBASE-16841 prevents this issue.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    6 views1 page

    Potential Data Loss After MOB Compaction in HBase Snapshots

    Uploaded by

    psaikrish
    Taking snapshots of HBase tables with Medium Object Blob (MOB) data enabled could cause data loss after a MOB compaction in CDH and BDA releases from 5.3.0 to 5.10.0. A race condition meant the snapshot manifest may not capture all new MOB data files, so they could be deleted after compaction. Applying the fix for HBASE-16841 prevents this issue.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 1

    5/17/2017 DocumentDisplay

    Sai(Available) (0) ContactUs Help


    PowerViewisOn ProductLine:OracleEBusinessSuite,Ora...

    Dashboard Knowledge ServiceRequests Patches&Updates



    Dashboard>
    GiveFeedback...
    DocumentDisplay
    Alerts

    MediumObjectBlob(MOB)DataLossofaSnapshotAfterMOBCompactionTechnicalServiceBulletin2017214 ToBottom
    (TSB)(DocID2265106.1)

    InthisDocument Wasthisdocumenthelpful?

    Description Yes
    No
    Occurrence

    Symptoms
    DocumentDetails
    ImpactStatement
    Recommendation
    Type:
    Workaround Status: ALERT
    LastMajor PUBLISHED
    Solution
    Update: 15May2017
    History Last 15May2017
    Update:

    APPLIESTO:
    RelatedProducts

    BigDataApplianceIntegratedSoftwareVersion4.1.0andlater
    Linuxx8664 InformationCenters

    DESCRIPTION
    DocumentReferences

    WhentakingasnapshotofaMediumObjectBlobs(MOBs)enabledtable,araceconditioncancausedatatobelostaftera
    MOBcompactionoperationcompletes. RecentlyViewed

    Normally,atablesnapshotflusheseachregioninthetableandbuildsasnapshotmanifestwithmetadatapointingtoallthe
    contentsofthesnapshot.Thesesnapshotmanifestsarelaterusedtodeterminewhichdatafilescanbesafelyremovedafter
    acompactionprocess.Whentakingasnapshoteachregion'sflushcanhappeninparallelsinceeachregionisindependentof
    alltheotherregions.

    WhentheMOBfeatureisenabled,thereisaseparatespecialMOBregionthatstorestheMOBitems.Priortoapplyingthe
    referencedpatchforHBASE16841,theMOBregionwastreatedasifitwasalsoindependentoftheotherregions.Thiswas
    notthecasewhenregionswereflushedinaMOBenabledtable,newMOBdatamayhavebeenwrittenintothespecial
    MOBregion.BecausenewMOBdatafilesmayhavebeenwrittenoutaftertheMOBregion'scontentswereaddedtothe
    manifest,someoftheMOBdatamaynothavebeenrecordedinthesnapshotmanifest.

    SnapshotsonMOBenabledtableswerenotsusceptibletodatalossuntilafteraMOBcompactionisrun.However,aftera
    MOBcompactionwasrun,theMOBdatafilesthatwerenotcapturedbythesnapshotmanifestmaynolongerhavehad
    referencesandwerethuseligiblefordeletionandsusceptibletodataloss.

    ThisissueisfixedbyHBASE16841.

    OCCURRENCE

    Productsaffected:HBase.

    Releasesaffected:

    CDH5.3.0,5.3.1,5.3.2,5.3.3,5.3.4,5.3.5,5.3.7,5.3.8,5.3.9,5.3.10
    CDH5.4.0,5.4.1,5.4.2,5.4.3,5.4.4,5.4.5,5.4.7,5.4.8,5.4.9,5.4.10,5.4.11
    CDH5.5.0,5.5.1,5.5.2,5.5.4,5.5.5,5.5.6
    CDH5.6.0,5.6.1
    CDH5.7.0,5.7.1,5.7.2,5.7.3,5.7.4,5.7.5
    CDH5.8.0,5.8.1,5.8.2,5.8.3
    CDH5.9.0,5.9.1
    CDH5.10.0

    Usersaffected:OnlyHBaseuserswhoenableMOBandtakesnapshots.Snapshotsonregulartablesarenotaffected.

    Note:BDAV4.1supportsCDH5.3.0/5.3.3,BDAV4.2supportsCDH5.4.0/5.4.4,BDAV4.3supportsBDACDH5.4.7,V4.4
    supportsCDH5.5.1/5.5.2,BDAV4.5supportsCDH5.7.0/5.7.1/5.7.4,BDAV4.6supportsCDH5.8.0/5.8.2/5.8.3,andBDA4.7

    LegalNoticesandTermsofUse Priv acy Statement


    Copy right(c)2017,Oracle.A llrightsreserv ed.

    https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrlstate=fz13y7ke0_9&_afrLoop=398852568104807 1/1

    You might also like