Scribd Logo
Upload

Welcome to Scribd!

  • 1678720740489

    Uploaded by

    nassim
    7 views20 pages

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    7 views20 pages

    1678720740489

    Uploaded by

    nassim

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    of 20
    DATA CLEANING auth) Data cleaning is very important, because it Re eM LB ol me Col CoM S ) Reliable © Accurate ty) Consistent Eos auth) Data can be "dirty" in many different ways We look at the 5 most eo CTRL le (a eRe es lla a ©) data and how to handle them ORM Ute M Cel ce) local bookstore and their order as an example _-, YOU CAN FIND A SPECIAL . 7 Qy ese ees im) EXT DATA AT THE END Eos OT DUPLICATES dM need mee Lt observation In this case, an order was ) captured twice 6) itu 2022-10-03 034-1235634 Ce EOC Preece) 034-1235634 Erica Example CREEP Pe) ttl APES Fou U 2023-09-08 Aree teee) ST eeETY Teen EN POC Pareto eee) Peta Etre Eos OT DUPLICATES You can simply remove this ITs) cet Mey OR Check back, if these were «) actually two separate ©) purchases rood order_date | phone_numer | order_sum Crm eOC To PLS Pasa) 034-1235634 Erica Example 61 CURE Ee Led crae cheer CSC cna PER Peer} pT Rey LOT CRC cae uth ofJanuary, | 601-3459370 712, u5€ ee SIZE os Oa INCONSISTENT DATA Data isn't following a standardized format or pattern In this case, order dates and «) total amounts are written in different formats rocisy order_date | phone_numer | order_sum CO NaC CCC PP pase} 034-1235634 cir COM PT Pees TE) Cen ee Ler) co Erica Example rae Ch PPELS Pou 2623-09-66 TUES] cP Uris a 601-3459370 ZU os Oa INCONSISTENT DATA Mieolticeeu meee ic MeS Rate ais follows a consistent format or pattern t<, BE ESPECIALLY CAUTIOUS wITH @ DIFFERENT DATE & CURRENCY oe FORMATS (EG. EUROPEAN VS. US) ©) eae samt | phone_numer | order_sum Test CCM 2022-10-03 034-1235634 55€ CiemCe ur Ppp es ony 634-1235634 = Sete cU ley Dit aP ELS Pere PIPER} 463-9784733 aPC 601-3459370 IEE os Ha EVE Data is incorrect, impossible or straight illogical based on the context of the data TR Rohr Leica aloheol alk «) be made in the future or its ©) amount be negative NaC Cy 2022-10-03 CED SCELeny Eira CNEL) Piers) 034-1235634 = isstomrcU ay 07.03.2022 rae ChCP ELS Former Ue eee Cee EEE) creed COLT LN aera ee Eomererey() rey i izes. Ha EVE You can simply remove this invalid rows OR Check back if this was a typo «) or a refund and also ask if a ©) Pat twe hla nM yg customer Omen TLS a be OU Rudy Random 2022-10-03 034-1235634 it Cae Ply Pesce ey} Ens PELL Er) cs Erica Example A Eee) Darel IEE oes Na UTR Data deviates significantly from the rest of the data TO eR

    You might also like