METADATA MANAGEMENT

Reporter:
Padpad, Justin Jay
Pastolero, John Lloyd
Passion, Jayvee
 Establish the processes,
standards, and infrastructure
for specification of well
organized, comprehensive and
accessible information about
the data assets under
management.
An organization that develops its
patient demographic metadata
will realize a number of direct and
indirect benefits, as metadata
reduces data risks and is
essential for:
• Improving data quality through common
understanding and agreement about
names, definitions, values, ranges, and
formats;
• Improving the accuracy of patient record
matching and identifying duplicates;
• Tracing the origin of data and assessing
impacts across the lifecycle;
• Building an accessible knowledge base for
stakeholders across the organization;
• Determining when to archive a record; and
Mapping data from multiple sources for
integration and sharing.
 METADATA IS USUALLY
CLASSIFIED IN THREE PRIMARY
CATEGORIES
BUSINESS METADATA
Descriptive information employed to
understand, locate, search, and control
content. It can include elements such as
terms and definitions (i.e., the Business
Glossary), values, authors, keywords, and
publishers.
OPERATIONAL METADATA
Descriptive administrative information
that assists in managing a data asset.
It includes information such as who
created or updated a record, when it
was created or updated (i.e., data
provenance); information needed for
archival or integration, and access
rights and entitlement restrictions
(e.g., privacy codes).
TECHNICAL METADATA
Descriptive information about data
stored in physical databases, as well
as its transformations through
automated processes. For example,
the content (e.g., tables and columns)
and location (e.g., server) of data
stores and interfaces, changes to data
sources.
BUSINESS DATA DEFINITION
Is information that is used to plan and
operate an organization. This includes
source data that a business collects and
data that has been processed such as
calculated metrics and forecast Business
data can be stored in database that are
machine readable or represented as
inforation intended for human consumption
such as a user interface, document or report.
The following are common types of business
data.
• Leads & Opportunities – List of Potential customer.
• Customer – Customer details such as name and address.
• Transactions – Records of commercial transactions such
as customer purchase.
• Interactions – Records of interactions with customer and
other stakeholders such as investors, employees and the
media. For example, records of visits to your websites.
• Social Media - Data regarding your target market or
reputations that is collected from social media sources.
• Product – A product catalog that captures the
specifications of your products.
• Employee – Employee data such as skill inventories,
salary and performance management data.
• Knowledge – information created by employee and
partners that is stored as documents and media.
• Communications – Communications such as business
emails and records of customer inquires.
• Process – Information that pertains to business process
such as manufacturing products, fulfilling orders and
supporting customers.
• Supply chain - Supply chain data such as tracking your
inventory in storage and transport.
• Partner – Partner informations such as data that is use
to monitor the performance of suppliers.
• Risk – Data that is used to identify, analyze and manage
risk such as a database of historical constructions
projects that is used to estimate contruction project
risk.
• Market – Market data such as information about price
offered by competitors.
• Industry – Idustry data such as market size and market
share data for product category.
IMPORTANCE OF BUSINESS DATA
• Data helps you understand and
improve business processes so you can
reduce wasted money and time.
Every company feels the effects of waste.
It depletes resources, squanders time, and
ultimately impacts the bottom line. For
example, bad advertising decisions can be
one of the greatest wastes of resources in
a company.
BUSINESS RULES &
ALGORITHMS
WHAT IS BUSINESS RULES?
 Business rules have been defined as both "directive(s)
intended to influence or guide business behavior" and
"constraints on a business”.
According the Business Rules Group……
 I/S Perspective: A statement that defines or constrains
some aspect of the business. It is intended to assert
business structure, or to control or influence the
behavior of the business.
 Business Perspective: A directive, intended to influence
or guide business behavior, in support of business policy
that has been formulated in response to an opportunity,
threat, strength, or weakness.
BUSINESS RULES MAY BE ANY OF
THE FOLLOWING:
 Definitions of business terms
 Data integrity constraints
 Mathematical and functional derivations
 Logical inferences
 Processing sequences
 Relationships among facts about the
business
Implementing business rules as metadata is the most rigorous
and, at the same time, most flexible approach to business rule
implementation.
This is in contrast to other implementation approaches.

 Process-driven approaches can be rigorous, but they are by

no means flexible. In any process-centric approach,
implementing the business rules is fairly straightforward,
but, because they are typically implemented in code,
changing them can be difficult and labor intensive.
 ‰Procedure-driven approaches, characterized by manuals
and checklists, are certainly flexible, but they are not
rigorous. Procedures can be changed very easily. However,
procedures are only as rigorous as their users choose them
to be. People can and will ignore procedures.
 ADVANTAGES OF MANAGING
BUSINESS RULES AS METADATA
• Allows maximum flexibility
• Reduces system maintenance
• Simplifies system design, development and
implementation
• Rules can change without affecting implementation
• Ensures that systems fully support business needs
• MIS personnel don't need to learn the intricacies of
the business
BUSINESS RULE TECHNIQUES AND
BEST PRACTICES
 Documenting and implementing business
rules as metadata is fairly simple.
However, any approach, no matter how
excellent or useful, can still be performed
poorly. This is particularly true when the
approach seems to be simple. To ensure
that business rules are captured correctly
and implemented effectively, requires
using a few techniques and best practices.
 THERE ARE THREE BASIC
CHARACTERISTICS OF GOOD BUSINESS
RULES:
• Explicit expression - Any statement of business
rules needs an explicit expression, either
graphically or as a formal (logic-based) language.
• Declarative nature - A business rule is declarative,
not procedural. It describes a desirable, possible
state that is either required or prohibited.
• Coherent representation - A single, coherent model
for all the kinds of business rules is desirable.
ALGORITHM
• A log-structured merge-tree (LSM
tree) is a data structure typically
used when dealing with write-heavy
workloads. 
DATA LINEAGE AND IMPACT
ANALYSIS
WHAT IS DATA LINEAGE?
Data lineage uncovers the life cycle of data
it aims to show the complete data flow, from
start to finish. Data lineage is the process of
understanding, recording, and visualizing
data as it flows from data sources to
consumption. This includes all
transformations the data underwent along
the way how the data was transformed, what
changed, and why.
 WHAT IS THE PURPOSE OF DATA
LINEAGE?
• Data lineage helps users make sure their data is
coming from a trusted source, has been
transformed correctly, and loaded to the specified
location. Data lineage plays an important role when
strategic decisions rely on accurate information.
• Data lineage shows the full context of your data
including the source of the data, how data sets are
built and aggregated the quality of data sets, and
any transformations along the data journey. This
helps ensure that accurate, complete and
trustworthy data is being used to drive business
decisions.
 WHY IS DATA LINEAGE
IMPORTANT?
• Just knowing the source of a particular data set is
not always enough to understand its importance,
perform error resolution, understand process
changes, and perform system migrations and
updates.
• Knowing who made the change, how it was
updated, and the process used, improves data
quality. It allows data custodians to ensure the
integrity and confidentiality of data is protected
throughout its lifecycle.
 THE BEST OPEN-SOURCE DATA
LINEAGE TOOLS
• Apatar
• CloverETL
• Dremio
WHAT IS IMPACT ANALYSIS?
• impact analysis is a detailed study of
business activities, dependencies, and
infrastructure. It reveals how critical
products and services are delivered and
examines the potential impact of a
disruptive event over time.
ACCORDING TO ARNOLD AND BOHNER, THERE
ARE THREE MAIN TYPES OF IMPACT ANALYSIS:
• Traceability Impact Analysis - Traceability impact analysis
captures the links between requirements, specifications,
design elements, and tests, analyzing their relationships to
determine the scope of an initiating change. Manually
determining what will be affected by a change can be
extremely time-consuming in complex projects, which is
where requirements management software comes in (more
about it later in this article).
• Dependency Impact Analysis - This type of impact analysis
is used to determine the depth of the impact on the system.
• Experiential Impact Analysis - Taking into account the prior
experience of experts in the organization, experiential
impact analysis studies what happened in similar situations
in the past to determine what may happen in the future.
 HOW TO CONDUCT AN IMPACT
ANALYSIS?
• 1. Prepare
• 2. Collect Information
• 3. Evaluate the Collected Information