INTRODUCTION TO ENTERPRISE DATA MANAGEMENT

Lesson 1: Data Governance

After reading this lesson, you will enable to:
 Understand the meaning of data governance and applying in it the data

Time frame: 5 hours

INTRODUCTION:
This lesson will introduce the definition of data governance and why does it matter. It
explains the benefits and goals of applying data governance in a data. As well as the
one that are responsible of data governance.

ACTIVITY:
Diagram Analysis: Analyze the diagram and answer the analysis question below.

DATA GOVERNANCE

Assets Policies
Management

DATA GOVERNANCE

ANALYSIS

1. Based on the diagram above, what is your understanding about the word
Data Governance?
 ABSTRACTION:

DATA GOVERNANCE
Data governance is a collection of processes, roles, policies, standards, and
metrics that ensure the effective and efficient use of information in enabling an
organization to achieve its goals. It establishes the processes and responsibilities that
ensure the quality and security of the data used across a business or organization. Data
governance defines who can take what action, upon what data, in what situations, using
what methods.

Data management encompasses three different areas.

 People: If you want to accurately and reliably manage your data, you are going
to need to find the right team first. This team will be responsible for managing important
aspects of your company's data, so you need to clearly define their roles and what is
expected from them.
 Processes: You need to outline a process for how your data will be controlled,
audited, and monitored. This will ensure that your data is accurate and useful in any
scenario.
 Technology: Technology is not the answer in itself, but it does help. It allows
your team to find the resources they need, streamlines your processes, and empowers
your company to make accurate, confident business decisions. Data management
technology will include things like verification and monitoring tools.

WHY DATA GOVERNANCE MATTERS

Without effective data governance, data inconsistencies in different systems
across an organization might not get resolved. For example, customer names may be
listed differently in sales, logistics and customer service systems. That could complicate
data integration efforts and create data integrity issues that affect the accuracy of
business intelligence (BI), enterprise reporting and analytics applications. In addition,
data errors might not be identified and fixed, further affecting BI and analytics accuracy.
Poor data governance can also hamper regulatory compliance initiatives, which
could cause problems for companies that need to comply with new data privacy and
protection laws, such as the European Union's GDPR and the California Consumer
Privacy Act (CCPA). An enterprise data governance program typically results in the
development of common data definitions and standard data formats that are applied in
all business systems, boosting data consistency for both business and compliance
uses.
BENEFITS OF DATA GOVERNANCE
An effective data governance strategy provides many benefits to an organization,
including:
1. A common understanding of data
2. Improved quality of data
 3. Data map
4. A 360-degree view of each customer and other business entities
5. Consistent compliance
6. Improved data management
WHO'S RESPONSIBLE FOR DATA GOVERNANCE?
In most organizations, various people are involved in the data governance
process. That includes business executives, data management professionals and IT
staffers, as well as end users who are familiar with relevant data domains in an
organization's systems. These are the key participants and their primary governance
responsibilities.
Chief data officer
The chief data officer (CDO), if there is one, often is the senior executive who
oversees a data governance program and has high-level responsibility for its success or
failure. The CDO's role includes securing approval, funding and staffing for the program,
playing a lead role in setting it up, monitoring its progress and acting as an advocate for
it internally. If an organization doesn't have a CDO, another C-suite executive usually
will serve as an executive sponsor and handle the same functions.
Data governance manager and team
In some cases, the CDO or an equivalent executive -- a director of enterprise
data management, for example -- may also be the hands-on data governance program
manager. In others, organizations appoint a data governance manager or lead
specifically to run the program. Either way, the program manager typically heads a data
governance team that works on the program full time. Sometimes more formally known
as the data governance office, it coordinates the process, leads meetings and training
sessions, tracks metrics, manages internal communications and carries out other
management tasks.
Data governance committee
The governance team usually doesn't make policy or standards decisions,
though. That's the responsibility of the data governance committee or council, which is
primarily made up of business executives and other data owners. The committee
approves the foundational data governance policy and associated policies and rules on
things like data access and usage, plus the procedures for implementing them. It also
resolves disputes, such as disagreements between different business units over data
definitions and formats.
Data stewards
The responsibilities of data stewards include overseeing data sets to keep them
in order. They're also in charge of ensuring that the policies and rules approved by the
data governance committee are implemented and that end users comply with them.
Workers with knowledge of particular data assets and domains are generally appointed
to handle the data stewardship role. That's a full-time job in some companies and a
part-time position in others; there can also be a mix of IT and business data stewards.

DATA GOVERNANCE IMPLEMENTATION

The initial step in implementing a data governance framework involves identifying
the owners or custodians of the different data assets across an enterprise and getting
them or designated surrogates involved in the governance program. The CDO,
executive sponsor or dedicated data governance manager then takes the lead in
creating the program's structure, working to staff the data governance team, identify
data stewards and formalize the governance committee.
Once the structure is finalized, the real work begins. The data governance
policies and data standards must be developed, along with rules that define how data
can be used by authorized personnel. Moreover, a set of controls and audit procedures
are needed to ensure ongoing compliance with internal policies and external regulations
and guarantee that data is used in a consistent way across applications. The
governance team should also document where data comes from, where it's stored and
how it's protected from mishaps and security attacks.
Data governance initiatives usually also include the following elements.

 Data mapping and classification

 Business glossary
 Data catalog
KEY DATA GOVERNANCE PILLARS
Data governance programs are underpinned by several other facets of the overall data
management process. Most notably, that includes the following:
1. Data stewardship. An essential responsibility of the data steward is to be
accountable for a portion of an organization's data, with job duties in areas such
as data quality, security and usage. Teams of data stewards typically are formed
to help guide and execute the implementation of data governance policies. Often,
they're data-savvy business users who are subject matter experts in their
domains, although data steward can also be an IT position. Data stewards
collaborate with data quality analysts, database administrators and other data
management professionals, while also working with business units to identify
data requirements and issues.
2. Data quality. Data quality improvement is one of the biggest driving forces
behind data governance activities. Data accuracy, completeness and consistency
across systems are crucial hallmarks of successful governance initiatives. Data
cleansing, also known as data scrubbing, is a common data quality element. It
fixes data errors and inconsistencies and also correlates and removes duplicate
 instances of the same data elements, thus harmonizing the various ways in
which the same customer or product may be listed in systems. Data quality tools
provide those capabilities through data profiling, parsing and matching functions,
among other features.
3. Master data management. MDM is another data management discipline that's
closely associated with data governance processes. MDM initiatives establish a
master set of data on customers, products and other business entities to help
ensure that the data is consistent in different systems across an organization. As
a result, MDM naturally dovetails with data governance. Like governance
programs, though, MDM efforts can create controversy in organizations because
of differences between departments and business units on how to format master
data.
4. Data governance use cases. Effective data governance is at the heart of
managing the data used in operational systems and the BI and analytics
applications fed by data warehouses, data marts and data lakes. It's also a
particularly important component of digital transformation initiatives, and it can
aid in other corporate processes, such as risk management, business process
management, and mergers and acquisitions. As data uses continue to expand
and new technologies emerge, data governance is likely to gain even wider
application.
DATA GOVERNANCE TOOLS
In order to find the right data governance approach for your organization, look for
open source, scalable tools that can be quickly and economically integrated with the
organization’s existing environment.
Additionally, a cloud-based platform will allow you to quickly plug into robust
capabilities that are cost-efficient and easy to use. Cloud-based solutions also avoid the
overhead required for on-premises servers.
As you start comparing and selecting data governance tools, focus on selecting tools
that will help you realize the business benefits laid out in your data governance strategy.
These tools should help you:

 Capture and understand your data

 Improve the quality of your data
 Manage your data
 Control your data
 Document your data
 Empower the people that know the data best
APPLICATION:
1. What is data governance?
2. Why data governance matters?
3-6.What are the four data governance pillars?
 7-10. Enumerate the people who are responsible for data governance and
explain their roles.

Lesson 2: Data Integration and Management

After reading this lesson, you will enable to:

 Understand the process of data integration and management and its
importance
 Identify different approaches to data integration

Time frame: 5 hours

INTRODUCTION:
 This lesson will introduce the definition of data integration and management
and its importance. It explains different approaches to data integration, as well
as its processes.

ACTIVITY:
Think of an existing business, organization, or technology that relies heavily on
data (e.g. VRBO, the United Nation Statistics Division, or autonomous cars). Answer the
analysis questions below.

ANALYSIS:
1. What kind of data sources might it need to integrate?
2. Describe three data sources, their formats, and what information they provide.
3. How would data integration in this example relate to one of the nine reasons to
integrate your data covered in the lecture?
ABSTRACTION:
ENTERPRISE DATA INTEGRATION (EDI)
The broad set of technologies that help combine, or integrate, two or more data
sets. EDI typically involves merging data from disparate systems and delivering that
combined data in such a way that it can be manipulated and analyzed to support
information management activities, such as business intelligence or reporting.
Enterprise data integration can be performed in many ways. One common
method is to build a central corporate data warehouse and then funnel in information
from various points within the network or from other business operations.
DIFFERENT APPROACHES TO DATA INTEGRATION
Enterprise Service Bus (ESB)
ESB is considered to be a critical aspect of data integration. It is designed
to combine numerous applications over a ‘bus-like’ architecture. ESB helps in
distributing tasks among the connected components and acts as a middleware
located between an applications based suite and framework.

Fig. 1: Enterprise Service Bus (ESB) Process

Extract, Transform, Load (ETL)

As the name suggests, the required data is extracted, transformed, and
loaded from disparate sources and converted into a standard format so that
analyzing common data becomes much more comfortable.

Fig. 2: Extract, Transform, Load (ETL)

Data Warehousing
A data warehouse is another way of consolidating and synchronization
data. Business intelligence users prefer this approach because a data
warehouse provides them with sufficient data for further analysis.

Fig. 3: Data Warehousing

Data Consolidation
The most preferred approach to data integration is consolidation. Because
tons of data need to be retrieved, moved, and transformed, the process can get
more complicated. Data consolidation is an excellent way for companies to
simplify data access.

Fig. 4: Data
Consolidation Methods
WHAT IS THE PURPOSE OF DATA INTEGRATION?
We hope that you have got the hang of data integration with the examples and
approaches we have mentioned.
Now, we will move on to its purpose. While it is pretty clear why every business
needs data integration, here is a detailed explanation of the importance of data
integration to technical and business practices.

 Reduce data complexity

 Make data more available.
 Easy data collaboration
 Smarter business decisions
 Data integrity
MANUAL DATA INTEGRATION
That means connecting the different data sources, collecting the data, and
cleaning it, etc., without automation.
Some of the benefits are reduced cost: This technique requires little maintenance and
typically only integrates a small number of data sources.
MIDDLEWARE DATA INTEGRATION
Middleware data integration is a data integration system that involves using a
middleware application as a go-between, moving data between source systems and the
central data repository.
APPLICATION BASED INTEGRATION
Application integration is the process of enabling individual applications—each
designed for its own specific purpose—to work with one another. Application integration
helps bridge the gap between existing on-premises systems and fast-evolving cloud-
based enterprise applications.
UNIFORM ACCESS INTEGRATION
Uniform access integration focuses on developing a translation process that
makes data consistent when accessed from different sources. In this situation, however,
the data is traditionally left with the original source and only copied to the central
database.
COMMON STORAGE INTEGRATION
Common storage integration is when copies of data drawn from their original
sources are kept in a warehouse and transformed for a standardized visualization of this
data. This is the most common method of storing integrated data and is the fundamental
process driving classic data warehousing models

APPLICATION:
1. When to use Manual Data Integration?
2. When to use Middleware Data Integration?
3. When to use Application-based Integration?
4. When to use Uniform access Integration?
5. When to use Common Storage Integration?

REFERENCES:
Goby (2020). An Introduction to Enterprise Data Management.
https://www.gobyinc.com/enterprise-data-management-guide
Beckert, K. (2020). What is Data Consolidation? - Definition & Overview .
https://study.com/academy/lesson/what-is-data-consolidation-definition
Monitis (2018). Top 5 data warehouses on the market today.
https://blog.monitis.com/blog/top-5-data-warehouses-on-the-market-today/
Stedman, C., Vaughan, J. (2020). What is Data Governance and Why Do You Need It?
TechTarget.https://searchdatamanagement.techtarget.com/definition/data-
governance
Talend (2020). What is Data Governance (and Why Do You Need It)?
https://www.talend.com/resources/what-is-data-governance
UCLAitservices (2018). What is an ESB? https://www.it.ucla.edu/news/what-esb