TITLE

Digital Integration & Access Layer

The world changing because of digitalisation and data is the foundation for this transition. While the
future will change a lot, the fundamental concept of data providers and data consumers won’t
disappear. As we stated that every application needs its own data we need a concept of connecting
data providers and data consumers.

New developments Cloud & API connectivity Increased regulatory attention

New (open source) concepts are introduced, Software & Platform as a Service (SAAS, Strong governance and data management
such as NoSQL database types, Block chain, PAAS) offerings will push the connectivity framework need to be in place because of
new database designs, distributed models and API usage even further. stronger regulatory requirements, such as
(Hadoop), new analytical capabilities, etc. BCBS 239.

Increase of computing power Exponential growth of (outside) data Data is read much more
Massive increase of computing power driven Exponential growth of data; especially Data is read much more, increased real-time
by hardware innovation, decreased latency, external (open data, social), internal, consumption, more search, because of
zero batch, new capabilities, etc. structured and unstructured. different consumer behaviour.

Data Providers Current situation Data Consumers

• Data is delivered • Data received is

with no clear
purpose.
• Limited definitions
and schema
information
available.
• Data is off loaded
too quickly, which
makes operational
querying more
difficult.
• Data providers have
no knowledge and
control of data
consumption and
distribution.
• Data is provided with
Data Quality issues
• Many intermediaries between data providers and consumers. distributed further.
Limited availability of meta-data. Schema translation takes place
• Data that is received is
several times. Overview is lost. No data lineage. also changed. No meta
data available. The
origin is unclear.
• Separate technology is used for real-time communication
• Data consumers are
impatient. Data
• Data is changed, difficult to determine the truth of data. consumers act as data
providers resulting in
point to point
• Data Governance is not clear connections.
• Data consumers often
• Data can be integrated upfront, without being consumed. don’t set any
requirements. All data is
first consumed.
• Communication between data providers, intermediates and data
consumers. Long release cycles. Many stakeholders involved. • Data consumers don’t
know where to find the
right data.
• Data Quality is fixed not at the data providers side, but at the
• Too much data is
intermediates. Difficult to judge what the origin is. collected before it is
used.

• Not designed for the • Data providers ‘abuse’ the intermediaries to answer own
future operational querying questions.

Outdated and complex Data Warehouse & BI Architecture, Design of Golden Sources,

! Self Service and finding the data is difficult, More control is needed, Missing Agility, New
Business Models are needed (Advanced Analytics) and Cost reductions are needed.

TOPS/CADM
 TITLE
Digital Integration & Access Layer

Enterprise
Data
Model We haven’t been able to find any applications
Application Logical Data without data in the “application data layer”. Based on
Models this consumption pattern, data is typically copied
from one application to another application. The
Application Physical Data
Models architecture has to be designed based on this
pattern.
Infrastructure Layer

Digital Integration & Access Layer

(DIAL)

Data
DIAL has technical
Providers
components which will sit
between data providers and
data consumers allowing
them to exchange data.
Enterprise Service Bus, ETL,
Streaming data are examples
in this context.
DIAL also looks out for the
more functional and governance
aspects of data. DIAL will take
care of lineage, meta-data, the
documentation of data and data
delivery agreements made
between data providers and
data consumers.
Data
DIAL is about connecting the
Consumers
dots with other subjects, such
as Data Quality, Data
Development, Data Security,
Meta Data Management and
Reference & Master Data
Management.

Enterprise Service Data Consuming Production

Applications Self-Service tools,

Application
Bus Enterprise reporting, Business Users
SOAP / SOAP / Analysis, Analytics,
s& REST REST Data Stores etc.
Data
Data (SQL & NoSQL) out
Sources Streaming BI Tools
Streaming
Analytical
Analytics
Semantic / Virtual Layer

Streaming Streaming Queries Tools

Other services and

applications DIAL
Raw Data Store Existing
Data
Change Data Warehouses out
data
capture Offload & landing
ETL

zone where data is

stored in its original Batch
form without Discovery
Isolated environment
modification Research Labs for ad-hoc discovery,
Analysts &
experiments & Developers
development
Data
out
Batch
BI Tools

Analytics
Queries Tools

Data
DIAL Consuming Applications
Providers

TOPS/CADM