You are on page 1of 24

Metadata Management

Case Study
Date: 10/21/2008

Dan McCreary
President
M
Dan McCreary & Associates
D dan@danmccreary.com
Metadata Solutions
(952) 931-9198
Overview
• The Challenge
• Why XRX is an Ideal Solution
• Screen Images
• Results

D 2
Copyright 2008 Dan McCreary & Associates
Gartner on Metadata
Metadata cast into formal logics will drive
interoperability, automation, cost cutting,
better search capabilities and new business
opportunities.
Semantic Web Drives Data Management, Automation and Knowledge and Discovery
Alexander Linder
March 2005
G00125145

D 3
Copyright 2008 Dan McCreary & Associates
The Challenge
• Allow the business people (not the IT
department or developers) to manage all
aspects of metadata
– Definitions
– Approval
– ISO/IEC Metadata Registry
– Shopping Cart
– Wantlist Management
– Automatic Form Generation
M

D 4
Copyright 2008 Dan McCreary & Associates
Semantic Triangle
A pattern of neural activity in our brain

Concept

Refers To
Symbolizes

Referent Symbol

Stands For
“cat” “gato” (Spanish)
“katze” (German)

M
Physical Objects
Ogden, C. K., & Richards, I. A. (1923) The Meaning of Meaning

D 5
Copyright 2008 Dan McCreary & Associates
Semantic Web Standards Stack
Source: Tim Berners-Lee www.w3c.org
Trusted
TrustedSemantic
SemanticWeb
Web

Proof
Proof

Logic
Logic

Encryption
Signature
Rules/Query

Encryption
Signature
Rules/Query

Ontology
Ontology(OWL)
(OWL)

RDF
RDFModel
Model&&Syntax
Syntax

XML
XMLQuery
Query XML
XMLSchema
Schema

XML
XML Namespaces
Namespaces

URI/IRI
URI/IRI Unicode
Unicode
M
http://www.w3.org/Consortium/Offices/Presentations/SemanticWeb/34.html
D 6
Copyright 2008 Dan McCreary & Associates
Example of K-12 Registry

D 7
Copyright 2008 Dan McCreary & Associates
A (meta) Data Registry
Goal: create semantic maps to a federal & state
metadata standard, not many standards

NIEM
RN R2 RN R2

R7 R3 R7 NIEM R3

R4 R6 R4
R6
R5 R5
Mapping from Minnesota's metadata Mapping from Minnesota's
registry to N other metadata registries: metadata registry to counties & federal
M The O(N2) problem The O(N) problem

D 8
Copyright 2008 Dan McCreary & Associates
UML

XML
Evolving Metadata Standards
XML
ISO/IEC 11179 MDR Non-ISO schemas
Doc
ISO commercial
schemas Public Schemas

Federal XML
XLink
Developer’s ebXML
Guide (xml.gov)

GJXDM xBRL

UBL MOF
Federal XML Federal Data
NIEM Naming and Reference Model
Design Rules (DRM) XMI

Future CWM
Minnesota Standards (?)
Dept Stds. Data
Standards OASIS Standards

Division Stds
M
ISO standards dominate most metadata registries
D 9
Copyright 2008 Dan McCreary & Associates
Minnesota Enterprise Technical Architecture

M
• Follow established Minnesota metadata standards
D 10
Copyright 2008 Dan McCreary & Associates
Build an Inventory of Data Elements
Sample Data Element

D 11
Copyright 2008 Dan McCreary & Associates
Examples of Federal Meta Data Registries

• NIEM – National Information Exchange Model


• GJXDM – Global Justice XML Data Model
• ebXML – Extensible Business XML
• UBL – Universal Business Language
• EPA – Environmental Protection Agency
• DOD – Department of Defense Metadata Registry
• xBRL – XML Business Reporting Language

D 12
Copyright 2008 Dan McCreary & Associates
Examples of Local Metadata Registries

• Minnesota Department of Education


Registry
• Minnesota Department of Revenue Property
Taxation Registry
• Financial Institution

D 13
Copyright 2008 Dan McCreary & Associates
Property Taxation Example

D 14
Copyright 2008 Dan McCreary & Associates
Example: NIEM.gov

Fill your shopping cart


with Data elements

Easily create sub-


M schemas for different
D needs 15
Copyright 2008 Dan McCreary & Associates
Registry helps track data source mapping
Table
Column
Column
Metadata Column
Registry A

OLTP
Table RDBMS
Column
Column
Column
Data Warehouse

• Registry data elements can map to one or more data sources.


Concepts usually map to tables and properties map to
columns.
• Mappings can be used to facilitate transfers
• Mapping can be stored directly in the registry
Local • Tools are frequently used to create initial mappings
Registry
• Organizations can create mappings between their internal
or database
systems and a central metadata registry
M

D 16
Copyright 2008 Dan McCreary & Associates
Requirements & data needs
Metadata Registry Workflow Funnel

Glossary Draft Data Review


Approve
Of Terms Elements & Edit

The registry defines the


Create the Registry data we exchange and
• Define your glossary and data elements keeps our need for code
• Review & make changes changes to a minimum
• Approve & publish by stakeholders
Use the Registry
• Generate data schemas (XML) by selecting and organizing data elements
• Add new items to the registry as needs change
Federated Search
• Federation: When many different sources
can return search results from a single search

Search

Business
Terms
RDMS
Columns
WebSite
Terms Other
Data Standards
ACORD
Elements
M

D 18
Copyright 2008 Dan McCreary & Associates
Federated Search Results

D 19
Copyright 2008 Dan McCreary & Associates
Metadata Shopper

D 20
Copyright 2008 Dan McCreary & Associates
Why XRX?
• Metadata is complex
• Many nested structures
• Metadata needs to be quickly customized to
meet the needs of different stakeholders
• Data governance is a collaborative process

D 21
Copyright 2008 Dan McCreary & Associates
Before XRX
• Staffing/Skills
– XML Schemas
– XSLT to transform data elements into HTML
– DBAs to create RDBMS tables and indexes
– One or more Java Developers
– HTML Forms and Reports
– CSS
– Reporting tools (Crystal Reports etc)
– Limited form functionality (no AJAX)
• Six people, 9 months $250,000 to $500,000
M

D 22
Copyright 2008 Dan McCreary & Associates
After XRX
• Skills
– XForms, REST and XQuery
• Steps
– Import data definitions from spreadsheets and XML
sources
– Create data element registry
– Create shopping cart tools with XForms
– Generate XML sub-schemas for importing into
document exchanges
– Higher quality user experience (suggest items)
• One Person Three Months: $40,000
M

D 23
Copyright 2008 Dan McCreary & Associates
Thank You!

Please contact me for more information:


• Metadata Management
• Metadata Registries
• Service Oriented Architectures
• Business Intelligence and Data Warehouse
• Semantic Web
• Native XML Databases
Dan McCreary, President
Dan McCreary & Associates
Metadata Strategy Development
dan@danmccreary.com
(952) 931-9198
M

D 24
Copyright 2008 Dan McCreary & Associates

You might also like