Data Issues:: Metadata

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW
Refs
• ANZLIC Homepage
Data Issues: Metadata http://www.anzlic.org.au/
• Geoscience Australia Homepage
http://www.ga.gov.au/
• ANZLIC Metadata Guidelines & ISO 19115 Standards
available at WebCT
S1.2005 GEOS9016 ©E.G.Masters July 2001 S1.2005 GEOS9016 ©E.G.Masters July 2001
Last modified by Samsung Lim 2005 Last modified by Samsung Lim 2005
Spatial Systems Spatial System Issues
• Acquire, • Where do I find data for my project?

• Manage, Databases
• How do I access data?
GIS System
• Analyse, pole type age lifetime $
10 50
road type surface age lifetime
bitumen 5 10 • How do I get the data into my system?

• Display, • How good is the data for my project?
• Assist Decision Making
• Is the Decision Correct?
Issues Metadata
• Sources of Error? • Metadata are data about the content, quality, condition and other
• Can error be eliminated or minimised? characteristics of data
• Magnitude of Errors? • Fundamental for
• How to document error? – Spatial Data Infrastructure (SDI)
• Data directories
• Clearinghouses
1
Purpose of Metadata Reasons for metadata use
• Information on data availability • Responsible Management

• Manage Assets – Avoid misuse of data
• Enough details to decide if data is useful – Reduce search times for data
• Enable users to process and interpret – Reduce unnecessary questions about data
• Contact Details for further enquiries – Reduce time spent determining suitability of undocumented
data
– Planned Management of data that is a Corporate Asset
Australian and New Zealand Land Information What Impacts Metadata Standard?
Council
• Federal Geographic Data Committee (FGDC)
• ANZLIC Sponsoring Metadata Standards – Content Standard for Digital Geospatial Metadata (US)
– find out whether data exists – US Spatial Data Infrastructure
– avoid recollection • Australian Spatial Data Infrastructure ANZLIC Policy
– facilitate access – Free Access to Metadata
– discourage proliferation of directories – National Spatial Data Infrastructure
– framework for aggregation
Other Drivers What’s around?
• ISO 19115, Geographic information – Metadata – Changes every day

– Feb 2001 – ANZLIC maintains a directory of directories
• The standard provides information about the • http://www.anzlic.org.au
identification, extent, quality, spatial and temporal – Check Mapping Agencies and Land Information
schema, spatial reference and distribution of digital Coordination Agencies
geographic data.
• It is applicable to the cataloguing of datasets, dataset
series and individual geographic features and feature
properties
2
APPROACH CORE ITEMS
• Define Core Metadata Items – Name

• Specification of allowable answers – Codename
• Data Dictionary – Custodian
• Framework for Layers of Metadata – Abstract
• Resolution of associated Issues...Data Quality? – Keyword on Contents
– General Area
– Geographic Coverage
CORE ITEMS Core items
– Spatial Description • Dataset, Custodian and Description

– Map reference – categories provide essential information about the content of
the data, the agency responsible for its collection and
– Form maintenance, and the geographic area it covers.
– Products • Data Currency and Dataset Status
– Currency – establish the time frame of the data
– Quality • Access category
– Procedure to order – provide potential users of datasets with sufficient
– Contact information to determine if the data is in a suitable format or
able to be transformed for their purpose.
Core items Core items
• Data Quality • Contact Information

– to determine the usefulness of a dataset for a particular – provides address details for the contact person in the contact
application. organisation that is responsible for delivery of the dataset to
• lineage, other users.
• positional accuracy, • Metadata Date establishes the currency of the directory entry.
• attribute accuracy,
• Logical consistency • Additional Metadata provides additional information that
• completeness supports documentation of the dataset.
– (Dealt with later in more detail)
3
In Software
• Metadata is expected
• ArcGIS (Arc/Info8)
– Metadata in ArcCatalog
• ESRI
• FGDC (Federal Geographic Data Committee)
– Needed to perform Analysis and Data Conversion
• ArcView does not have metadata but third party extensions are
available as freeware
ArcGIS metadata ArcGIS metadata
• Properties and documentation • FGDC standards (www.fgdc.gov/metadata)

– Identification
• Properties updated automatically – Data Quality
– Created as Shapefile is imported
– Spatial Data Organization
– Updated when Metadata opens, after an edit
– Spatial Reference
• Documentation added by user – Entity and Attribute
– A metadata edit tool is included – Distribution
– Metadata Reference
– Citation Information
– Time Period Information
– Contact Information
4
Used for Catalogs DATA QUALITY
• Australian Spatial Data Directory

• An essential or distinguishing characteristic necessary for spatial
data to be fit-for-use
• Subset of Metadata
–ASDD http://www.environment.gov.au/net/asdd/
PURPOSE REASONS
• Quality Documentation was common in Hardcopy era (printed maps)

– Title Boxes
• Suitability for intended use
– Scale Bars
• How to process and use – Map Accuracy Standards
– Lineage
– Suitability for purpose
• Information not normally transferred in proprietary GIS formats
Spatial Data Transfer Standard / FGDC Lineage

• data source
• Lineage • description of processes and transformations
• Positional Accuracy – standards
• plotting
• Attribute Accuracy
• accuracy
• Logical Consistency
• scales
• Completeness
– acquisition technique
– map projection
– datum
– purpose/function
5
Positional Accuracy Attribute accuracy
• closeness of data to its true position

• closeness of attributes to true values
• 4 methods – deductive estimate based on knowledge of data
– deduction – test of independent samples
– based on internal measurements within the data – tests based on overlays
– comparison to source documents
– comparison to independent source of higher accuracy
Logical Consistency Completeness

• selection criteria
• internal graphical consistency of data
– What features have been collected
• topology of
• mapping rules
– points
• definitions
– arcs
– polygons • currency
– nodes
– features
OTHER ISSUES Error Determination

• How to deal with volatile data? • Identify Error sources
• Varying Levels of Documentation • Quantify errors
– Complex...Detailed..feature level • Track lineage of spatial processes
– Simple...General...textual • Propagate errors through processes
• Visualise errors
Problem: Software cannot do all this
6
Design
the
Problem: Software cannot do all this Database
Processes Input Graphical

Data
Coordinate
Transformation Input Textual Data
& Projection
Metadata Catalogue
99
Data Refinement
Data Validation
Polygonisation
Topology
Formation
How to link Error

Error Feature Identifier
Implementation
Feature Identifier
together? Modelling
Visualization Feature
Identification
Link Graphics to
Attributes
Analysis
Error Propagation Display
Processes Data Acquisition Accuracy

• Prepare Source Document Acquisition Vector Raster Resolution Accuracy Cost
• Place on digitising tablet Method
3 2
• Digitise registration points Manual
Digitising
0.1mm 0.5mm at
map scale
Moderate
• Calculate transformation Scanning 3 3 0.1mm 0.5mm at Moderate

• Digitise Map (transform) map scale
Remote Sensing 2 3 1m-1km metres low

• Map Projection
Photogrammetry 3 3 microns at microns at Moderate
• Manual Edit image scale image scale
• Topological Clean Field Survey 3 2 cm cm-metres high
Electronic
• Add identifiers/labels Theodolite
• Enter Attribute Data Field Survey 3 2 10cm 10cm- high

Range finder metres
• Link Graphics to Text
GPS 3 2 1cm 1cm-metres high
• Analysis/Query
COGO 3 2 cm cm-metres Moderate
• Presentation -High
• Make Decision Digital Transfer 3 3 na na na
Source Document Registration
• Distortion • Transformation Calculation

• Plotting Accuracy (Map Standards?) – World Coordinate Accuracy (Datum)
• Completeness – Location of Registration Points
– current • (spread, not collinear, outside region)
• Classification Error – Accuracy of Digitising registration points
• Generalisation • Pointing accuracy, digitiser accuracy
• Symbolism – Accuracy of Plotting of Registration Points
• Map accuracy standard
7
GIS Conversion Processes Representation Errors

• GIS: straight line segments vs parametric
• Digitising
• line thickness
– Pointing Error
• appropriate data models
– Source Document Errors
– many feature have indistinct boundaries
– Transformation
• (soils, forest)
– Equipment • Appropriate Data Structure
– The problem of Scale – raster: natural resources?
– vector: cadastral, facilities
– Map Projection – layers vs objects
– 3D data
– Representation Errors
– Generalisation problems
Edit/topological clean Identifiers
• Unique
Spatial accuracy and topological accuracy
• Complete
• snap, dangle tolerances
• Correct
Attribute data
Link graphics to text
• Database design (keys)
• Correspondence with graphics identifiers • matching identifiers pole type age lifetime $
10 50
• Complete
road type surface age lifetime
bitumen 5 10
lot_no address owner value
1234 Marine Smith 10000
8
Analysis/query Display
• Propagation of errors • Visualisation of errors
– buffer • Media
– overlay – Screen
– network – Paper
– Electronic publishing
– conversions and transformations
Lecturer : Samsung Lim UNSW
Decision Making
• Interpretation of Results
• Improper use of data
• Risk?
–$
– Social / cultural
– Environment
S1.2005 GEOS9016 ©E.G.Masters July 2001

Last modified by Samsung Lim 2005

Data Issues:: Metadata

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Data Issues:: Metadata

Uploaded by

Copyright:

Available Formats

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Spatial Systems Spatial System Issues

• Acquire, • Where do I find data for my project?

• Analyse, pole type age lifetime $

bitumen 5 10 • How do I get the data into my system?

• Is the Decision Correct?

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Purpose of Metadata Reasons for metadata use

• Information on data availability • Responsible Management

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Other Drivers What’s around?

• ISO 19115, Geographic information – Metadata – Changes every day

APPROACH CORE ITEMS

• Define Core Metadata Items – Name

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

CORE ITEMS Core items

– Spatial Description • Dataset, Custodian and Description

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Core items Core items

• Data Quality • Contact Information

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

ArcGIS metadata ArcGIS metadata

• Properties and documentation • FGDC standards (www.fgdc.gov/metadata)

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Used for Catalogs DATA QUALITY

• Australian Spatial Data Directory

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

• Quality Documentation was common in Hardcopy era (printed maps)

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Spatial Data Transfer Standard / FGDC Lineage

Positional Accuracy Attribute accuracy

• closeness of data to its true position

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Logical Consistency Completeness

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

OTHER ISSUES Error Determination

Problem: Software cannot do all this

Problem: Software cannot do all this Database

Processes Input Graphical

How to link Error

Error Propagation Display

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Processes Data Acquisition Accuracy

• Calculate transformation Scanning 3 3 0.1mm 0.5mm at Moderate

Remote Sensing 2 3 1m-1km metres low

• Enter Attribute Data Field Survey 3 2 10cm 10cm- high

• Make Decision Digital Transfer 3 3 na na na

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Source Document Registration

• Distortion • Transformation Calculation

GIS Conversion Processes Representation Errors

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

Edit/topological clean Identifiers

Lecturer : Samsung Lim UNSW Lecturer : Samsung Lim UNSW

lot_no address owner value

1234 Marine Smith 10000

Lecturer : Samsung Lim UNSW

S1.2005 GEOS9016 ©E.G.Masters July 2001

You might also like