An Insight into the Proposed NTG Address Validation Service

David McDonald
22 March 2012

Agenda
Project background & business challenge Project and technical requirements Solution architecture Key components of the proposed solution Video: Spectrums address validation capabilities The added value data quality and spatial capabilities Video: Spectrum Enterprise Designer workflow example Summary Questions?

Go into the draw to win a bottle of top notch wine for the best NT Spatial 2012 Tweet. All you have to do is include a #tonkin hashtag for your chance to win!

Project background
Tonkin Consulting and PBS are in discussions with NTLIS to supply & implement a NAMF compliant address validation application to the Northern Territory Government The provision of an address geocoding/validation solution to core NTG agencies is a key element of the Spatially Enabling NT Government initiative
included in the NTLIS business plan for 2011/12

The proposed solution will deliver increased efficiencies across all NTG agencies by providing access to a standardised address dataset

Business challenge
NTLIS maintains the authoritative source of all address data for NT Other government agencies also use address data within their own internal business systems (e.g. licensing, policing, etc.) Address data held by other agencies is not validated against the authoritative source maintained by NTLIS when these addresses are entered into their systems The NTLIS has an immediate business requirement to geocode addresses for the NTPFES
Other agencies could use this service to validate and geocode their address information

Improve data quality and spatial capabilities Meet future requirements for other NTG agencies

Project requirements
NTPFES immediate requirements to validate address information include the following:
dispatch resources to an address (geocode) & deal with poor quality input have a location but need an address (reverse geocode) able to locate intersections cleanse historical address information confirm a persons identity/address (check against NT & interstate addresses )

The address validation solution has also been scoped for the needs of other core NTG agencies for requirements such as:
ability to cleanse historical address information to allow it to be easily mapped and analysed postal address validation improve customer communication and reduce mail costs improve reporting services through providing spatial context to various datasets

Technical requirements
The address validation service has been scoped to include a key technical requirements such as:
NT data to be stored and access locally
more up-to date than G-NAF as it includes local updates (update cycles) flexibility, cost savings

Access to interstate address information via OnDemand web services

Access as needed, no maintenance, standards-based, cost per transaction Provides the ability to undertake intersection searches nationally

NAMF compliance
In its simplest definition, NAMF provides a set of standards that prescribe how an address, either postal or physical, should be structured and exchanged

Solution needs to be accessible via web services

SOAP/ REST capabilities

Solution architecture

Spectrum OnDemand

Web Service Client

Single solution consisting of a Technology Platform that will manage the flow and processing of all the address data Integrates with NTLIS existing infrastructure and will use modules from PBS Spectrum Technology Platform Implementation services and project management will provide the glue

NTLIS DMZ
Apache HTTP Server

NTLIS

Spectrum Server & Dictionary Builder

Dictionary Builder Source Data

ILIS (Oracle)

Key components of the proposed solution

Physical address validation (geocoding) engine technology provided by the Pitney Bowes Spectrum Technology Platform Physical address validation within NT utilises NTLIS own data within a custom dictionary Capability to expose all required functionality via customised web service interfaces exposed via both SOAP and REST NAMF compliant web service interface is provided for access to Spectrum via the NAMF interface specification Postal validation, geocoding of interstate addresses, geocoding of street intersections use PBS Spectrum OnDemand service
Postal address validation uses an AMAS certified engine to validate the postal address and utilises PAF (Postal Address File)

Key components of the proposed solution

Spectrum Enterprise Designer
The Enterprise Designer provides the capability to implement flow based design to process address (and other attribute) data. This allows NTLIS to:
incorporate customised business decisions in to the process of geocoding an address access internal repositories (Oracle DB etc) to perform batch processing of address (and other) data

Key components of the proposed solution

Start Extract Address data from Oracle (NTLIS - FME)

Custom Address Dictionary Deployment

A custom address dictionary builder is included with the geocoding engine NTLIS utilises FME technology to manage spatial data. As such it is proposed that the existing FME technology be utilised to extract the data from Oracle Deployment of the newly built dictionary is dependent on NTLIS server architecture. As such it is proposed that Tonkin Consulting and PBS work together with NTLIS IT administration staff to create required scripts

Build Dictionary (PBBI)

Stop Spectrum Server (NTLIS)

Backup Dictionary (NTLIS)

Copy New Dictionary (NTLIS)

Test (PBBI)

Start Spectrum (NTLIS)

Sucess

No Yes
Notify Admin (NTLIS)

Roll back (NTLIS)

Finish

Video: Spectrums address validation capabilities

The added value

Data quality and spatial capabilities

Spectrum Technology Platform

Web Applications Desktop Applications Web Service Batch Processing

Enterprise Designer Administration Security

Data Integration
CRM Oracle Siebel RDBMS Flat Files NAMF ERP SAP Salesforce SQL Multi Language Transliteration

Data Quality
Valid Address TypeAhead De-duplicate Standardize Normalize AMAS Restrict Fields Typing Errors Consolidate

Location Intelligence
Geocoding Point in Polygon Distance Calc Routing Travel Cost Find Nearest Buffer Calc. Boundary Calc. Travel Time

Enrichment
Single View Cust Lifestyle Segm, Name Analysis Spatial X,Y Social Media Statistical Data Risk Analysis Gender Calculate Costs Resolve Tel No. Patronymic An.

Governance
Confidence Repeatable SOX Profiling AML / CTF Compliance Auditable US Patriot ACT Fraud Detection Ethics

Unstructured

Formatting

XML & Structured

Missing Data Incorrect Data

Travel Matrix

Audio

Area Calc. Line Calc.

Do Not Call reg

Video

Best Practice

People
Privacy

Data Access

Sensis Experian D&B Acxiom

Packaged Apps

RDBMS

Data Warehouse

Web Services

13

Spectrum Capabilities enterprise data quality

Matching Records Incorrect addresses Non Standard formats
Name Bob Williams Robert Williams Burkes, Mike and Ilda Jason Bourne, Bourne & Cie. Address 36 Jones Avenue 36 Jones Av. 38 Jones av. 76 King st Plamerston Palmerston City Palmerston State NT Northern Territory N.T. nt Zip 0830 0830 0830 Phone 08 5555 0000 55550000 618-5322-9550 +618-5360-5480 mburkes@gmail.com 61855241329 Email bob.williams@yahoo.com

Multiple Names

Mis-fielded data

Mixed business and contact names

Typos Missing Data

Spectrum Capabilities Location Intelligence Module

Spectrum LI Module Spatial Capabilities:
Find Closest Site Find Point in Polygon Find Nearest The closest linear distance from a point The closest travel distance from a point The shortest travel time from a point Get Travel Cost Matrix Get Travel Boundary Return Holes Identify Islands Get Travel Directions Find Travel Time Get Bounding Box Is Within Boundary

Video: Spectrum Enterprise Designer

Identify duplicates workflow

Summary
An address validation solution, with an ability to undertake both physical & postal address validation, will enable the NTLIS to better service the NTPFES and other NT Government agencies.
real-time (during address entry) and batch mode services accommodated

Being standards based and utilising web services provides greater flexibility The Spectrum Technology Platform is scalable and can be extended to:
provide improvements to overall data quality further enrich existing datasets

And finally the key benefit of this project is....

Questions???

NTG Address Validation Solution

...to ultimately deliver increased efficiencies across all agencies by providing easy access to a standardised address dataset.

David McDonald
Associate, Spatial Services Manager TONKIN CONSULTING Level 2, 66 Rundle Street, Kent Town SA 5067 08 8237 3100, 08 8237 3110 David.McDonald@tonkin.com.au