You are on page 1of 46

Esri UK Annual Conference 2016

Architecting the ArcGIS Platform


Best Practices
Dominic Stubbins
@DomStubbins

Design, Test,
Operate

Data
Management

Web GIS
Architecture

Deployment
Options

Patterns of
GIS

Availability
Scalability
Load Balancing

Application
Patterns

Security and
Identity

Web GIS | Transformation of the ArcGIS Platform

Desktop

Apps

Web Maps
Web Scenes

Server GIS

Layers

Web GIS | How is it Different from Server GIS?


Server GIS

Web GIS

Silod use of GIS services within custom applications

Pervasive use of web layers, scenes, and maps


within all of the ArcGIS apps

Users

App

Apps

n+1
Services

Web Maps
Web Scenes
Web Layers

portal

Services

Data
Data

Web GIS Shifts the Focus


Apps

Distributed Services

Client / Server

Web Services & App

Stand Alone Desktop

Connected Desktop

Data Models

Web Maps

Static Data

Real-Time

Custom Applications

Configurable Templates and Apps

All Purpose Applications

Focused Apps

Proprietary Data

Open Data & Shared Services

Platforms offer a common, extensible foundation

Managing your workforce

Foundation of technology and practice

Support a portfolio of solutions and


enable growth.

Revolutionary and evolutionary

Solution Solution Solution Solution


Plank
Plank
Plank
Plank
1
2
3

ArcGIS

Solution Planks deliver significant


business value by tailoring the platform
to specific business needs

Platform
(80%)
Common technical foundation
Common implementation patterns
Common operational skills
Common administration skills

SDKs / APIs

APPS

Constituent
Engagement

Field
Mobility

Decision Support

Location Data
Management

Analytics

Essential Patterns of a Location Strategy

Users Groups Items Tags


(Content and Capabilities)

Web Layers

Tools

Files

Data and Storage

Data
Management
SDKs / APIs

I N F R A S TR U C TU R E

SDKs / APIs

P O R TA L

LOAD BALANCING

Analysis

Visualization

HIGH AVAILABILITY

PUBLICATION
STRATEGY

PRODUCTION

STAGING

Enterprise
Systems

SDKs / APIs

Web Maps

E XTE R N A L S YS TE MS A N D S E R V I C E S

ArcGIS Conceptual
Reference Architecture

Solutions
Location
Enablement

Salesforce.com
Microsoft Dynamics
SAP HANA
IBM Cognos
MicroStrategy

Microsoft
Office
Excel
PowerPoint

Other

Social
Weather
Traffic
IoT Sensors

WORKLOAD
SEPARATION

DEVELOPMENT

A S S O C I A TE D B E S T P R A C TI C E S
IT Governance Project Prioritization
Workforce Development Security

https://www.esri.com/~/media/Files/Pdfs/products/arcgis-platform/architecting-the-arcgis-platform

Essential Patterns of GIS


Location
Enablement

Constituent
Engagement

Decision
Support

Field
Mobility

Analytics

Location Data
Management

Discover, use, make,


and share maps at
work anywhere,
anytime

Facilitate and
manage
communication with
stakeholders

Inform execs and


management with
maps and location
intelligence

Get authoritative
information into and
out of the field

Describe, predict, and


improve business
performance

Collect and organize


location data about
your assets and
resources

System of Engagement
(Demand)

System of Record
(Supply)

Essential Patterns of a Location Strategy: The Solution Portfolio


Location
Enablement

Constituent
Engagement

Portal for
ArcGIS

Decision
Support

Analytics

Location Data
Management

Operations
Dashboard

Ad Hoc
Analysis
(Desktop)

GIS Data
Stewardship
& Workflow

Collaborative
Markup

Structured
Analysis
(Service)

Shared GIS
Web Services

Real-time
Analytics
(Service)

Real-Time
Feed Config

ArcGIS
Online

Public
Information
Map

Customer
Care

ArcGIS
Open Data

Feedback
Map

Workforce
(Dispatch)

Field
Mobility

Workforce
(Collector &
Navigator)

ETL, Services
Integration

Server GIS

Web GIS
Portal

ArcGIS Server

Enterprise GDB

Portal for ArcGIS

ArcGIS
Server

GIS Services

Data Store
ArcGIS
Enterprise
Data Store
GDB(s)

Web GIS | Anatomy


Desktop

2. Portal

Web

Device

1. Users & Apps

portal

3. GIS Server
Server

Online Content
and Services

4. Basemaps & Utility Services

Web GIS | Portal


ArcGIS for Server

Software
-

ArcGIS Online

Portal for ArcGIS as part of


ArcGIS for Server

www.arcgis.com

Releases 3-4 times per year

Releases 1-2 times per year

Upgraded automatically (by Esri)

Upgraded manually (by organization)

Esri controls SLA

Organization controls SLA

Core Web GIS functionality

Enterprise Integration
-

Web SSO via SAML

Web-tier Authentication via Web


Adaptor

Core Web GIS functionality (visualization,


smart mapping, analysis)

(visualization, smart mapping, analysis)

SaaS

Enterprise Integration
-

Web SSO via SAML

Content and services


-

Basemaps

Enterprise Groups

Living Atlas

ArcGIS Server Integration

GeoEnrichment, Routing,

Advanced GIS functionality

Web GIS | Anatomy of the Portal


Desktop

Web

Device

The portal in ArcGIS Online just is:


hosted by Esri and no need for installation
or maintenance nor breaking apart into
the backend components..

For a deployment using Portal for ArcGIS there are


three main components that make up a Web GIS:

portal

Portal for ArcGIS

Hosting server
(ArcGIS Server)
Server

Online Content
and Services

ArcGIS Data Store

Web GIS | Anatomy of the Portal


System of Engagement

System of Record

On-premises Web GIS


components

Server GIS infrastructure

Portal for ArcGIS

Server
Connects to Data

Hosting server

by reference

(ArcGIS Server)

Enterprise
geodatabase

ArcGIS Data Store

Supports hosted data as well


Supports publishing of authoritative data
as the app and collaboration infrastructure;
from enterprise geodatabases;
does not replace Server GIS infrastructure can be used in conjunction with a Web GIS

Web GIS Deployment |

ArcGIS Online
Portal + Content + Services

Glossary of icons

ArcGIS Online
Content + Services
(no use of the portal)

Customer owned Web GIS infrastructure


ArcGIS for Server: Portal for ArcGIS,
Hosting server, ArcGIS Data Store

Boundary between Esri


owned infrastructure and
customer owned
infrastructure

Customer owned GIS server


(ArcGIS Server)

Web GIS Deployment |


Online

Options, for hybrid deployments


Server

ArcGIS Online

Customer managed
infrastructure
On-premises
Private Cloud
Public Cloud
(AWS, Azure, etc.)

Web GIS Deployment |

Options, for hybrid deployments

Online
Online Web GIS

Distributed Web GIS


Online portal + own Portal
w/own Server

Hybrid Web GIS


Online Web GIS w/own Server

Web GIS Deployment |


Distributed Web GIS
Online portal + own Portal
w/own Server

Options, for on-premises deployments

On-Premises Web GIS

Server

Own Portal w/Online content


and own Server

On-Premises Web GIS


(disconnected from open Internet)

Server GIS

Agility

Scalability

Manageability

Security

Cost

Integration

Accessibility

Data
Sovereignty

Scalability| Everything On One Machine

Wow, this is easy!

Scalability| Silos, Sites & Clusters

Site

Silo
LB

Clusters

LB

LB
Cluster A

Site

Site
Configuration Stores

Cluster B

Configuration Store

Configuration Store

(shared)

(shared)

Scalability| Workload Separation can evolve

LB

LB

LB

LB

ArcGIS Server

ArcGIS Server

ArcGIS Server

ArcGIS Server

Visualization &
Imagery

Visualization

Analysis &
Data Management

Imagery

Initial Deployment

Complete GIS

High Availability | Server & Portal Patterns

Server
w/ Single Web Adaptor

Portal w/ 3rd Party LB

Server
w/ 3rd Party LB

Server w/ Multiple
Web Adaptors & 3rd Party LB

Portal w/ Multiple
Web Adaptors & 3rd Party LB

Disaster Recovery |

Backup & Restore Pattern

Global DNS

NLB

NLB

Portal for ArcGIS

ArcGIS Server

NLB

NLB

Portal for ArcGIS

ArcGIS Server

Identity
Store

Identity
Store

Hot Backups
Content Store

Configuration Store
Directories

Primary Data Center

Content Store

Configuration Store
Directories

Secondary Data Center

Geodata Management |

The Geodatabase

The ArcGIS

information model
Encapsulates data & functionality
Three types:
- File

Networks

Surveys
Addresses

Vectors

27 Main St.

Annotation

- Personal
- Enterprise

ABC

(ArcSDE)

Managed ArcGIS

Data Store

3D Objects
Attributes

- Relational
- 3D
- Spatial

107

Topology

Temporal

Dimensions
CAD
Drawings

Terrain
Images

Geodata Management |

Organizational Deployment Patterns

Centralized Database
IT
Utilities
ArcSDE

Geodatabase

export / import
RDBMS export / import
RDBMS replication
ETL Tools (e.g. FME, Informatica)
Geodatabase replication

Centralized Data Warehouse


ArcGIS Server
Terminal Servers

Utilities

ArcSDE

IT

Parks
Assessor

Parks

WAN
Assessor
ArcGIS Desktops,
Terminals and Browsers

WAN
ArcGIS Desktops

Centralized Database

Data Warehouse

Enterprise GIS Operations


Centralized Data Administration

Departmental GIS Operations


Centralized Data Sharing

Geodata Management |
Mobile
Publication
Distributed

Sites
Hierarchical

Geodatabase Replication Scenarios

Publication Strategies |

The Web GIS Information Model

Organization

Group

Application

Item

Web Scene

User

Web Map

Web Layer
Service
Dataset

Publication Strategies | The Role of Portal & Web Layers

Portal

GeoServices

Geodata

Wells

Wells

Active Wells

Proposed Wells

Wells by Status

Publication Strategies |

Publishing Methods

By Reference

Server

ArcMap

By Value

portal
Connects to Data

Copies Data

by reference

by value

Enterprise GDB

ArcMap
ArcGIS Pro
Maps for Office
Portal Website

Gedatabases
Spreadsheets
Shapefiles

Security |

Terminology

Active Directory

Built-in Users

SSO
NTLM

FedRAMP & FISMA

Privileges

Portal-tier Authentication

Security |

Online Authentication Patterns

Online

SAML IDP

Online

User Store

Portal-tier Auth
Built-in Users

SAML Auth
Enterprise Users

Security |

Portal & Server Authentication Patterns


SAML IDP

Portal

Web Adaptor

Portal

User Store

User Store

User Store

Portal-tier Auth
Built-in Users

Portal

SAML Auth
Enterprise Users

Web-tier Auth
Enterprise Users

Portal-tier Auth
Enterprise Users

Web Adaptor

Server

User Store

Server

User Store

Server

Server-tier Auth
Built-in Users

Portal

Server-tier Auth
Enterprise Users

Web-tier Auth
Enterprise Users

Security |

Federating Portal & Server


App

1. Login

2. Login (again)

ArcGIS Server

Portal for ArcGIS

User Store
(Active Directory, LDAP)

Security |

Federating Portal & Server


App

1. Login

Portal for ArcGIS

2. Single Sign On (SSO)

federation

User Store
(Active Directory, LDAP)

ArcGIS Server

Portal manages users, groups & roles

Every service has an item in Portal

Server inherits from Portal

Using the Platform |

Apps

Explorer

Collector

Story Maps

Maps for Office


Templates
Dashboard

Web Scene Viewer

Open Data
Crowdsourcing

GeoPlanner

Using the Platform |

Templates

App Development Patterns

Builders

APIs

Applications| User in Mind


Story Maps

Portal

Think about your users

Explorer
Dashboard

Collector

Office

deliver the app(s) they need


Focused Apps
(Configured and/or Customized)

Applications| Good Design

Applications| Configure First

Develop
APIs, SDKs

Customise

Configure
COTS
Use Apps and
workflow

Apps, Tools,
workflow, maps

App frameworks,
widgets, tools,
templates

Thick Client

Thin Client

Portal

Thick

Desktop
Virtualization

Thin

Thin

Connectivity Models

Thick

Thick Connection

Desktop GIS Deployment |

Web GIS Client

Operations |

System Management

System Monitoring
Operations

Planning

System Design
Deployment

Development

System Testing

Requirements

Design

Operations |

Design, Test, Monitoring

Network

Hardware

Web Server

ArcGIS Server

Geodatabase

RDBMS

Esri UK Annual Conference 2016

Architecting the ArcGIS Platform


Best Practices
Dominic Stubbins
@DomStubbins