Service-Oriented Architecture and Web Services

Essentials

Jake Freivald February 9, 2008

Copyright © 2001 iWay Software

1

A Lesson From Calvin and Hobbes
architecture
service-oriented

First, A Question
 What does the “S” stand for in SOA? “Service”  Who or what is being serviced in SOA? The business process owner

Copyright © 2001 iWay Software

The Concept Behind SOA
 A Lieutenant has:  A flagpole  A rope  A flag  Two shovels  Three bags of cement  A Corporal, a Lance Corporal, and a Private  He has been ordered to erect the flagpole  How should he erect it? “Corporal, erect the flagpole.”
Copyright © 2001 iWay Software

Business Questions for IT Managers
 How do we improve check processing?  What will it cost to merge order processing apps?  How long to implement the CRM application?  How do I know that this IT investment will pay off? Answering these questions requires a solid understanding of enterprise architecture

Copyright © 2001 iWay Software

The Problem With Current Architecture

 What’s this change going to cost?  What will it affect?  Will it be worth it?
Copyright © 2001 iWay Software

Service-Oriented Architecture: An Attempt to Gain Control  Align IT with business requirements  “Process check”  “Accept order”  “Change address”  Not “Connect SAP to JDE, getting additional
information through CICS transaction WNIT, then sending a message
through WMQI to the EDI processor for sending to…”

 How do we do it?  Define services  Have IT create an architecture that supports services
Copyright © 2001 iWay Software

Implication
 Web services aren’t the same thing as SOA  Can be application-oriented  Can be “tightly coupled”  Can be unarchitected  What are Web services?  How do we use them properly?

Copyright © 2001 iWay Software

What Are Web Services, and Why Use Them?

Copyright © 2001 iWay Software

Copyright © 2001 iWay Software

2

Interface Flexibility vs. Interoperability

Flexibility

Interoperability
Copyright © 2001 iWay Software

1

Interface Flexibility vs. Interoperability
text

Flexibility

HTML

Flash

Interoperability
Copyright © 2001 iWay Software

1

Interface Flexibility vs. Interoperability
Flat file + FTP

Flexibility

Web services

CORBA

Interoperability
Copyright © 2001 iWay Software

1

Our Five Web Services Terms
XML Schema Flexibility SOAP + WSDL

UDDI

Interoperability
Copyright © 2001 iWay Software

1

Topic: XML
XML Schema Flexibility SOAP + WSDL

UDDI

Interoperability
Copyright © 2001 iWay Software

1

XML
 “Self-describing”  Easy to understand and use (in theory)  Cross-platform
<book> <author>Joliet Jake Blues</author> <title>Shades of Blue</title> <publisher>Free Forest Publishing</publisher> </book>

Copyright © 2001 iWay Software

1

XML – Issues
 Too flexible. Can describe anything, but we need to know specifically what we’re going to see
<book> <author>Joliet Jake Blues</author> <title>Shades of Blue</title> <publisher>Free Forest Publishing</publisher> </book> <book> <authors> <author> <title>Joliet</title> <first>Jake</first> <last>Blues</last> </author> </authors> <title>Shades of Blue</title> <publisher>Free Forest Publishing</publisher> </book>
Copyright © 2001 iWay Software

1

Topic: XML Schema
XML Schema Flexibility SOAP + WSDL

UDDI

Interoperability
Copyright © 2001 iWay Software

1

Schema
 Sets limits for what a given XML document holds  The absolute minimum for automatic interactions
<book> <author>Joliet Jake Blues</author> <title>Shades of Blue</title> <publisher>Free Forest Publishing</publisher> </book> <book> <authors> <author> <title>Joliet</title> <first>Jake</first> <last>Blues</last> </author> </authors> <title>Shades of Blue</title> <publisher>Free Forest Publishing</publisher> </book>
Copyright © 2001 iWay Software

1

Topics: SOAP and WSDL
XML Schema Flexibility SOAP + WSDL

UDDI

Interoperability
Copyright © 2001 iWay Software

1

Example: Using SOAP and WSDL
User SOAP Request Administrator WSDL

“Can you help me gain access to SAP?”

“Sure. Here’s the WSDL file.”

SOAP Response

SAP

Copyright © 2001 iWay Software

2

Topic: UDDI
XML Schema Flexibility SOAP + WSDL

UDDI

Interoperability
Copyright © 2001 iWay Software

2

Example: Using UDDI with SOAP and WSDL
User SOAP UDDI Request UDDI Directory WSDL

SOAP Response

SAP

Copyright © 2001 iWay Software

2

SOA and Web Services

Copyright © 2001 iWay Software

Copyright © 2001 iWay Software

2 2

The Vision of Web Services in Service-Oriented Architecture
Java and .NET Apps Portals Business B2B Intelligence Interaction

Web Services: XML and HTTP

WS

WS

WS

WS

WS

WS

WS

WS

The Reality
Java and .NET Apps Business B2B Intelligence Interaction

Portals

Web Services: XML and HTTP Custom Web Service Implementation

API

API

API

API

API

API

API

API

Eliminating Code from Web Services
Java and .NET Apps Business B2B Intelligence Interaction

Portals

Web Services: XML and HTTP iWay SOA Middleware: ESB, etc.

API

API

API

API

API

API

API

API

SOA Means Not Being Limited To Web Services
Java and .NET Apps Portals Business B2B Intelligence Interaction

Web Services, XML, HTTP, JCA, ODBC, Plug-ins,… iWay SOA Middleware: ESB, etc.

API

API

API

API

API

API

API

API

One of Our Customer’s Requirements

1. Get approved work design

2. Load design detail into work request

3. Get Services Request Detail

4. Obtain Accomplish Records

5. Update Crew Schedule

6. Get Labor Equipment Info

7. Update estimate tables
Copyright © 2001 iWay Software

8. Extract Employee Skills

2

Customer Solution
Customer/1
Customer Billing CIS Tools Rates & metering Customer Info

PragmaCAD
Mobile Management Job Order Tools Crew Profiles Schedules

Passport
Equipment AM Tools Material Catalogue Work Orders

Primavera (P3E)
Projects Planning Equipment Activity Estimates Actual Labor Hours, costs

Service Exposure, Composition, Provision: ESB App Server: Orchestration Service Exposure, Composition, Provision: ESB
ArcFM
Mapping & Models Graphical Tools Work Design Gas & Electric

Timberline
Accounting & Estimating Estimating tools Material Catalogue Evaluations

eTimeMachine
Enterprise Project Management Enterprise PM tools Resources & Employees Time and Expense

Peoplesoft
Employee Skills HR Tools HR Records Organization detail

Copyright © 2001 iWay Software

2

Web Services Aren’t Enough

Copyright © 2001 iWay Software

Copyright © 2001 iWay Software

2 3

Web Services Alone Don’t Mean You Have a Good Architecture
Service consumers Credit Risk Engine

Application owners create different services for each ERP
Credit in PSFT Information Assets Credit in SAP

The Usual Solution
Service consumers Credit Risk Engine

Common (but bad) idea: application developers call each service independently

Credit in PSFT Information Assets

Credit in SAP

Terrible Development
Service consumers Credit Risk Engine

Requires knowledge of business problem, which functions to call, application security, metadata, transaction management

Credit in PSFT Information Assets

Credit in SAP

Worse Maintenance
Service consumers Credit Risk Engine

Tightly couples new application to underlying ERPs, so upgrades must propagate to new application.

Credit in PSFT Information Assets

Credit in SAP

Problems Multiply With Reuse
Service consumers EAI or BPM Tools Credit Risk Engine Portals and B2B systems

Every new application has to recode multiple service calls the same way, reducing the benefit of service reuse.

Credit in PSFT Information Assets

Credit in SAP

No Isolation From Change
Service consumers EAI or BPM Tools Credit Risk Engine Portals and B2B systems

Adding or removing applications causes a ripple effect throughout the environment.

Credit in PSFT Information Assets

Credit in Siebel

Credit in SAP

Better: Use “Service Composition”
Service consumers EAI or BPM Tools Credit Risk Engine Portals and B2B systems

Complete isolation from change. Service implementation has little to no effect on consumers.

Enterprise Service Bus

Credit in PSFT Information Assets

Credit in SAP

Better: Use “Service Composition”
Service consumers EAI or BPM Tools Credit Risk Engine Portals and B2B systems

Complete isolation from change. Service implementation has little to no effect on consumers.

Enterprise Service Bus

Credit in PSFT Information Assets

Credit in Siebel

Credit in SAP

Better: Use “Service Composition”
Service consumers EAI or BPM Tools Credit Risk Engine Portals and B2B systems

Complete isolation from change. Service implementation has little to no effect on consumers.

Enterprise Service Bus

Credit in Siebel Information Assets

Credit in SAP

What Was That Again?

Copyright © 2006 iWay Software

Copyright © 2001 iWay Software

2 4

Web Services and Legacy Systems
Turn this…
Application Application Application Application

…into this
App Service Interface Service Interface App App Service Interface Service Interface App App Service Interface Service Interface App App Service Interface Service Interface App

Application

Application

Application

Application

Web services decouple service interfaces and applications …but service invocations and interfaces are usually still tightly coupled
Copyright © 2006 iWay Software

4

ESB and Legacy Systems
Turn this…
App Service Interface Service Interface App App Service Interface Service Interface App App Service Interface Service Interface App App Service Interface Service Interface App Service Interface Service Interface Service Interface Service Interface Service Interface

…into this
Service Interface Service Interface Service Interface

ESBs can decouple service invocations from service interfaces …through transformation, routing, and service composition
Copyright © 2006 iWay Software

4

SOA, Legacy, and the ESB
Focus on your core business rather then IT …
New Check Traveler Service

Travel Reservation Process

Book Flight Service

Check Credit Service

Add new services faster

Enterprise Service Bus
Hotel Availability Service Flight Availability Service Book Hotel Service Book Car Service

Change services with minimal impact to existing services

New Flight Availability Service
Copyright © 2006 iWay Software

Old Flight Availability Service

4

SOA, Legacy, and the ESB
1 When all applications conform to Web Services standards…
Check Traveler Service Check Credit Service Book Flight Service

2

When not all applications conform to Web Services standards…
Check Traveler Application Check Credit Application Book Flight Application

Travel Reservation Process

Travel Reservation Process

Typical Enterprise Service Bus
Hotel Availability Service Flight Availability Service

Advanced Enterprise Service Bus
Hotel Availability Service Flight Availability Application

Book Hotel Service

Book Car Service

Book Hotel Application

Book Car Application

…a “standards-based” ESB may do enough
Copyright © 2006 iWay Software

…you may need an advanced ESB that creates services from existing non-standard assets.

4

SOA, Legacy, and the ESB
iWay Enterprise Service Bus
Web Service connectivity and data transformation
Web Services UDDI XML SOAP HTML JMS JMS Siebel FIX Lawson WSDL HTTP AS1

Universal connectivity and transformation
Tuxedo SAP Oracle PeopleSoft AS2 GJXML CICS EDIG@S Google ebXML AS3 Baan 3270 ESRI VSAM DB2/400 HL7 JCA Essbase 5250

EDIINT AquaLogic

BizTalk UCCnet

Copyright © 2006 iWay Software

4

iWay’s Two Major Benefits: Productivity and Interoperability
Productivity
 From developer’s perspective, everything looks the same  Requires no extra training or skills  Useful for their tools of choice
Composite Apps JCA

Interoperability
 Different platforms and software require different plugins  Leaves you open for next steps, e.g., B2B, post-Web services

BPM/BPEL

B2B XML AS2

Portals

EAI Tools

Plug-in

Plug-in

Service interfaces: business data only Stateless services

DB2

VSAM

CICS CICS Mainframe

IMS

DB2/400 JDE iSeries

Oracle Unix

SAP

SQL Svr Etc. Windows

Copyright © 2006 iWay Software

4

SOA and Business Intelligence

Copyright © 2001 iWay Software

Copyright © 2001 iWay Software

2 4

Options: Traditional ETL
 Supports DW goals: single version of truth, etc.  Relatively simple conceptually  Relatively high latency
Data Flow

Copyright © 2006 iWay Software

4

Options: Real-time, or “Trickle-feed”, Data Warehousing
 Events captured, cleansed, loaded as they happen  Supports DW goals: single version of truth, etc.  Very low latency, from real-time to several minutes
Event Flow

Copyright © 2006 iWay Software

4

Options: Distributed Query
 One query, many sources: reconciled in real time  The operational systems’ “version of the truth”  Need to be wary of performance, contention issues

Copyright © 2006 iWay Software

5

Data Integration vs. Application Integration
Application Application

Data Dump

FTP

Data Load

Copyright © 2001 iWay Software

5

Data Integration vs. Application Integration
Application Application

Data Dump

FTP

Data Load

Copyright © 2001 iWay Software

5

Data Integration vs. Application Integration
Application Transactions Application Transactions

Copyright © 2001 iWay Software

5

Application Integration – and SOA – For Business Intelligence
Application Transactions Business Intelligence Applications

Data Warehouse

Copyright © 2001 iWay Software

5

Application Integration – and SOA – For Business Intelligence
Application Transactions Business Intelligence Applications

Data Warehouse

Copyright © 2001 iWay Software

5

Application Integration – and SOA – For Business Intelligence
Application Transactions Business Intelligence Applications

Data Warehouse

Copyright © 2001 iWay Software

5

Application Integration – and SOA – For Business Intelligence
Application Transactions Portals Business Intelligence Applications Composite Applications Data Warehouse Business-toBusiness Interactions

Copyright © 2001 iWay Software

5

What Services Should We Expose, And When?
 SQL-queryable data models  Parameterized non-SQL queries  Queries deployed from BI tools  Pros and cons of various tool sets  Business intelligence  Application integration  EII / federated data query tools  Customers:  Bell Canada  Iowa Courts
Copyright © 2006 iWay Software

5

Henny Penny

Copyright © 2006 iWay Software

Copyright © 2001 iWay Software

2 5

Pre iWay Topology
RIP and read
Rip and Read
7.3.3

FTP / Form

Trading Partner I

Receive and print orders

JDE Terminal Interface

Value Added Network
DB2
ODBC FTP / X!2 EDI INOVIS EDI Translator

ISERIES

Trading Partner II
Copyright © 2006 iWay Software

6

Solution Topology
Trading Partner I Trading Partner II Trading Partner III Sales Orders Sales Orders Email Server

FTP/ XML

Protocol Adapter

FTP/ X!2 EDI

EDI X12 Adapter

eMail/File

Protocol Adapter Running a process flow to validate and insert sales orders.

Validate and Translate

iWay Service Manager
Trading Partner Runtime

JDE Master Business Functions interface

JD Edwards One World Adapter

Legacy Adapter

Windows 2003 Server

DB2
7.3.3
Copyright © 2006 iWay Software

iSeries

6

Colorado Dept of Corrections

Copyright © 2006 iWay Software

Copyright © 2001 iWay Software

2 6

Pre iWay Topology
Flat files HL7 GJXML

Call Center

Online Pharmacy

Is there any vendor that can help us validate, transform, and route flat files, HL7, and GJXML – in and out of our Jail Management System?

Colorado Department Of Corrections Jail Management System

Colorado Bureau of Investigation
Copyright © 2006 iWay Software

6

iWay Solution
Colorado Department of Corrections Call Center
Flat files HL7 Service Manager
Wintel Unix

Online Pharmacy

GJXML

RDBMS Adapter

Informix

DOC Enterprise Service Bus

Jail Management System

Colorado Bureau of Investigation*
*Future: GJXML exchanges Copyright © 2006 iWay Software with other departments inside the Colorado Justice supply chain …

6

Wrap-up

Copyright © 2001 iWay Software

Copyright © 2001 iWay Software

2 6

What To Do Now: Project Perspective
 Evaluate high-value projects  Portal, composite application, B2B, BPM, BI  Evaluate BI applications  You measure important stuff: walk the process  Identify the services needed to support them  Identify other projects that can use them  Create the services  Orchestrate them  Don’t be too timid: you’ll want the ROI and reuse
Copyright © 2001 iWay Software

6

Call to Action
Take us up on . . .
Half Day needs analysis and Review
Our iWay Integration Specialists will  Analyze your business challenge  Examine your Enterprise / Environment  Assess your integration requirements  Recommend Integration Alternatives

This half day session is free
Hands on Workshops Note your interest on your evaluations
Copyright © 2001 iWay Software

6