Professional Documents
Culture Documents
Gartner RAS Core Research Note G00151150, Ted Friedman, Mark A. Beyer, Andreas Bitterer, 5 October 2007
MAGIC QUADRANT
Market Overview
The discipline of data integration comprises the practices, architectural techniques and tools
for achieving the consistent access and delivery of data across the spectrum of data subject
areas and data structure types in the enterprise, in order to meet the data consumption
requirements of all applications and business processes. As such, data integration capabilities
are at the heart of the information-centric infrastructure and will power the frictionless sharing of
data across all organizational and system boundaries. Contemporary pressures are leading to
an increase in investment in data integration in all vertical industries and geographies. Business
drivers, such as the imperative for speed to market and agility to change business processes
and models, are forcing organizations to manage their data assets differently. Simplification of
processes and the IT infrastructure are necessary to achieve transparency, and transparency
requires a consistent and complete view of the data, which represents the performance and
operation of the business. Data integration is a critical component of an overall enterprise
information management strategy that can address these data-oriented issues.
From a technology point of view, data integration tools were traditionally delivered via a set of
related markets, with vendors in each market offering a specific style of data integration tool.
Most of the activity has been within the extraction, transformation and loading (ETL) tools
market, with a growth in the use of ETL tools for data warehouse implementations and, more
recently, other types of data integration problems. Markets for replication tools, data
2
federation and other submarkets each contained Figure 1. Magic Quadrant for Data Integration Tools, 2007
vendors offering tools optimized for a particular style
of data integration. A variety of other related markets,
such as data quality tools, adapters and data challengers leaders
modeling tools, also overlap with the data integration
tools space. The result of all this historical
fragmentation in the markets is the equally
fragmented and complex way in which data
integration is accomplished in large enterprises –
different teams using different tools with little Informatica IBM
consistency, lots of overlap and redundancy, and no
common management and leverage of metadata. Business Objects
ability to execute
Technology buyers were been forced to acquire a
Microsoft
portfolio of tools from multiple vendors in order to
amass the capabilities necessary to address the full
range of their data integration requirements. Oracle
Pervasive Software SAS Institute
With the emergence of the data integration tools iWay Software
Tibco Software Sybase
market, the separate and distinct submarkets Cognos
continue to converge, both at a vendor and SAP
technology level. This is being driven by buyer
demands (for example, organizations realizing they ETI Sun
need to think about data integration holistically and Syncsort
have a common set of data integration capabilities
Pitney Bowes Group 1 Software
they can use across the enterprise). It is also being
Hummingbird Connectivity
driven by the actions of the vendors (for example,
vendors in individual data integration submarkets
organically expanding their capabilities into
neighboring areas, and acquisition activity bringing niche players visionaries
vendors from multiple submarkets together). The
result is a market for complete data integration tools completeness of vision
that address a range of different data integration
styles and are based on common design tooling, As of October 2007
metadata and runtime architecture. This market has Source: Gartner
supplanted the former data integration tools
submarkets, such as ETL, and becomes the
competitive landscape in which Gartner evaluates vendors for
placement within this Magic Quadrant. Gartner estimates that the integrated data structures for analytic purposes. BI and data
current size of the market for data integration tools is warehousing remains a mainstay of the demand for data
approximately $1.2 billion as of the end of 2006, and that it is integration tools.
growing at a compound annual rate of more than 17%. • Creation of integrated master data stores – enabling the
consolidation and rationalization of the data, representing
Market Definition/Description critical business entities such as customers, products and
The data integration tools market comprises vendors that offer employees. Master data management may or may not be
software products to enable the construction and implementation subject-based, and data integration tools can be used to build
of data access and delivery infrastructure for a variety of data the data consolidation and synchronization processes that are
integration scenarios, including: key to success.
• Data acquisition for business intelligence (BI) and data • Data migrations/conversions – traditionally addressed most
warehousing – extracting data from operational systems, often via the custom coding of conversion programs, data
transforming and merging that data, and delivering it to integration tools are increasingly addressing the data movement
The Magic Quadrant is copyrighted October 2007 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a mar-
ketplace at and for a specific time period. It depicts Gartner’s analysis of how certain vendors measure against criteria for that marketplace, as defined by
Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those
vendors placed in the “Leaders” quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner
disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
© 2007 Gartner, Inc. and/or its Affiliates. All Rights Reserved. Reproduction and distribution of this publication in any form without prior written permission is
forbidden. The information contained herein has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy,
completeness or adequacy of such information. Although Gartner’s research may discuss legal issues related to the information technology business, Gartner
does not provide legal advice or services and its research should not be construed or used as such. Gartner shall have no liability for errors, omissions or
inadequacies in the information contained herein or for interpretations thereof. The opinions expressed herein are subject to change without notice.
3
and transformation challenges inherent in the replacement of • Changed-data capture (ability to identify and extract modified
legacy applications and consolidation efforts during merger and data).
acquisition activities. • Event-based acquisition (time-based or data value-based).
• Synchronization of data between operational applications –
similar in concept to each of the prior scenarios, data Data-Delivery Capabilities
integration tools provide the capability to ensure database-level The ability to provide data to consuming applications, processes
consistency across applications, both on an internal and and databases in a variety of modes, including:
interenterprise basis, and in a bidirectional or unidirectional
manner. • Physical bulk data movement between data repositories.
• Creation of federated views of data from multiple data stores – • Federated views formulated in memory.
data federation, often referred to as enterprise information • Message-oriented movement via encapsulation.
integration (EII), is growing in popularity as an approach for • Replication of data between homogeneous or heterogeneous
providing real-time integrated views across multiple data stores database management systems (DBMSs) and schemas.
without physical movement of data. Data integration tools are
increasingly including this type of virtual federation capability. In addition, support for delivery of data across the range of latency
• Delivery of data services in a service-oriented architecture requirements is important:
(SOA) context – an architectural technique, rather than a data • Scheduled batch delivery.
integration usage itself, data services are the emerging trend
• Streaming/real-time delivery.
for the role and implementation of data integration capabilities
within SOAs. Data integration tools will increasingly enable the • Event-driven delivery.
delivery of many types of data services.
• Unification of structured and unstructured data – also not a Data Transformation Capabilities
specific use-case itself, and relevant to each of the above Built-in capabilities for achieving data transformation operations of
scenarios, there is an early but growing trend toward leveraging varying complexity, including:
data integration tools for merging both structured and • Basic transformations, such as data type conversions, string
unstructured data sources, as organizations work on delivering manipulations and simple calculations.
a holistic information infrastructure that addresses all data • Intermediate complexity transformations, such as lookup and
types. replace operations, aggregations, summarizations, deterministic
matching and management of slowly changing dimensions.
Gartner has defined several classes of functional capabilities that • Complex transformations, such as sophisticated parsing
vendors of data integration tools must possess in order to deliver operations on free-form text and rich media.
optimal value to organizations in support of a full range of data
integration scenarios: In addition, the tools must provide facilities for development of
custom transformations and extension of packaged
Connectivity/Adapter Capabilities (Data Source and transformations.
Target Support)
The ability to interact with a range of different data structures
Metadata and Data-Modeling Capabilities
types, including:
As the increasingly important heart of data integration capabilities,
• Relational databases. metadata management and data-modeling requirements include:
• Legacy and non-relational databases. • Automated discovery and acquisition of metadata from data
• Various file formats. sources, applications and other tools.
• XML. • Data-model creation and maintenance.
• Packaged applications such as customer relationship • Physical to logical model mapping and rationalization.
management (CRM) and supply chain management (SCM). • Defining model-to-model relationships via graphical attribute-
• Industry-standard message formats such as electronic data level mapping.
interchange (EDI), Society for Worldwide Interbank Financial • Lineage and impact analysis reporting, via graphical and tabular
Telecommunication (SWIFT) and Health Level 7 (HL7). format.
• Message queues, including those provided by application • An open metadata repository, with the ability to share metadata
integration middleware products (such as MQ) and standards- bidirectionally with other tools.
based products (such as Java Messaging Service [JMS]).
• Automated synchronization of metadata across multiple
• Semi-structured data, such as e-mail, Web sites, office instances of the tools.
productivity tools and content repositories.
• Ability to extend the metadata repository with customer-defined
metadata attributes and relationships.
In addition, data integration tools must support different modes of
• Documentation of project/program delivery definitions and
interaction with this range of data structure types, including:
design principles in support of requirements definition activities.
• Bulk acquisition and delivery.
• Business analyst/end-user interface to view and work with
• Granular trickle-feed acquisition and delivery. metadata.
4
Design and Development Environment Capabilities • Common design environment for supporting all data delivery
Facilities for enabling the specification and construction of data modes.
integration processes, including: • Ability to switch seamlessly and transparently between delivery
• Graphical representation of repository objects, data models modes with minimal re-work.
and data flows. • Interoperability with other integration tools and applications, via
• Workflow management for the development process, certified interfaces and robust application programming
addressing approvals, promotions and so on. interfaces (APIs).
• Granular role-based and developer-based security. • Efficient support for all data delivery modes regardless of
• Team-based development capabilities, such as version control runtime architecture type (centralized server engine vs.
and collaboration. distributed runtime).
• Functionality to support reuse across developers and projects,
and facilitate identification of redundancies. Service-Enablement Capabilities
As acceptance of data services concepts continues to grow, data
• Testing and debugging.
integration tools must exhibit service-oriented characteristics and
provide support for SOA deployments, such as:
Data Governance Capabilities (Data Quality, Profiling • Ability to deploy all aspects of runtime functionality as data
and Mining) services.
Mechanisms for aiding the understanding and assurance of quality • Management of publication and testing of data services.
of data over time, including interoperability with: • Interaction with service repositories and registries.
• Data profiling tools. • Service-enablement of the development and administration
• Data mining tools. environments, such that external tools and applications can
• Data quality tools. dynamically modify and control runtime behavior of the tools.
Talend, Los Altos, CA, U.S. and Suresnes, France, Completeness of Vision
www.talend.com – Open Studio is an open-source tool that The “Completeness of Vision” criteria most strongly emphasizes an
primarily supports ETL-oriented implementations and is provided overall market understanding. This criteria includes an assessment
for on-premises deployment as well as in a software-as-a-service of the degree to which the vendor establishes market trends and
(SaaS) delivery model. direction, as well as the ability of the vendor to capitalize on market
trends and survive disruptions. Both of these characteristics are
Vamosa, Glasgow, U.K. and Cambridge, MA, U.S., crucial in the data integration tools market due to the volatility
www.vamosa.com – Provides content integration and migration, introduced by merger and acquisition activity, as well as the
aimed at synchronization and consolidation of document increasing impact on the market of the largest software vendors in
repositories, via its Content X-Change and Content Migrator the world. As such, in this iteration of the Magic Quadrant we
products. place additional emphasis on these criteria. In addition, we place a
high weighting on Innovation, in the form of the magnitude of R&D
WhereScape, Atlanta, GA, U.S., www.wherescape.com – investment directed specifically toward data integration tools, and
WhereScape RED enables rapid creation and maintenance of data the amount of creativity the vendors exhibit when developing their
warehouses, including ETL functionality. product and go-to-market strategies. Specific to Offering (Product)
7
Table 1. Ability to Execute Evaluation Criteria substantial in size, though
implementations are often of a single
Evaluation Criteria Weighting project nature, or reflect multiple
projects of a single type (for example,
Product/Service high all ETL-oriented use cases).
Ability to Execute
Product/Service: Core goods and services offered by the vendor that compete in/serve the defined market. This includes current
product/service capabilities, quality, feature sets, skills, etc., whether offered natively or through OEM agreements/partnerships as
defined in the market definition and detailed in the subcriteria.
Overall Viability (Business Unit, Financial, Strategy, Organization): Viability includes an assessment of the overall organization’s
financial health, the financial and practical success of the business unit, and the likelihood of the individual business unit to continue
investing in the product, to continue offering the product and to advance the state of the art within the organization’s portfolio of
products.
Sales Execution/Pricing: The vendor’s capabilities in all pre-sales activities and the structure that supports them. This includes deal
management, pricing and negotiation, pre-sales support and the overall effectiveness of the sales channel.
Market Responsiveness and Track Record: Ability to respond, change direction, be flexible and achieve competitive success as
opportunities develop, competitors act, customer needs evolve and market dynamics change. This criterion also considers the
vendor’s history of responsiveness.
Marketing Execution: The clarity, quality, creativity and efficacy of programs designed to deliver the organization’s message in order
to influence the market, promote the brand and business, increase awareness of the products, and establish a positive identification
with the product/brand and organization in the minds of buyers. This “mind share” can be driven by a combination of publicity,
promotional, thought leadership, word-of-mouth and sales activities.
Customer Experience: Relationships, products and services/programs that enable clients to be successful with the products
evaluated. Specifically, this includes the ways customers receive technical support or account support. This can also include ancillary
tools, customer support programs (and the quality thereof), availability of user groups, service-level agreements, etc.
Operations: The ability of the organization to meet its goals and commitments. Factors include the quality of the organizational
structure including skills, experiences, programs, systems and other vehicles that enable the organization to operate effectively and
efficiently on an ongoing basis.
Completeness of Vision
Market Understanding: Ability of the vendor to understand buyers’ wants and needs and to translate those into products and
services. Vendors that show the highest degree of vision listen and understand buyers’ wants and needs, and can shape or enhance
those with their added vision.
Marketing Strategy: A clear, differentiated set of messages consistently communicated throughout the organization and
externalized through the Web site, advertising, customer programs and positioning statements.
Sales Strategy: The strategy for selling product that uses the appropriate network of direct and indirect sales, marketing, service
and communication affiliates that extend the scope and depth of market reach, skills, expertise, technologies, services and the
customer base.
Offering (Product) Strategy: The vendor’s approach to product development and delivery that emphasizes differentiation,
functionality, methodology and feature set as they map to current and future requirements.
Business Model: The soundness and logic of the vendor’s underlying business proposition.
Vertical/Industry Strategy: The vendor’s strategy to direct resources, skills and offerings to meet the specific needs of individual
market segments, including verticals.
Innovation: Direct, related, complementary and synergistic layouts of resources, expertise or capital for investment, consolidation,
defensive or pre-emptive purposes.
Geographic Strategy: The vendor’s strategy to direct resources, skills and offerings to meet the specific needs of geographies
outside the “home” or native geography, either directly or through partners, channels and subsidiaries as appropriate for that
geography and market.