Professional Documents
Culture Documents
Hybrid Integration
CONTENTS
öö What Is a HIP?
Best Practices
öö How to Build a HIP
It’s clear that rethinking your integration stack is becoming more and • To build integration flows in a few days rather than a few weeks
more urgent. or months,
1
Destination:
Hybrid integration platform
Spend 5 minutes,
save 5 months
axway.com
HYBRID INTEGRATION BEST PRACTICES
• To discuss new use cases around IOT and AI, and HIP is far more complex to address than it might seem. You will need
• To activate and blend together the different architecture strate- to grasp this complexity on a fundamental level in order to address it
gies (services, events, and data). sufficiently. A HIP is, in fact, truly hybrid across several axes:
What Is a HIP? points exactly how you want, with the communication patterns
So what is a Hybrid Integration Platform (HIP)? First of all, it is important required (files, messages, transactions, and so on).
This view of the HIP architecture shows its hybrid character. The details • By the architecture strategies it covers: Stop the useless debates
will change according to your integration needs, but this view gives you around architecture. You need several architecture strategies
the big picture of a HIP. following your specific needs. You need to use and combine sev-
eral integration patterns, such as services-oriented integration,
In a HIP, API management is central to all your integrations, and must ad-
data-oriented integration, or events integration. Each pattern
dress both on-premise and cloud endpoints. This API management should
uses different technologies, and they all must live and work
work in concert with new data integration solutions, iPaaS/iSaaS solutions
together seamlessly.
(which we’ll introduce later), RPA, and iBPM, as well as specific cloud plat-
form solutions, and of course, your legacy integration stack (generally ESB, • By solutions: Following your integration needs, you’ll need dif-
ETL, and MFT). This is not a comprehensive list — you’ll probably think of a ferent technologies. After this, we’ll zoom in on APIs and iPaaS.
few additional endpoints for API management in your HIP. I’ve added data-oriented solutions, like CDC or data virtualiza-
tion, that let you have access to data very easily and quickly.
Why Do I Need a HIP? Why Should I Care About
This Concept? • By deployment: You need to integrate your endpoints, regard-
First, if your global architecture looks like the diagram above, or if it will less of where they reside, with technologies that work seamless-
look similar in the future, you already have or will soon have a HIP. A ly on-premise as well as in the cloud.
• By unforeseen related needs: In general, you must future-proof by abler of hybrid integration, in conjunction with an API management solu-
being able to integrate every new technology that will emerge. tion. And major iPaaS vendors offer prebuilt templates and connectors
that can be easily reused, so iPaaS development can actually require
We see that the hybrid character of a HIP is multi-dimensional, and that
less time than before. This blend can work very well, as a number of
the combinations of possibilities is almost infinite. We must therefore
iPaaS have agreements with third-party API management solutions and
be able to absorb this complexity, and be able to address any idea that
vice versa, API management companies that have bundled iPaaS. The
we may have only conceived of six months ago. Of course, you can
reality is you need both to accomplish today’s more complex integration
imagine a lot of different integration patterns, including many previously
use cases and scenarios.
unheard-of, and even more not supported anywhere.
Finally, one of the potential benefits of iPaaS is to provide an iSaaS solu-
It is important to keep in mind that a true HIP can only be executed grad-
tion. iSaaS is a bit like iPaaS for end users. We can cite Microsoft Flow as
ually, in step with its unique current starting point, new requirements,
an example, which is quite oriented toward office automation uses.
and anticipated future needs.
and having an extremely simple development process maybe your organization isn’t mature enough.
• If you don’t know what you will be able to sell to your company
There is nothing more annoying than having an integration solution that
executives, you’ll get no money to work on it, or maybe worse,
requires a week of training, all to make flows that should not take more
not enough to accomplish your future needs in the right manner.
than half an hour to develop. All these points constitute the innovations
of iPaaS beyond the classic ESB. They serve to make iPaaS the real en- This vision should adapt to your organization’s changing needs. Compa-
ny strategy, future needs already expressed, industry trends, competitive • Project managers:
intelligence, and the degree of growth of the cloud and SaaS applica-
You must offer them a catalogue of easy-to-understand,
tions in your company are all good insights to take into account.
off-the-shelf APIs, but also support them in defining the
After defining your vision, you must first analyze your existing system, APIs to be built with their help. Show them a schedule of
because you certainly have a legacy on integration topics. You will need: your APIs and their versions, and support them in defining
their integration needs. You should also enable them to
• Knowledge of current flows to map your existing systems and understand for themselves what the best integrations would
subsequently determine what will require changes in order to be be to implement. Transform into a one-stop-shop for them,
more HIP-ready, to make their tasks as simple as possible.
• Knowledge of the integration solutions and patterns you have,
as well as the level of maturity of their implementation, • Application developers:
• Already known future integration needs (the earth continues You must make your integrations available to them in
to turn, right?), to which must be added any integration needs self-service, and at the same time, give them the support
expected in the coming year, over three years, and over the next necessary to carry out their integrations themselves. This
five years. This requires the intervention of specialists, as well requires not only traditional support, but also a version of
as your team, in addition to the people you have identified as open-source governance, where the team responsible is
innovators. The new uses and new products drive the need for above all the guardian of the temple, letting the projects
integration in the first place. work themselves.
In order to sell your HIP initiative to these groups, you’ll have to be point, the HIP team must likewise integrate with microservices for other
able to frame your integration stack as a product. The HIP will need to projects, but also integrate their own microservices.)
improve your company’s operations in measurable ways. Integration will
At the same time, how can you integrate your HIP with aging, legacy
need to become faster and better as a result of HIP implementation. To
IT? How do you link your mainframe to your customer website? The big
achieve that, you’ll need to create and operate a help desk that will man-
problem is that you can’t give your customers almost direct access to the
age integration requests, but also to accompany and manage key user
mainframe. It would not support the influx of requests.
accounts. You’ll need to have technical architects, API architects, and
functional architects in your team. As an integration guru, you will also For example, consider a small insurance company with a mainframe
need to establish best practices to ensure everyone’s best efforts have that did not yet have a customer portal. It would be impossible to API-
the biggest impact. Indeed, many tasks will be quite repetitive. It is up call their mainframe directly, and even so, the throttling rules needed for
to you to gradually operationalize them through a genuine continuous the API gateway so as not to collapse the mainframe would have been
improvement process. Finally, in the same vein as the need to market too restrictive for fully functional use.
your HIP platform, you will need to ensure that the user experience of
your platform is impeccable. At the same time, it’s a simple question of displaying customer
information. Let’s say this company has a close relationship with its
TECHNOLOGY BEST PRACTICES customers, who do not hesitate to call or go to a branch if they need to
As I said earlier, the API is the cornerstone of a HIP. It is essential because
get something done. Therefore, we should port this data into a resilient
it will be the common point for all your integrations, allowing you to
system — in this case, a SQL database. If the mainframe and database
share your integrations with all types of actors. Nevertheless, as we
are synchronized via a change data capture (CDC), the client only needs
have also seen, any number of new technological solutions are regularly
to put in Java code that would read the database, then expose this
emerging. And this point has two obvious corollaries:
Java code via their API manager (with throttling limits acceptable to the
• Technological: Yes, it is obvious, but it’s important to keep client). Thus, customer data would remain the full property and respon-
in mind that many subjects are maturing rapidly each year. sibility of the mainframe, and the role of the API is to be the single entry
DevOps? New tools are always emerging or improving. Big Data? point for the customer portal.
We’re talking more and more about DataOps, and the sector is in
So, to summarize, you need to extract the data into a high-performance
full consolidation. AI? We all know that the subject will become
data layer that will be exposed by an API manager. Two main types of
more and more defined in the coming years. Microservices? It is
technologies allow this. The first, change data capture (CDC), is the
an area that is still maturing, whether technologically speaking
bidirectional synchronization between the legacy system of record and
or in its logical architecture in the company. Embarking on mi-
your modern system. The second can be grouped as all messaging tech-
croservices means potentially embarking on a project where the
nologies. These two types of technologies allow the two systems to be
definition of done is a moving target. Streaming APIs? So many
uncorrelated, without impacting the performance and developments of
technologies are available that you may not really know which
the legacy system. From this fast data layer, you can bring needed data
one to choose. It is therefore necessary to be able to follow
into the digital system.
technological developments in order to quickly anticipate and
embrace the requests they will make to HIP teams. The schema can be simplified like this:
or Yammer, your HIP will need an engaged community. You must not up for debate. Business users, developers, CDOs, CEOs — all must
communicate on new features, your roadmap, new APIs, and also take be sponsors of your HIP. The ROI will not be immediate and will not
the opportunity to exchange and bring out new ideas. It is therefore be immediately visible, so it is important to make sure that everyone
necessary to bring to life this great engine of innovation that is the HIP. appreciates the stakes involved. The future cost of integration is a key
The innovative personalities incorporated into your HIP team must take consideration of any business project.
control of this process, and must be supplied with the toolsets to do so.
I hope in any case that this Refcard serves as a resource for those who
Design thinking, visual management, and CX/UX are all methodologies
are considering implementing a HIP, and provides a number of keys
that may prove useful. But if you think internal teams are your only
to implement it in a range of diverse circumstances. Like any solution,
potential audience, you’ve already lost! Modern companies operate an
there is not a single possible path, and it will be up to you to find the one
ecosystem, with more and more business partners joining all the time.
that suits you.
This ecosystem is broader than just internal teams. Your HIP should
also embrace partner ecosystems and larger value chain ecosystems —
always with the goal of creating more value for your end customer. You
are not alone in your business, so share your assets and your knowledge
with partners. Collaboration will lead to even more innovation.
The lead innovator is the role that must take charge of the HIP team —
not all alone of course, but with everyone connected to the spirit of
innovation in the company. The HIP team must cement its value in the
minds of the various stakeholder groups in order to work efficiently. As
I said earlier, the subject of integration has experienced its “winter.” It
is therefore necessary to improve its image and re-affirm its value. In
this respect, we will be helped by the contribution of API management,
which benefits from a modern and innovative image, whose benefits are
Devada, Inc.
600 Park Offices Drive
Suite 150
Research Triangle Park, NC
888.678.0399 919.678.0300
DZone communities deliver over 6 million pages each month to
more than 3.3 million software developers, architects, and de- Copyright © 2019 DZone, Inc. All rights reserved. No part of this
cision makers. DZone offers something for everyone, including publication may be reproduced, stored in a retrieval system, or
news, tutorials, cheat sheets, research guides, feature articles, transmitted, in any form or by means electronic, mechanical,
source code, and more. "DZone is a developer’s dream," says PC photocopying, or otherwise, without prior written permission of
Magazine. the publisher.