ARHITEKTURA ANALITIČKE PLATFORME U CLOUD OKRUŽENJU

Copyright © 2018 Syntio. All Rights Reserved.

SYNTIO

Data engineering company focused on building solutions that create value from
client's data.

FOCUS ON CLOUD, BIG TRANSFORMING PROVEN PROJECT CERTIFIED IN DATA VENDOR AGNOSTIC
DATA AND EVENT BUSINESS EXPERTISE METHODOLOGY AND INTEGRATIONS, BIG APPROACH
DRIVEN ARCHITECTURES INTO MEASURABLE FAST RESULTS DATA & DATA
IMPACT WAREHOUSES

Copyright © 2018 Syntio. All Rights Reserved. ‹#›

PARTNERI I KLIJENTI – FOKUS NA EUROPSKO TRŽIŠTE

Copyright © 2018 Syntio. All Rights Reserved. ‹#›

20 GODINA ISKUSTVA

1998 2007 2017 Today

• OSNIVAČI ZAPOČELI KARIJERE U IT • OSNIVAČI ZAPOČELI • SYNTIO OSNOVAN • 15 ZAPOSLENIH

• SOFTWARE ENGINEERING ZAJEDNIČKE PROJEKTE • OSNIVAČI U PROSJEKU • 14 PROJEKATA
• DATA WAREHOUSE & BI • DATA WAREHOUSES, BI S 15 GODINA • 10 SENIOR INŽENJERA
• MALOPRODAJA, FINANCIJE & & EKSPERTNI SISTEMI ISKUSTVA • 10 KLIJENATA
TELEKOM OPERATERI • PREPOZNATI KAO • 04 ZEMLJE
• PODRŠKA KLIJENTSKIM POSLOVNIM STRUČNJACI U DWH &
CIKLUSIMA I RAZVOJU BI

Copyright © 2018 Syntio. All Rights Reserved. ‹#›

ISKUSTVA S ALATIMA

ENTERPRISE DATA PLATFORM NOSQL DATABASE

CLOUD DATA PLATFORM ELT TOOL

LOG MANAGEMENT WORKFLOW MANAGER

STREAMING DATA PLATFORM BUSINESS ANALYTICS

BATCH DATA PROCESSING REPOSITORY MANAGER

DATA STORAGE DISTRIBUTION AND ORCHESTRATION

DATABASE BUILD AND AUTOMATION

DATA ANALYTICS ENTERPRISE

Copyright © 2018 Syntio. All Rights Reserved. 5

METODOLOGIJA RADA

PRODUCTION Output result integration

Operational systems start
consuming AA results
LIMITED
PRODUCTION
SCALED POC
Delivery

PROTOTYPE

Automation level
Quick iteration Value proof in Stabilize code, BAM, monitor Transfer insights
to prove value real business extend reach (UI closely into IT system
situation / interface)

Focus on trial/ Focus on Focus on roll- Focus to drive Reduced (no) AA

error cycles functionality out / stability business value dependency

Use Case phases PoC Pilot Roll out Usage

Copyright © 2018 Syntio. All Rights Reserved. 6

BIG DATA I CLOUD

SKALIRANJE ODRŽAVANJE VIRTUALIZACIJA

INFRASTRUKTURA

DOSTUPNOST SOFTVERA TRANSPARENTNIJI

TROŠKOVI

Copyright © 2018 Syntio. All Rights Reserved. 7

CLOUD VENDORI

Copyright © 2018 Syntio. All Rights Reserved. 8

 Amazon AWS Microsoft Azure Google Cloud Open Source

PREGLED Batch Ingest AWS Data Transfer Services (various options) Import/Export Service
Data Factory
Cloud DataFlow Sqoop
File Transfer
Flume

CLOUD Streaming Ingest Amazon Kinesis Firehose Event Hubs

IOT Hub
Cloud DataFlow
StreamSets
Flume
StreamSets

SERVISA Persistent
Storage
S3, Glacier
RDS
Storage Blob
Data Lake Store
SQL Database
Persistent Disk
Google Cloud Storage
Cloud SQL
HDFS
RDBMS

ZA ANALITIKU Transient
Storage
Kinesis Event Hubs
IOT Hub
HDInsight (Kafka)
Cloud Pub/Sub
Cloud IoT Core
Kafka

Batch EMR Spark Azure Batch Cloud Dataflow (open source Apache Beam) Hive
Processing EMR Hadoop HDInisght (Spark/Map Reduce) Cloud DataProc (Spark, Hadoop) Flink, Spark
EMR Presto SQL Data Warehouse MapReduce
AWS Batch Data Lake Analytics PostgreSQL
Redshift Azure Functions
Stream Amazon Kinesis Streams Stream Analytics Cloud Dataflow (open source Apache Beam) Flink
Processing Amazon Kinesis Analytics HDInsight (Storm, Spark) DataProc (Spark, Hadoop) Spark
EMR Spark Beam
Machine Lex Azure ML Natural Language Scikit
Learning Polly Cognitive Services SpeechTranslation Tensorflow
Recognition Vision Spark MLLib
Amazon Machine Learning Video TensorFlow etc.
ML Engine Huge number of libraries
Serving Storage Neptune CosmosDB N/A JanusGraph
Graph Storage Redshift
Serving SQL Data Warehouse BigQuery Impala + Kudu
BI/EDW Athena Analysis Services (OLAP Cubes)
Serving Storage Amazon CloudSearch Azure Search N/A Marketplace, e.g. Solr Solr
Search Amazon Elasticsearch
(keywords +
Serving Storage RDS SQL DB Cloud SQL PostgreSQL
RDBMS
Serving Storage DynamoDB HDInsight (HBase) BigTable HBase
NoSQL CosmosDB Spanner
DataStore
Sandboxes EMR Zeppelin Azure Notebooks Cloud Datalab Zeppelin
Notebook
Sandboxes Data N/A Marketplace only, e.g. Dataiku DSS N/A Marketplace only, e.g. Dataiku DSS Cloud DataPrep (Trifacta) Dataiku DSS Community Edition (not open source)
Science or
Clients/Data Quicksight PowerBI Google Data Studio Superset (BI)
Apps
Orchestration AWS Data Pipeline Data Factory N/A Marketplace Airflow
ETL Tool AWS Glue Data Factory N/A Marketplace N/A
MDM Hub N/A Marketplace N/A Marketplace N/A Marketplace N/A
Lineage AWS Glue N/A N/A N/A
Catalog AWS Glue Data Catalog N/A Marketplace N/A

Copyright © 2018 Syntio. All Rights Reserved. 9

ANALITIČKA PLATFORMA – CILJEVI

UNIFORMNOST ORKESTRACIJA INFRASTRUCTURE AS KVALITETA PODATAKA PODACI KAO SERVIS

ISKORISTIVOST AUTOMATIZACIJA CODE (DAAS)
VRIJEDNOST (IaC)

Copyright © 2018 Syntio. All Rights Reserved. 10

... I IZAZOVI

SIGURNOST PRIVATNOST UPRAVLJANJE PODACIMA

Copyright © 2018 Syntio. All Rights Reserved. 11

PROTOTIP ARHITEKTURE

Izvor: https://www.whizlabs.com/blog/big-data-and-cloud-computing/
Copyright © 2018 Syntio. All Rights Reserved. 12
KLJUČNA PITANJA

MOTIVATORI ODABIR CLOUD ZRELOST CLOUD ALATA ODABIR APLIKACIJA SIGURNOST

TROŠKOVI RJEŠENJA MIGRACIJA PODATAKA PRIVATNOST
USKLAĐENOST

Copyright © 2018 Syntio. All Rights Reserved. 13

USE CASE 1

Copyright © 2018 Syntio. All Rights Reserved. 14

USE CASE 2

Copyright © 2018 Syntio. All Rights Reserved. 15

USE CASE 3

Copyright © 2018 Syntio. All Rights Reserved. 16

 HVALA NA PAŽNJI

marko.krajnik@syntio.hr

Copyright © 2018 Syntio. All Rights Reserved.