Reporting Tool Comparative Analysis

Clicdata :-
 SAAS
 BI Tool
 In free ware version only 1GB Space permissible per customer

Metabase:-
 Both enterprice and open source version available
 BI tool
 Built on clojure runs in JVM

Supported Databases:-
 Amazon Redshift
 Google BigQuery
 H2
 MongoDB (version 3.4 or higher)
 MySQL (version 5.5.3 or higher, as well as MariaDB)
 Postgres
 SQLite
 SQL Server
 Druid
 Oracle
 Vertica
 Presto
 Google Analytics
 SparkSQL
 Snowflake

Pros:-
 SQL custom query available
 Builtin authentication available
  Role based access control present
 Pretty good UI
 User addition and previlage modification available from UI
 Table joins from UI available
 Auto Refresh of dashboard available
 Custom column creation from UI available with a good number of number and string
functions
 Dynamic Dashboard filtering and column level insights available
 14 graph widgets available
 Multi axis graphs available
 Funnel chart available

Cons:-

 Histogram(can be done from custom sql),heat map,word cloud maps not available.

Reference and installation links:-

 https://websiteforstudents.com/how-to-install-metabase-server-on-ubuntu-18-04-16-04/
 https://computingforgeeks.com/how-to-install-metabase-with-systemd-on-ubuntu/

Installation Steps:-

sudo apt update

sudo apt-get install default-jresudo apt-get install mariadb-server mariadb-client
sudo systemctl stop mysql.service
sudo systemctl start mysql.service
sudo systemctl enable mysql.servicesudo mysql_secure_installation
sudo mysql -u root -p
CREATE DATABASE metabase;
CREATE USER 'metabaseuser'@'localhost' IDENTIFIED BY 'new_password_here';GRANT
ALL ON metabase.* TO 'metabaseuser'@'localhost' WITH GRANT OPTION;
FLUSH PRIVILEGES;
EXIT;
cd /tmp
wget http://downloads.metabase.com/v0.34.1/metabase.jar
sudo mkdir /opt/metabase
sudo mv metabase.jar /opt/metabase
sudo addgroup --quiet --system metabase
sudo adduser --quiet --system --ingroup metabase --no-create-home --disabled-password
metabase
sudo chown -R metabase:metabase /opt/metabase
sudo touch /var/log/metabase.log
sudo chown metabase:metabase /var/log/metabase.log
sudo touch /etc/default/metabase
sudo chmod 640 /etc/default/metabase
sudo nano /etc/systemd/system/metabase.service

paste below

[Unit]
Description=Metabase server
After=syslog.target
After=network.target

[Service]
WorkingDirectory=/opt/metabase/
ExecStart=/usr/bin/java -jar /opt/metabase/metabase.jar
EnvironmentFile=/etc/default/metabase
User=metabase
Type=simple
StandardOutput=syslog
StandardError=syslog
SyslogIdentifier=metabase
SuccessExitStatus=143
TimeoutStopSec=120
Restart=always

[Install]
WantedBy=multi-user.target
sudo systemctl daemon-reload
sudo systemctl start metabase
sudo systemctl enable metabase
sudo systemctl status metabase
sudo nano /etc/rsyslog.d/metabase.conf

paste below

if $programname == 'metabase' then /var/log/metabase.log

& stop

sudo systemctl restart metabase

from browser http://<ip>:3000

Google Data Studio:-

 Completely free ware SAAS
  BI tool

Supported Databases:-
 BigQuery
 Cloud SQL
 DCM
 Google Analytics
 Google Sheets
 MySQL
 PostgreSQL
 Search Console
 YouTube Analytics

Pros:-
 SQL custom query available
 Builtin authentication available
 Role based access control present
 Pretty good UI
 Sharing documents pretty eaasy
 Table joins from UI available
 Auto Refresh of dashboard available
 Custom column creation from UI available with a good number of number and string
functions
 Dynamic Dashboard filtering and column level insights available
 31 graph widgets available
 Multi axis graphs available

Cons:-

 In mysql,postgres a max of 100K rows allowable and if we move to google storages its
unlimited.

Helical Insight :-
  SAAS
 BI Tool
 UI driven dashboard designer with drag drop interface not there on community edition

Apache Superset:-
 OS
 BI tool
 Built in python

Supported Databases:-
 Amazon Athena
 Amazon Redshift
 Apache Drill
 Apache Druid
 Apache Hive
 Apache Impala
 Apache Kylin
 Apache Pinot
 Apache Spark SQL
 BigQuery
 ClickHouse
 CockroachDB
 Dremio
 Elasticsearch
 Exasol
 Google Sheets
 Greenplum
 IBM Db2
 MySQL
 Oracle
 PostgreSQL
 Presto
 Snowflake
 SQLite
 SQL Server
 Teradata
 Vertica
 Hana
Pros:-
 SQL custom query available
 Statistical test like paired t test available
 Resampling data possible
 Advanced analytics like moving average and time comaprision
 Builtin authentication available
 Role based access control present
 User addition and previlage modification available from UI
 Auto Refresh of dashboard available
 Custom column creation from UI available
 48 graph widgets available

Cons:-

 Multi axis graphs only line chart available

Reference and installation links:-

 https://medium.com/tools-for-data-visualization/apache-superset-bootcamp-step-by-step-
installation-in-ubuntu-18-04-part-2-f13cd7dce59f
 https://superset.apache.org/gallery.html

Installation Steps:-

2 sudo apt-get update

3 sudo apt-get install -y build-essential checkinstall libreadline-gplv2-dev libncursesw5-dev libssl-dev
libsqlite3-dev tk-dev libgdbm-dev libc6-dev libbz2-dev zlib1g-dev openssl libffi-dev python3-dev
python3-setuptools wget
4 mkdir /tmp/Python37
5 cd /tmp/Python37
6 wget https://www.python.org/ftp/python/3.7.0/Python-3.7.0.tar.xz
7 tar xvf Python-3.7.0.tar.xz
8 cd /tmp/Python37/Python-3.7.0
9 ./configure
10 sudo make altinstall
11 python3.7 –version
12 python3.7 –-version
13 python3.7
14 python3.7 -V
15 pip3.7 install virtualenv
16 sudo pip3.7 install virtualenv
17 cd ..
18 mkdir superset
 19 ls
20 sudo mkdir suprset
21 cd suprset
22 python3.7 -m virtualenv apsuperset
23 sudo python3.7 -m virtualenv apsuperset
24 cd apsuperset/
25 ls
26 cd vin
27 cd bin
28 ls
29 source activate
30 cd ..
31 python -V
32 sudo pip3.7 install apache-superset
33 sudo apt-get update
34 superset db upgrade
35 export FLASK_APP=superset
36 flask fab create-admin
37 superset load_examples
38 superset init
41 superset run --host=0.0.0.0 --port=8088

from browser http://<ip>:8088

Kibana:-
 Both OS and enterprice edition available
 Data visualization dashboard for Elasticsearch data
 Built in Java-script

Supported Databases:-
 Elastic Search

Pros:-
 KQL custom query available
 Builtin authentication available
 Role based access control present
 User addition and previlage modification available from UI
 Auto Refresh of dashboard available
  17 graph widgets available
 Multi axis graphs available

Cons:-

 Works only on elastic search

 Elastic search doesn’t offer built in joins, ACID Transactions
 Histogram not available

Reference and installation links:-

 https://www.elastic.co/guide/en/elasticsearch/reference/7.8/configuring-security.html
 https://www.elastic.co/guide/en/kibana/current/using-kibana-with-security.html
 https://www.elastic.co/blog/getting-started-with-elasticsearch-security

Installation Steps:-

1 apt update
2 apt upgrade
3 wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add -
4 echo "deb https://artifacts.elastic.co/packages/7.x/apt stable main" | sudo tee
/etc/apt/sources.list.d/elastic-7.x.list
5 apt update
6 apt-get install apt-transport-https
7 apt install elasticsearch
8 nano /etc/elasticsearch/elasticsearch.yml
9 systemctl daemon-reload
10 systemctl enable elasticsearch
11 systemctl start elasticsearch
12 cd /usr/share/elasticsearch/
13 ls
14 bin/elasticsearch-setup-passwords interactive
53 apt install kibana
54 nano /etc/kibana/kibana.yml
55 curl -XPOST -u elastic 'localhost:9200/_security/role/events_admin' -H "Content-Type:
application/json" -d '{
56 "indices" : [
57 {
58 "names" : [ "events*" ],
59 "privileges" : [ "all" ]
60 },
61 {
62 "names" : [ ".kibana*" ],
63 "privileges" : [ "manage", "read", "index" ]
64 }
 65 ]
66 }'
67 curl -XPOST -u elastic 'localhost:9200/_security/user/johndoe' -H "Content-Type: application/json"
-d '{
68 "password" : "userpassword",
69 "full_name" : "John Doe",
70 "email" : "john.doe@anony.mous",
71 "roles" : [ "events_admin" ]
72 }'
73 nano /etc/kibana/kibana.yml
74 systemctl daemon-reload
75 systemctl start kibana
76 systemctl enable kibana
77 apt install logstash
78 apt-get install default-jre
79 apt install logstash
80 service logstash start
81 service logstash status

cluvio:-
 SAAS
 BI Tool
 In free ware version only 1 user 3 dashboard possible.

freeboard:-
 OS
 Dashboard Tool
 Only limited widgets available and cant be used for BI

mozaic:-
 OS
 Dashboard Tool
 Not user friendly, extensions and graph widgets have to be added separately.
Jasper Reports:-
 OS and Enterprice editions available
 BI
 Dashboards cant be created in open source version.

zoho reports:-
 SAAS
 BI
 In free ware version a max of 10k rows can be used.

Pentaho:-
 SAAS
 BI
 Dashboards cant be created in open source version.

Seal Report:-
 OS and Enterprise edition available
 BI
 Web report designer and dashboard manager arent part of open source

Tableau:-
 OS and Enterprise edition available
 BI
 In opensource version reports/dashboards can only be saved publicly.

Data iku DSS:-

 Both enterprice and open source version available
 BI tool
Supported Databases:-
 MySQL
 PostgreSQL

Pros:-
 Built-in ETL capabilities
 Python, R, SQL, Shell Data transformations supported with integrated notebook and IDE.
 Custom webapp build capabilities with python backend and access to dataset queries
 ML algorithms like regression, classification, clustering, Automated features preprocessing,
Custom Python algorithms available.
 SQL custom query available
 Builtin authentication available
 Pretty good UI
 User addition available from UI
 Table joins from UI available
 Dynamic Dashboard filtering and column level insights available
 36 graph widgets available
 Multi axis graphs available

Cons:-

 Role based access control not present

 A max of 3 users possible
 Automated refresh of data not available in open source version.

Reference and installation links:-

 https://www.dataiku.com/product/get-started/linux/
 https://doc.dataiku.com/dss/latest/connecting/sql/mysql.html
 https://doc.dataiku.com/dss/latest/installation/jdbc.html
https://support.rackspace.com/how-to/install-mysql-server-on-the-ubuntu-operating-
system/

Installation Steps:-

1. wget https://cdn.downloads.dataiku.com/public/dss/7.0.2/dataiku-dss-7.0.2.tar.gz
2. tar xzf dataiku-dss-7.0.2.tar.gz
3. dataiku-dss-7.0.2/installer.sh -d DATA_DIR -p 11000
4. DATA_DIR/bin/dss start
5. Browse to http://<your server address>:11000.
Tableau:-
 OS and Enterprise edition available
 BI
 code-free analytics not available in free ware version