BI DEVOPS

Jens Vestergaard, CatMan®Solution

Fair Warning:
Slight overlap w/: Agile BI from the cloud with Team Foundation Services by Sander Hoeff from yesterday
More detail on SSAS Tab: Analysis Services in times of Continuous Integration – How to keep up with modern standards by Gabi Münster later today
THANKS TO ALL SPONSORS!

EVENT SPONSORS

EXPO SPONSORS

EXPO LIGHT SPONSORS

 MEET ME AT THE COMMUNITY
• After this session, you can speak with me in the ZONE
Community Zone

• WE MIGHT
• Discuss additional questions
• Review parts of my session in more detail
• Network
• Take selfies… 
 AGENDA
Process MS Tools – GOTCHA’s
• Five steps to Nirvana • Integration Services
• Analysis Services
• Reporting Services Brief Tour MS Tools
• SQL Relational Engine
• MSTest

Tools in General
• Git
• Octopus
Questions Wrap-up – 5 mins. • Pester
• Team City
•…
 ABOUT.ME/JENSVESTERGAARD

jv@t-sql.dk

@vestergaardj t-sql.dk

CatMan®Solution

Jens Vestergaard powerbi.dk

 TEMPERATURE OF AUDIENCE
• How many are using some kind of code repository?
• How many are building (any solution) on check-in?
• How many are testing automatically?
• How many are deploying automatically into production?
PROCESS
 TO DEVOPS AND BEYOND

Operability?

DevOps

Continuous
Delivery
Continuous
Integration
Manual
Deployment
MANUAL
DEPLOYMENT
Leads to

Fear

Anger

Hate

Suffering
 TO DEVOPS AND BEYOND

Operability?

DevOps

Continuous
Delivery
Continuous
Integration
Manual
Deployment
CONTINUOUS INTEGRATION
Single Code Repository

Automate Builds

Every Commit to baseline is built

Keep Build fast

Automate Deployment

Test in a clone environment

 TO DEVOPS AND BEYOND

Operability?

DevOps

Continuous
Delivery
Continuous
Integration
Manual
Deployment
CONTINUOUS
DELIVERY

As Continuous Integration

+ Automatic Deploy to Production

• Delivery Team
• Version Control
• Build & Unit Test
• Automated Acceptance Tests
• User Acceptance Tests
• Release
 TO DEVOPS AND BEYOND

Operability?

DevOps

Continuous
Delivery
Continuous
Integration
Manual
Deployment
 Continuos
Business Planning DEVOPS
Feedback & Collaborative
Optimization Development

Continuos
Continuos Testing
Monitoring

Continuos Release
& Deployment
 TO DEVOPS AND BEYOND

Operability?

DevOps

Continuous
Delivery
Continuous
Integration
Manual
Deployment
 OPERABILITY

Pace of Reliability
Features & Uptime
 DEVOPS AS A CULT

Development Operations

Development DevOps Operations

DEVOPS AS PHILOSOPHY

DevOps
 STATE OF MIND
Prioritisation of operational requirements

Automated infrastructure

Deployment health checks

Pervasive telemetry

Failure injection

Incident swarming 

Blameless post-mortems

Shared on-call responsibilities

 STATE OF MIND

By removing Blame, you remove Fear;

By removing Fear, you enable Honesty;
and Honesty enables Prevention.
Bethany Macri, Etsy; Creator of Morgue tool
https://github.com/etsy/morgue
MS TOOLS
VISUAL STUDIO ONLINE (VSO)
 PROCESS FEATURES IN VSO

Assign Approvers

Deployment Conditions

Clone Environments

Define Triggers

Retention Policies

Keep Track of History

…
 THREE STEPS TO SUCCESS

Install and Configure a Hosted Build Agent

Create a Build Definition Locally

Setup a Visual Studio Online Release

Prerequisites:
• TFS License (hosted build agents are ~ $15 – source)
• Visual Studio Online Subscription (free)
• Visual Studio Data Tools (free)
 $$$

Users Build
POWER BI
• https://powerbi.microsoft.com/en-us/docume
ntation/powerbi-content-pack-visual-studio/
 INTEGRATION SERVICES
• EncryptSensitiveWithPassword or EncryptAllWithPassword
• SSISDB
• Environments
• BIML
• DTEXEC/ISDeploymentWizard.exe vs MSBuild
• http://sqlsrvintegrationsrv.codeplex.com/
 ANALYSIS SERVICES
• Gabi Münster – Particularly on Tabular - 02:45pm - 03:45pm
• Analysis Services in times of Continuous Integration

• SSAS (both MD & Tab)

• Create Artifact via Codeplex (.asdatabase)
• Deploy to Processing/Staging Server
• Synchronize to UAT/Test/Production

• Five (5) ways of deploying SSAS

• XMLA*, Synchronize, Backup/Restore, AMO* & Wizard*
 DEPLOYMENT WIZARD
Microsoft.AnalysisServices.Deployment.exe

• Answer File Mode

• Generates
• .deploymentoptions
• .deploymenttarget
• assecurityinformation
• .configsettings
• Silent Mode
• Runs the deployment silently
• Output Mode
• Generate xmla
 REPOTING SERVICES
• Report Manager

• Stand Alone
• PowerShell / C#
• Deploy / Upload Reports
• Sharepoint Integrated Mode
• PowerShell
• Deploy / Upload Reports
• PowerShell
• Registering Data Sources
• PowerShell
• Re-link to Shared Datasets
 DATA WAREHOUSE
• SQL Server Data Tools Project
• DAC publish & SQL Package.exe
• Natively Supported in VSO
 MSTEST
pushd "$env:VS140COMNTOOLS"
cmd /c "vsvars32.bat&set" |
foreach {
if ($_ -match "=") {
$v = $_.split("="); set-item -force -path "ENV:\$($v[0])" -value "$($v[1])"
}
}
popd
write-host "`nVisual Studio 2015 Command Prompt variables set." -ForegroundColor Yellow
$TestResultStamp = Get-Date -Format yyyyMMdd-HHmmss

mstest /TestContainer:C:\SSAS\Scripts\CMS_UnitTests.dll
/ResultsFile:C:\SSAS\Scripts\Output\CMS_UnitTests_$TestResultStamp.trx
DEMO – VSO & TEST
OTHER TOOLS
 OTHER TOOLS
GITHUB
• Code Repository
• http://github.com/

OCTOPUS DEPLOY
• Parallel Application Distribution, Env. Specific Conf.
• https://octopus.com/

PESTER (PS)
• BDD - Behaviour Drive Testing
• https://github.com/pester/Pester

PSAKE
• Build Automation (now with less XML)
• https://github.com/psake/psake

TEAM CITY
• Continuous Integration Out-of-the-Box
• https://www.jetbrains.com/teamcity/

NBi (NUnit)
• Test Framework
• http://www.nbi.io/

DIMODELO
• Data Warehouse Deployment
• http://www.dimodelo.com

Chef
• Infrastructure
• https://www.chef.io/chef/

Jenkins
• Build, Test & Deploy
• https://jenkins.io
PLEASE EVALUATE ALL SESSIONS!

http://speakerscore.com/NEX17