WSV315

Diving into SMB 3.0

Jerome Brown
Technical Specialist, Olikka
Olikka is a specialist systems integrator

We are experts in
Infrastructure Management and Virtualization

We specialize in the
Design and Deployment of
Microsoft and Citrix software

We focus on two areas

Private Cloud and Windows Client
Why?
 What the Business What the CIO What the Windows Admin
thinks the SAN is thinks the SAN is thinks the SAN is

What the Project Manager What the Vendor What the SAN does
thinks the SAN is sells the SAN as
What is SMB?
Server Storage in Windows Server 2012

Design target: Parity with key values of best-in-class SAN storage

Equivalent availability and reliability
Enterprise
storage Competitive performance and CPU overhead
on industry- Application-consistent backups
standard
server Substantially lower cost – acquisition,
hardware deployment, and operation
Substantially better serviceability and data
management model
Easier to deploy and manage
SQL TPC-C Benchmark
Transactions per second
4315 (100%) 4270 (98.95%)

1175 (27.23%)

Direct (4Gbps FC) SMB 2 (1 GbE) SMB 3 (1 GbE)

A Brief History of SMB
SMB – IBM Technical Reference 6322916 (1984)
Renamed to CIFS in 1996
SMB over TCP/IP – Windows 2000 (1999)
SMB 2.0 – Windows Vista / Server 2008 (2006)
Improved scalability
Improved performance; larger reads/writes
More secure
SMB 2.1 – Windows 7 / Server 2008 R2 (2009)
File leasing improvements
Larger MTU support
BranchCache
Common SMB 2.x Bottlenecks
CPU for TCP/IP processing
Network bandwidth
Alleviated with teaming, but unsupported
Slow timeouts
Active/Passive clustering
How?
SMB Direct
High speed, low latency networking through RDMA
Cheaper alternative to FC Only used for SMB in Server 2012

Bypass the CPU Requires RDMA NICs

Currently up to 56 Gbps InfiniBand, iWARP & RoCE
Transparent to applications

$/NIC port $/switch port $ total/port MBs/port $/MB

1Gb Ethernet on-board $25 $25 110 $0.23
10Gb Ethernet $300 $674 $974 1100 $0.89
56Gb InfiniBand $790 $243 $1,033 5600 $0.18
8G Fiber Channel $950 $933 $1,883 750 $2.51
* Based on Hewlett Packard US list prices on 15 May 2012
SMB Multichannel
Multiple connections per SMB session
Full Throughput Sample Configurations
Bandwidth aggregation with multiple NICs Multiple 1GbE NICs Single 10GbE
RSS-capable NIC
Multiple 10GbE
in a NIC team
Multiple RDMA NICs
(cannot be teamed)
Multiple CPUs cores engaged when using
Receive Side Scaling (RSS)
SMB Client SMB Client SMB Client SMB Client

Automatic Failover RSS NIC Teaming

NIC NIC NIC NIC NIC NIC NIC
1GbE 1GbE 10GbE 10GbE 10GbE 10GbE/IB 10GbE/IB
Implements end-to-end failure detection
Leverages NIC teaming if present, but Switch Switch Switch Switch Switch Switch Switch
does not require it 1GbE 1GbE 10GbE 10GbE 10GbE 10GbE/IB 10GbE/IB

NIC NIC NIC NIC NIC NIC NIC

1GbE 1GbE 10GbE 10GbE 10GbE 10GbE/IB 10GbE/IB

Automatic Configuration RSS NIC Teaming

SMB Server SMB Server SMB Server SMB Server

Detects and uses multiple network paths

* Vertical lines are logical channels, not cables

SMB Multichannel
Hyper-V Configuration
Virtual
Hyper-V Server Machines
2+ NICs Scale-Out File Server

Teamed with
Multichannel

Multichannel Multichannel
Teaming Teaming
Optional Optional
Storage &
Storage &
Management Management
2+ NICs
4+ NICs
demo

SMB Multichannel
Availability
SMB Transparent Failover
Server 2008 R2 Server 2012
SQL or Hyper-V Server SQL or Hyper-V Server

1 3 1 3

\\fs1\share \\fs1\share \\fs1\share \\fs1\share

2 2

File Server Node A File Server Node B File Server Node A File Server Node B

Server 2008 R2 File Server Cluster Server 2012 File Server Cluster

1 Normal operation 1 Normal operation

2 Failover share and connections and handles lost 2 Failover to node B

3 Administrator intervention needed to recover Connections and handles auto recovered

3 Application IO continues with no errors
SMB Transparent Failover
New components Witness Witness

SMB 3.0 Client Protocol Service

User

Client operation replay Kernel

End-to-end support for replay of Witness

SMB 3.0 Server

read, write and delete operations Client

User User

SMB 3.0 Server Kernel Kernel

Support for network state Operation replay SMB 3.0

State
persistence
persistence SMB 3.0 Redirector
Protocol
SMB 3.0 Server
Files are always opened Write-
Resume Key Filter
Through
File System

SMB 3.0 Client SMB 3.0 Server

SMB Transparent Failover
New components Witness Witness

Resume Key Protocol Service

User

Resume handle state after planned Kernel

or unplanned failover SMB 3.0 Server

Witness
Fence handle state information Client

Mask some NTFS failover issues User User

Kernel Kernel

Witness Service Operation replay

State
SMB 3.0 persistence
Proactive notification of server SMB 3.0 Redirector
Protocol
SMB 3.0 Server
failure
Resume Key Filter
Enables dynamic reallocation of
load File System

SMB 3.0 Client SMB 3.0 Server

SMB Scale-Out File Servers
Designed for application storage

Active-Active file server cluster

Increased bandwidth Single Logical File Server (\\fs\share)

CHKDSK with zero downtime

Simpler management Single File System Namespace

Cluster Shared Volume

SAN or JBOD shared storage
Continuously available shares
Low-metadata workloads only Scale-Out File Server
SMB Scale-Out File Servers

Scale-Out
File Server
Ethernet
Cluster

Hyper-V Cluster Clustered PCI RAID

SAS Extenders

JBOD
Array
Management
VSS for SMB 3.0 File Shares
Backup application data Backup
Server G
stored on SMB 3.0 file Read from
Shadow Copy
Backup Share
shares A

Same process as local File Share Shadow Copy Agent

backups Backup Agent

E Request Shadow Copy

B Coordinate Shadow Copy Volume Shadow Copy Service

D
F
Requires support from Volume Shadow Copy Service Relay Create Shadow Copy
Shadow

backup solution Create Shadow Copy C Copy

request
VSS Providers

Supported in DPM 2012 SP1 File Share Shadow Copy Provider

\\fs\foo \\fs\foo@{GUID}
Data volume Shadow Copy

Application Server File Server

SMB Encryption
Encrypt sensitive data in transit
Company financials
Executive data

Configure per share or server Client Server

Only SMB 3.0 clients can access

SMB Encryption
Hardware accelerated
Industry standard AES
BranchCache V2
Variable sized chunks
Same chunks as Deduplication
SMB Directory Leasing
Simpler Group Policy management
Automatic configuration of hosted cache servers
Cache preloading
Multiple hosted cache servers per site
V2 chunks are incompatible with V1
Can generate both V1 and V2 chunks
SMB PowerShell CmdLets
SMB Share SMB Mapping
Get, New, Set, Remove Get, New, Remove
SMB Share Access SMB Connection
Get, Grant, Revoke, Block, Unblock Get
SMB Configuration SMB Network Interface
Get, Set for Server, Client Get for Server, Client
SMB Session SMB Multichannel Connection
Get, Close Get, Update
SMB Open File SMB Multichannel Connection
Get, Close New, Get, Remove
SMB Witness Client
Get, Move
Put it into pratice
Flexible Storage Options
…
…

or or

2 node ‘cluster-in-
Single discrete Clustered discrete a-box (CiB) with 4 node Shared SAS External Storage Array
system systems integrated storage ‘cluster-in-a-box’ JBOD

Small Business and Branch

Midmarket and Departmental
Enterprise and Hosted Cloud

Internal HW RAID Clustered PCI RAID Clustered PCI RAID Fibre Channel or IP SAN
or Windows virtualized or Windows virtualized storage (Storage Spaces) or Windows virtualized storage (Storage
storage (Storage Spaces) Spaces)
Single node 2 nodes 3 to 8+ nodes with CSV v2 scale-out 3 to 64 nodes with CSV v2 scale-out
*HW RAID node support partner-dependent
Shared JBOD SAS Shared JBOD SAS (discrete or CiB) Shared JBOD SAS (discrete or CiB) External Storage Array

Integrated SAS switch in JBOD SAS switch and fabric FC or IP SAN Fabric

 Virt: Hyper-V Server  Virtualization: Hyper-V Server  Virtualization: Hyper-V Server  Virtualization: Hyper-V Server
 IW: File Server shares  Info worker: File Server shares
 Datacenter NAS: FS for Hyper-V, SQL, IIS  Datacenter NAS: FS for Hyper-V, SQL, IIS  Datacenter NAS: FS for Hyper-V, SQL, IIS
 Applications: SQL Server  Applications: SQL Server  Applications: SQL Server
Application Storage On SMB Shares
SQL Server Hyper-V (3+)

Database Files: SQL 2008 R2 +

System Databases: SQL 2012 +
demo

Hyper-V & SQL Over SMB

Storage Abstraction
Manage shares not LUNs
ACLs instead of LUN masking and zoning

Upgrade applications and storage independently

Simplify automation

Scale easier
What is the SAN?
SMB 3.0 storage is … SMB 3.0 supports …
Faster Hyper-V
More available SQL
Resilient Documents
Secure <Insert your application here>
Cost effective
Manageable
What is SMB?
Related Content
Breakout Sessions
VIR311 Comparing Core Virtualization Platforms
WSV313 Architecting Private Clouds Using Server 2012
VIR316 Comparing Private Cloud Capabilities
WSV316 File System Enhancements: ReFS and Storage Spaces
WSV321 NIC Teaming and Multichannel Solutions
WSV325 File and Storage Services Management

Find Me Later At…

Twitter @oWretch or @OlikkaTech
Blog http://bolikka.com
 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the
part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.