Professional Documents
Culture Documents
Introduction to
Network Storage
Chapter 1
Storage Technology Primer
Version 1.1
© COPYRIGHTED 2004
Coverage
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 1
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 1: Need for Storage &
Growth of Data
1.1 Need for Storage
1.2 Growth of Data
© COPYRIGHTED 2004
Need for Storage
© COPYRIGHTED 2004
Growth of Data
World Wide Production of Information
200
180
160
140
Exabytes*
120
100
80
60
40
20
0
1997 1998 1999 2000 2001 2002 2003 2004 2005 2006
© COPYRIGHTED 2004
Computer Architecture
Arithmetic/
Control unit
Logic unit
Memory
© COPYRIGHTED 2004
Computer Input and Output
Step 1:
The user presses the letter
T key on the keyboard
T Step 2:
An electronic signal for
the letter T is sent to the
system unit
Step 3:
T Step 4:
The signal for the letter T is
converted to it ASCII binary code
(01010100) and is stored in
After processing, the binary code memory for processing
for the letter T is converted to an image, T
and displayed on the output device.
© COPYRIGHTED 2004
DATA STORAGE
• Data is numerical or other information represented in a form
suitable for processing by computer system. Data can be exist
as electronic signal or stored in certain media.
• All device, media and system which can store data is called
storage or data storage, storage can be a part of a computer
system or network system, may stores data for subsequent use
or retrieval and retain data for some period of time.
© COPYRIGHTED 2004
SECTION 2
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 2:Types of Storage
© COPYRIGHTED 2004
Volatile Storage
• Volatile Storage – A storage device in which the contents are
lost when power is removed.
first in the cache memory and if it finds the data there (from a
previous reading of data), it does not have to do the more time-
© COPYRIGHTED 2004
Non Volatile Storage
Magnetic Optical IC
© COPYRIGHTED 2004
Hard Disk Drive
• A set of electro magnetically
charged disks that stores and
provides fast access to large
data.
© COPYRIGHTED 2004
Hard Disk Drive Road Map
© COPYRIGHTED 2004
ATA Hard Disk Drive
Parallel ATA Interface
© COPYRIGHTED 2004
ATA Hard Disk Drive (cont’d)
• Serial ATA
• SATA, 1st generation or SATA-I
• SATA NCQ (Native Command Queuing), 2nd
generation or SATA-II
© COPYRIGHTED 2004
SCSI HARD DISK DRIVE
• Brief history of SCSI:
• SCSI-1, the first SCSI standard was approved by ANSI in
1986 1986, SCSI-1 standard use only 8 bits bus with
maximum 5 MB/s transfer rate and now obsolete
• SCSI-2, was approved by ANSI in 1994, is an extensive
enhancement of SCSI-1, 10MB/s, 16/32 Bits, More Devices
per Bus
• SCSI-3,
• Fast-wide, 20MB/s,1992,
• Ultra or Fast-20, 40 MB/s 1995,
• Ultra2, or SPI-2, 80 MB/s 1997,
• Ultra3, or SPI-3, 160MB/s 1999
• Ultra320, or SPI-4, 320MB/s 2001
© COPYRIGHTED 2004
SCSI HARD DISK DRIVE (cont’d)
© COPYRIGHTED 2004
SCSI HARD DISK DRIVE (cont’d)
• Ultra320 SCSI Hard Disk Drive Introduction:
• Model: ST3300007LC
• Capacity : 300 GB
• Interface: Ultra320 SCSI
RPM: 10,000
• Seek Time (avg.): 4.7ms
© COPYRIGHTED 2004
Tape Technology
• What is a Tape?
• An external storage medium, usually both readable and
write able.
• A tape drive is the device that positions, writes to, and reads
from the tape.
© COPYRIGHTED 2004
Fast Flash Disk (FFD)
• Fast Flash Disk (FFD) is a non-volatile storage device, base on
flash technology, capacity 512B to 90GB, Maximum R/W:
100MB/s MTBF>700Khr, more than 5M time erase cycle.
Support ATA and SCSI interface.
© COPYRIGHTED 2004
MMC
• The Multi-Media Card (MMC) - ROM technology for read-
only applications and Flash technology for read/write
applications.
• Removable solid-state memory solutions.
• Weigh less than two grams and about the size of a postage
stamp.
© COPYRIGHTED 2004
SECTION 3
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 3:Storage issues & Evolution
© COPYRIGHTED 2004
Storage Issues
© COPYRIGHTED 2004
Storage Issues (cont’d)
© COPYRIGHTED 2004
Evolution of Storage
Management
© COPYRIGHTED 2004
Storage Management Centre
© COPYRIGHTED 2004
SECTION 4
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 4: DAS, NAS, SAN &
CAS
© COPYRIGHTED 2004
LAN – Local Area Network
Unix NT Netware
© COPYRIGHTED 2004
Network Storage Basics
-DAS,NAS,SAN
Direct-attached storage (DAS) Network-attached storage (NAS) Storage area network (SAN)
LAN LAN LAN
File Switch
Disk Server
Disk Disk
The three main storage architectures
© COPYRIGHTED 2004
DAS – Direct Attached Storage
• Storage hardware that connects to a single
server. Also called: Direct Attached
Storage (DAS). DAS is Local storage and
one-to-one relationship.
• Most of storage (about 70%) is connected
via DAS today, but 60% of storage will be
connected via SAN by 2007(IDC)
© COPYRIGHTED 2004
DAS (cont’d)
• Advantage:
• Low cost, Interface of DAS is use of ATA/SCSI , easy to setup and
management,
• easy to use in Client/Server environmental.
• Disadvantage:
• Expansion beyond server’s internal drive capacity.
• DAS can only scale along with the server that it is attached
to, storage resource are assigned to server.
• Lack of interoperability between different platforms,
operating systems and devices
• Sharing storage resource is not provide.
• limited by ATA/SCSI interface connectivity, Operation
distances are shot .
© COPYRIGHTED 2004
Network Storage Evolution
DAS SAN
clients
LAN
Disk drives
NAS
© COPYRIGHTED 2004
NAS - Network Attached
Storage
• Storage subsystem that connects directly to the LAN.
© COPYRIGHTED 2004
Network Attached Storage
Windows Workstations
Protocol Unix Workstations
LAN
CIFS NFS
© COPYRIGHTED 2004
Network Attached Storage -
Benefits
• Work independently without host support
• Centralizes control
• Provide across platform file server
• Minimal downtime
• Streamlined architecture
• Reduced server I/O bottleneck
• Data availability, stored data is shared.
• Efficient allocation and use of resources
• Simplicity
• Increased productivity
• Connectivity
© COPYRIGHTED 2004
Network Attached Storage -
Disadvantages
• Storage traffic travels across the messaging network, So
Network performance is impacted.
• Need protocol (NFS, CIFS etc.) support, can not work in
block level.
• Sharing data is only in file level, can not share resource in
storage device level.
© COPYRIGHTED 2004
SAN - Storage Area Network
© COPYRIGHTED 2004
Definition of SAN
• A network whose primary purpose is the transfer of data
between computer systems and storage elements and among
storage elements. Abbreviated SAN.(SNIA)
© COPYRIGHTED 2004
SAN Building Block
Client
PC’s
LAN
SAN
• Producing reports.
© COPYRIGHTED 2004
Benefits Of SAN
• Pooling of storage devices for better utilization.
• Increase the availability of storage.
• Increased backup performance.
• Increase of operation distance, useful for disaster recovery
and remote mirroring.
© COPYRIGHTED 2004
SAN Disadvantages
• Main weakness of SAN
• Difficult to the interoperability of storage devices between
OS, database and technologies
• Complexity - Difficult to manage the systems
without powerful software to manage the storage
devices.
• Lack of specialised staff resources
• Cost considerations, high startup cost for SME
Scalability, reliability and data protection affects
cost.
• Too many devices and vendors to enumerate.
© COPYRIGHTED 2004
DAS, NAS, SAN Deployment
© COPYRIGHTED 2004
Comparison Table
DAS NAS SAN
ATA/SCSI
Connective Type Cable Network Network
© COPYRIGHTED 2004
NAS Gateway
• NAS Gateway is the control function of NAS without the storage
device.
• The storage is connected (typically using Fiber Channel) to a
SAN where the resources may be shared by other servers and
are managed centrally.
• The usage is still that of a remote file system where the
requesting host redirects file I/O over Ethernet using a
protocol such as NFS or CIFS.
© COPYRIGHTED 2004
NAS vs. NAS Gateway
© COPYRIGHTED 2004
Total Cost of Ownership
• Typically looks at annual cost of systems/solutions :
• Elements of TCO includes :
• Production cost – software and hardware
• Implementation cost
• Training
• Administration ( Operational cost )
• Support- monitoring and tuning
• Maintenance
• Upgrades
• Data Unavailability cost
• Direct – additional support
• Indirect – lost business
© COPYRIGHTED 2004
Content Addressed Storage
• Released in 2002 by EMC
• Refers to storage of fixed content, that is data written once and
never changed or cant be altered in any way.
• Storage schema was designed specifically for keeping fixed
content secure and in place was inevitable.
• CAS provides a digital fingerprint for a stored piece of data.
Also known as an ID or logical address.
© COPYRIGHTED 2004
Requirement of CAS
• Guaranteed integrity and authenticity of information
• Location independent & Long-term retention
• Continuous online and available
• Automatic distribution across devices
• Operation and management of information should be automated
• Singapore context
• MAS rule that financial documents must be retained for 6
years
• Companies Act, all financial records must be maintained for
7 years
• Telecom need to keep their CDRs for 3 years
© COPYRIGHTED 2004
How CAS can Impact Business
• Confront the increasingly stringent business and legal
requirements to store information for decades.
• Storage ecosystem that can alleviate one of today's growing
storage challenge.
• Its core software can manage over decades, extraordinary
amounts of fixed content and to integrate easily with
Independent software vendor applications.
• Modification of existing applications via its application
programming interfaces.
© COPYRIGHTED 2004
How does CAS Work?
• Uses a ‘claim check’ to address objects.
• FCS generates a globally unique identifier (claim check) to later
retrieve the object. The client presents a token and the server
replies with the object.
• The token is a set of ASCII characters. Maybe fixed in length or
varies. Token is a unique string associated with each object in
the system.
© COPYRIGHTED 2004
Content Addressed Storage
Application Database Claim Check Analogy
Object to be stored
Content Storage Box
API
Application Server
Application Data Token
Application Client
© COPYRIGHTED 2004
SAN, NAS & CAS- Comparison
High High
Performance Capacity
Mixed
Performance/Capacity
© COPYRIGHTED 2004
SECTION 5
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 5: Interfaces for Mass
Storage Systems
© COPYRIGHTED 2004
Traditional Interfaces for
Mass Storage Systems
• Fibre Connection (FICON)
• Enterprise Systems Connection (ESCON)
• High Performance Parallel Interface (HIPPI)
• Small Computer System Interface (SCSI)
© COPYRIGHTED 2004
Limitations of Current Mass
Storage Architecture
Data Transfer
Protocols:
SCSI
IPI-3
• Limited Distance
Disk
between Devices Bus, short, few devices,
common signals, half-duplex
Mainframe
Disk
• Limited Number of
Devices Supported 2 x HIPPI Bus, short,two devices, dual-
simplex
Disk array
Super computer
© COPYRIGHTED 2004
Solutions
• Fibre Channel
• iSCSI ( Internet Small Computer System Interface )
• FCIP ( Fibre Channel Over Internet Protocol )
• iFCP ( Internet Fibre Channel Protocol )
© COPYRIGHTED 2004
SECTION 6
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 6: Fibre Channel &
Classes of Service
© COPYRIGHTED 2004
Introduction to Fibre Channel
• High Speed: 2 Gbps, full duplex dedicated connection.
• Provides a general hardware transport vehicle for Upper Level
Protocols (e.g. SCSI, IP, etc)
• Reduced congestion
• Long Distance: Up to 10km.
• Heterogeneous systems support
© COPYRIGHTED 2004
Fibre Channel Architecture
© COPYRIGHTED 2004
The Fibre Channel Network
SCSI Initiator Node
© COPYRIGHTED 2004
Fibre Channel Topologies
Point To Point Arbitrated Loop Switched Fabric
© COPYRIGHTED 2004
Fibre Channel Node and Port
Node: Any device or entity that can initiate and receive transmissions
in a fibre channel network.Eg. Storage device
Port: A fibre Channel port is an intelligent physical hardware that
connects all components to the network.
Switch and hubs are not considered as nodes as they do not initiate
any transmissions.
A node can have multiple ports
Node
N_Port N_Port Port Name=‘2100…
#1 #2 8765
Nodes N_Port_ID = ‘123456’
N_Port NL_Port
#3 #4 Each Port has separate
Transmit and Receive
functions
U_Port U_Port
NL_Port NL_Port
#7 #8
© COPYRIGHTED 2004
Port Visualization
E-Port
Fabric
E-Port
NL-Port
FL-Port
G-Port
NL-Port
Switch 2
Brocade © COPYRIGHTED 2004
Classes of Service
• High speed and Flexible architecture of Fibre Channel enables
it to carry out different applications.eg tape-backup, real-time
video etc.
• Different applications have their own delivery requirements like
bandwidth, connectivity etc.
• Fibre Channel defines 5 classes of service that address
different delivery requirements
• Class 1- Acknowledged Connection Oriented Service
• Class 2- Acknowledged Connection-less Service
• Class 3 - Unacknowledged Connection-less Service
• Class 4 – Fraction Bandwidth Connection Oriented Service
• Class 6 – Multicast Service.
© COPYRIGHTED 2004
Class 1 Service
• Connection-Oriented Class of Service.
• Allows full-bandwidth between a pair of nodes with a
confirmation of delivery and End To End Flow Control
• In-Order delivery of frames due to dedicated connection.
• Best suited for real-time applications like video processing.
• Connections are established and removed at sequence boundaries.
N_Port N_Port
#2 #4
© COPYRIGHTED 2004
Class 2 Service
• Connection-less service class and no bandwidth is reserved.
• Frames are routed by the fabric using internal routing algorithms.
• Do not guarantee In-Order delivery of frames, but there is
confirmation of delivery.
Frame 1:5
N_Port N_Port
#2 #5
© COPYRIGHTED 2004
Class 3 Service
• It is a connection-less and unacknowledged service.
• Frame routing done internally by the fabric.
• Also known as the datagram service, as it is the quickest
transmission without involving the acknowledgement.
• If a frame cannot be processed then, it is discarded without
notification.
© COPYRIGHTED 2004
Class 4 service
• This service is connection-oriented providing a virtual circuit
between a pair of nodes.
• Known as Fractional Bandwidth, as it assigns only a fraction of
the total bandwidth and different QoS parameters for each
connection.
• The QoS parameters for each services ensures that certain time-
critical applications always have bandwidth available.
• Exists only as a standard due to its complexity.
© COPYRIGHTED 2004
Class 6 Service
• Provides reliable multicast service with acknowledged delivery.
• It is only a variation from Class1 service in a way the responses
are processed by recipients of the multicast group.
• A multicast server serves consolidates all acknowledgements,
thereby returning only a single confirmation to the initiator.
• Example, A video broadcast application, with a central video
server and multiple video recipients.
ACK’s
from the
Initiator Connect Fabric Recipient targets
request
N_Port N_Port
N_port
Multicast
N_Port
ACK server
© COPYRIGHTED 2004
SECTION 7
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
SECTION 7:Standards Organizations
© COPYRIGHTED 2004
Fibre Channel Association
• Non-profit, mutual organization of integrators, system
vendors, industry professionals and end users. FCIA
working groups focus on specific aspects of the technology
that target both vertical and horizontal markets, including
storage, video, networking and SAN Management
© COPYRIGHTED 2004
NSIC & SNIA
NSIC – National Storage Industry Consortium
• Consist of fifty universities and national lab with common
interest in the field of digital information storage.
© COPYRIGHTED 2004
SECTION 8
1. Need for Storage & Growth of Data
2. Types of Storage
3. Storage Issues and Evolution of Network Storage
4. DAS, NAS, CAS, SAN
5. Interfaces for Mass Storage Subsystems
6. Fibre Channel & Classes of Service
7. Standards Organization
8. Review Questions
© COPYRIGHTED 2004
Review Questions
• Explain the need for a growth in storage.
• Explain the difference between a DAS, NAS and SAN.
• What are the advantages and disadvantages of SAN?
• What are the components of SAN and how it contributes to the
building of a SAN network?
• What is Fibre Channel and what role does it play in a SAN
network?
© COPYRIGHTED 2004
References
• The evolution of storage: yesterday, today & tomorrow
• Storage Area Network Essentials – Wiley
• SAN, NAS & DAS : The inside story
• O’Reilly SAN vs NAS Decision Factors
• The Economics of a Storage Strategy – Computerworld
• Storage Networking: Back to Basics – Computerworld
• Network Attached Storage Overview – Advanced Media
Services
• Fibre Channel Overview –Seagate
• Introduction to Fibre Channel www.snwonline.com
© COPYRIGHTED 2004