So la ris 1 0

Ra n d y Fis h e l Su n Micro s ys te m s , In c.

Wh a t's UP?

DTra ce Dyn a m ic Tra cin g N1 Grid Co n t a in e rs (a .k.a Zo n e s ) Gre e n lin e / Se rvice Ma n a g e m e n t Fa cility Fa u lt Ma n a g e m e n t Arch ite ct u re AMD6 4 So la ris 1 0 Ne two rkin g Ne t wo rk Pe rfo rm a n ce Fu tu re s Ja va De s kt o p Sys t e m - JDS Ze ta b yte File Sys t e m ZFS Pro je ct Ja n u s Op e n So u rce Us e fu l In fo rm a t io n

So la ris 1 0 De s ig n Prin cip le s

Pe rfo rm a n ce Se cu rity Re lia b ility Ava ila b ility Ma n a g e b ility Se vica b ility Pla tfo rm Ne u tra lity

Dyn a m ic Tra cin g

Pe rfo rm a n ce Bo ttle n e ck Bu s te r
Bre a kth ro u g h a p p ro a ch fo r t u n in g

Po we r to o l fo r re a l- tim e a n a lys is , d ia g n o s is No n in va s ive , little o ve rh e a d , e a s y to u s e On e vie w in to b o th s ys te m a n d a p p lica tio n le ve l Ove r 3 0 ,0 0 0 d a t a m o n ito rin g p o in ts No n e e d t o fo rce fa ilu re , th e n d o p o s tm o rt e m d e b u g No n e e d t o re - cre a te th e p ro b le m o n te s t s ys te m s No n e e d t o ru n d iffe re n t, s lo w, in s tru m e n te d OS in p ro d u ctio n So lu t io n s fo u n d in m in u te s o r h o u rs , n o t d a ys o r we e ks Op tim iz e d a p p s : c a s e s o f 3 - 3 0 x s p e e d u p s a lre a d y s e e n

Sa fe a n d co m p re h e n s ive

De s ig n e d fo r live u s e o n p ro d u ctio n s ys t e m s

Re d u ce d co s t s

Wh y Dyn a m ic Tra cin g ?

We ll- d e fin e d te ch n iq u e s fo r d e b u g g in g f a t a l, n on - rep rod u cib le fa ilu re :

Ob ta in co re file o r cra s h d u m p De b u g p ro b le m p os t m ort em u s in g m d b (1 ), d b x (1 )

Te ch n iq u e s fo r d e b u g g in g t ra n s ien t fa ilu re s a re m u ch m o re a d h o c

Typ ica l te ch n iq u e s p u s h tra d itio n a l to o ls (e .g . tru s s (1 ), m d b (1 )) b e yo n d th e ir d e s ig n ce n te rs Ma n y tra n s ie n t p ro b le m s ca n n o t b e d e b u g g e d a t a ll u s in g e x ta n t te ch n iq u e s

Ex p lo rin g DTra ce

DTra ce is a va ila b le to th e p u b lic s ta rtin g in So la ris Ex p re s s 1 1 / 0 3 :

h t t p :/ / www.s u n .co m / s o ft wa re / s o la ris / s o la ris - e x p re s s

Big Ad m in h a s a p a g e a n d d is cu s s io n fo ru m d e d ica te d to DTra ce :

h ttp :/ / www.s u n .co m / b ig a d m in / co n te n t/ d tra ce

Th e DTra ce An s we rBo o k is a va ila b le fo r p u b lic d o wn lo a d th e re a s we ll

N1 Grid Co n ta in e rs (Zo n e s )

Ba s ic co n ce p t: is o la te d e x e cu tio n e n viro n m e n t w it h in a So la ris in s ta n ce In clu d e s re s o u rce , s e cu rity, fa ilu re is o la tio n Lig h twe ig h t, fle x ib le , e fficie n t On e OS to m a n a g e Co m p o n e n ts :

Re s o u rce m a n a g e m e n t (CPU, m e m o ry, ...) Se cu rity/ n a m e s p a ce is o la tio n (z on es )

N1 Grid Co n ta in e rs (Zo n e s )

Pro vid e s virtu a liz e d OS s e rvice s th a t lo o k like d iffe re n t So la ris in s ta n ce s Is o la te s a p p lica tio n s fro m e a ch o th e r Hid e s th e d e ta ils o f th e u n d e rlyin g OS Pro vid e s a lm o s t a rb itra ry g ra n u la rity in is o la tio n g a n d / o r s h a rin g re s o u rce s Ap p lica tio n e n viro n m e n t is co m p a tib le fo r e x is tin g p ro g ra m s .

Wh e n to d e p lo y Zo n e s

Ho s tile a n d u n tru s two rth y a p p lica tio n s

Ex a m p le : Two we b s e rve rs e a ch b in d in g t o p o rt 8 0 Un tru s te d s o ft wa re t h a t s h o u ld b e is o la te d

Da ta ce n te r co n s o lid a tio n

Mu ltip le d a t a b a s e s wit h d iffe re n t a d m in is tra to rs Co n s o lid a t e m a n y s m a ll cu s t o m e rs o n to a s e rve r g ivin g s o m e o r a ll o f t h e m t h e ro o t p a s s wo rd A ch e a p wa y to s im u la te a s e t o f p ro d u ctio n s ys t e m s , t e s t s o ft wa re in s t a lla t io n , e t c.

Ho s tin g

So ftwa re d e ve lo p m e n t

Grid Co n ta in e rs Blo ck Dia g ra m

global zone
(serviceprovider.com)
foo zone (foo.net) zone root: /aux0/foonet
login services (OpenSSH sshd 3.4) network services (BIND 8.3, sendmail) core services (ypbind, inetd, rpcbind) zcons

blue zone (blueslugs.com) zone root: /aux0/blueslugs

web services (Apache 1.3.22, J2SE) enterprise services (Oracle 8i, IAS 6) core services (ypbind, automountd) /opt/yt zcons

beck zone (beck.org) zone root: /aux0/beck

web services (Apache 2.0) network services (BIND 9.2, sendmail) core services (inetd, ldap_cachemgr) zcons

ge0:1

ce0:2

ge0:2

ce0:1

zoneadmd

zoneadmd

zoneadmd

zone management (zonecfg(1M), zoneadm(1M), zlogin(1), ...) core services

(inetd, rpcbind, ypbind, automountd, snmpd, dtlogin, sendmail, sshd, ...)

remote admin/monitoring
(SNMP, SunMC, WBEM)

platform administration
(syseventd, devfsadm, ...)

storage complex network device (ce0) network device (ge0)

Virtual Platform

/usr

/usr

/usr

Application Environment

Gre e n lin e

Pro b le m :

Ad h o c m e ch a n is m s fo r m a n a g in g s e rvice s : / e t c file s Rc s crip t s Fra m e wo rk fo r s e rvice m a n a g e m e n t Re p o s it o ry fo r co n fig u ra t io n d a ta Ad m in is tra t ive e n a b le / d is a b le co n t ro ls Fin e - g ra in e d a cce s s co n t ro l Lin k b e t we e n a p p lica t io n s a n d FMA

So lu tio n :

Au to m a te d s in g le - n o d e re s t a r t

Wh a ts a Gre e n lin e s e rvice ?

inetd(1 M)

A p e rs is te n tly- ru n n in g a p p lica tio n A n a m e d in s ta n ce o f th e s e rvice e n tity s ch e m a :

n e two rk/ p h ys ica l

Sta rt , s t o p , re s ta rt , h e a lt h / s ta tu s s e rvice m ethods Pro p e rt ie s (b u n d le s ) Re s t a rt re la t io n s h ip (s )

Ex a m p le : In te rn e t re s ta rte r s e rvice

hme0

init.d co d e m e t h o d inetd.conf p ro p e rtie s rc.d o rd e r m ile s to n e d e p e n d e n cy

Sta rt- u p a n d co n fig u ra tio n

To d a y
/dev/*

To m o rro w
lo w- le ve l d e vice s in vo ca tio n , t e rm in a tio n
d e vice s e rvice s s e rvice m e th o d s s e rvice d e p e n d e n cie s m ile s to n e s

n e t wo rk in te rfa ce s
/etc/inittab /etc/init.d/* /etc/rc?.d/* /etc/inet/inetd.conf /etc/system /etc/default/* /etc/inet/* /etc/hostname* /etc/dhcp/* /etc/ppp/*

p ro p e rtie s

s e rvice p ro p e rtie s

file s ys te m p e rm is s io n s NSS b a cke n d s lo ca l file s

s e cu rity re p o s ito ry

e n t ity a u th o riz a tio n s d e le g a t e d ro le s s e cu rity p ro file s DSS d a ta s to re s lo ca l ca ch e

Arch ite ctu re s ch e m a tic

m anagem ent agent o b s e rva b ility agent in e t- s e rvice s e rvice

in e t d (1 M) re p o s ito ry API s vc.co n fig d (1 M) s vc.s t a rt d (1 M)

p ro ce s s co n t ra ct

re p o s ito ry clie n t

in it (1 M)

KERNEL

Pre d ictive Se lf He a lin g

On lin e Re co ve ry with Au to m a te d Se rvice s

Bre a kth ro u g h a p p ro a ch t o s e rvice a va ila b ilit y

Erro r d e te ct io n & a g g re g a tio n , a u t o re co ve ry Co m p o n e n ts p ro a ct ive ly o fflin e d b e fo re fa ilu re Au t o m a t ic s e rvice re s t a rt Dia g n o s is & m it ig a tio n in m illis e co n d s , n o t h o u rs Sim p lifie d e rro r re p o rtin g All s ys t e m & s e rvice in t e rd e p e n d e n cie s re co rd e d a n d co rre la te d Re d u ce d s ys t e m d o wn t im e , in cre a s e d u tiliz a tio n Hig h e r s e rve r- to - a d m in is tra to r ra tio

Re d u ce d d o wn t im e

Re d u ce d co m p le x it y

Re d u ce d co s t s

Pre d ictive Se lf He a lin g Ph a s e 1

So la ris FMA in fra s tru ctu re a n d Fa u lt Ma n a g e r:

Ne w t o o ls fo r a d m in s , o p s , a n d s e rvice Ne w s tru ct u re d lo g file s fo r t e le m e t ry d a ta Live d ia g n o s is u p d a te s wit h o u t re b o o t s

Sta n d a rd iz e d fa u lt m e s s a g in g a g e n t Me s s a g e s lin ke d to n e w cu s to m e r we b s ite Au to m a tic s e rvice re s ta rt (Se rvice Ma n a g e r) Dia g n o s is fo r Ultra SPARC- III, IV CPU a n d Me m o ry Au to m a tic CPU a n d m e m o ry re tire Im p ro ve d s o ftwa re re s ilie n ce to I/ O fa ilu re s

So la ris / AMD6 4

Na tive 6 4 b it a rch ite ctu re fo r AMD6 4 / Op te ro n 6 4 b it e x e cu tio n o n s o m e In te l p ro ce s s o rs Will a ls o ru n 3 2 b it b in a rie s a s So la ris Sp a rc Will ru n 3 2 b it Lin u x b in a rie s u n d e r Ja n u s

Ja va De s kto p Sys te m - JDS

In te g ra te s d e s kto p a n d u s e r p ro d u ctivity to o ls in o n e co m p o n e n t:

Gn o m e 2 .6 Mo z illa 1 .7 Evo lu t io n 1 .4 .6 Sta rOffice 7 PP3 APOC 1 .0 Xo rg x s e rve r (X1 1 r6 .7 )

Ne two rk Pe rfo rm a n ce

Tu rn p e rfo rm a n ce in to co m p e titive a d va n ta g e fo r SMI, p a rtn e rs a n d cu s to m e rs

Ad d p e rfo rm a n ce to So la ris ' re p u t a t io n fo r q u a lity a n d re lia b ilit y Stro n g h o riz o n t a l a n d ve rtica l s ca lb ilit y Ro b u s t o u t o f t h e b o x p e rfo rm a n ce

Im p ro ve n e two rk p e rfo rm a n ce o ve r 2 5 % Op tim iz e TCP/ IP with re s p e ct to e a ch o th e r Op tim iz e d th e IP Cla s s ifie r

Pe rfo rm a n ce Stra te g y
Pa rtn e r with ISVs , IHVs , a n d cu s to m e rs to u n d e rs ta n d a n d a d d re s s p e rfo rm a n ce is s u e s Fo cu s o n im p ro vin g wh o le s ta ck a n d a p p lica tio n p e rfo rm a n ce

Ut iliz e m icro / m a cro b e n ch m a rkin g a n d cu s t o m e r wo rklo a d s

Ex p lo it e m e rg in g HW te ch n o lo g y wh ile b e in g p la tfo rm a g n o s tic

Mu lt it h re a d e d (e .g CMP, SMT, CMT), SSE2 , 6 4 - b it AMD, e tc. 1 0 Gb E, TOE, iSCSI, RDMA, Cryp t o Offlo a d , e tc.

Le ve ra g e s yn e rg y b e twe e n o rg a n iz a tio n s with in Su n to d rive in te g ra te d p e rfo rm a n ce

So la ris 1 0 : Ke y Ne two rk Te ch n o lo g ie s

Fire En g in e : Ove ra ll TCP/ IP p e rfo rm a n ce e n h a n ce m e n t Mu ltiDa ta : Bu lk d a ta th ro u g h p u t Be tte r Ze ro co p y s u p p o rt (ftp s e rve r fa s te r b y 3 0 %) SCTP: Su p p o rt fo r t h e p ro to co l its e lf a n d th e s o cke ts API Fu lly d e p lo ya b le IPv6 Wa n b o o t: Re m o te b o o t m a ch in e u s in g HTTP/ HTTPS

Do e s n o t re q u ire DHCP Wo rks a cro s s fire wa ll

Le a d ville : Fib re ch a n n e l o n x 8 6

FE - IP Cla s s ifie r

Us e a co n n e ctio n cla s s ifie r e a rly in IP fo r in co m in g p a cke t Th e co n n e ctio n s tru ctu re ('co n n p ') co n ta in s a ll th e n e ce s s a ry in fo rm a tio n :

Th e CPU/ s q u e u e o n wh ich th e p a cke t n e e d s to b e p ro ce s s e d Th e s trin g o f fu n ctio n s n e ce s s a ry to p ro ce s s th e p a cke t

Ne two rk Pe rfo rm a n ce Fu tu re s

Ne m o :

Dyn a m ic s witch in g b e t we e n in te rru p t a n d p o llin g 1 0 Gb p s NIC s u p p o rt Vla n a n d Tru n kin g s u p p o rt fo r th e m a s s e s

Fa r e a s ie r t o cre a te d rive rs NCA m e rg e to Fire En g in e (NL7 C) UDP p e rfo rm a n ce (yo s e m ite ) TOE a n d o th e r o fflo a d s u p p o rt As yn ch ro n o u s s o cke t s u p p o rt SIP - p ro x y, re d ire ct a n d re g is tra r s e rve rs Dia m e te r a n d RTP ....

Ne m o : GLD v3

Ne x t ve rs io n o f GLD (fo r Sp a rc a n d x 8 6 ) Tru n kin g , vla n , d yn a m ic p o llin g , ch a in in g s u p p o rt Hig h p e rfo rm a n ce fra m e wo rk La rg e s e g m e n t o fflo a d s u p p o rt Will m a ke writin g d e vice d rive r a b re e z e

Dyn a m ic File s ys te m (ZFS)

Po o le d s to ra g e
Co m p le t e ly e lim in a te s t h e a n t iq u e n o tio n o f vo lu m e s Do e s fo r s to ra g e wh a t VM d id fo r m e m o ry

En d - to - e n d d a ta in te g rity
His t o rica lly co n s id e re d t o o e x p e n s ive Tu rn s o u t , n o it is n 't An d t h e a lte rn a tive is u n a cce p ta b le

Eve ryth in g is tra n s a ctio n a l

Ke e p s t h in g s a lwa ys co n s is te n t o n d is k Re m o ve s a lm o s t a ll co n s tra in ts o n I/ O o rd e r Allo ws u s t o g e t h u g e p e rfo rm a n ce win s

FS/ Vo lu m e vs . ZFS
Tra d itio n a l Vo lu m e s

ZFS Po o le d Sto ra g e

Ab s t ra ct io n : virtu a l d is k Pa rtit io n / vo lu m e fo r e a ch FS Gro w/ s h rin k b y h a n d Ea ch FS h a s lim it e d b a n d wid t h St o ra g e is fra g m e n te d , s t ra n d e d

Ab s tra ctio n : m a llo c/ fre e No p a rtit io n s t o m a n a g e Gro w/ s h rin k a u to m a tica lly All b a n d wid t h a lwa ys a va ila b le Po o l a llo ws s p a ce t o b e s h a re d

FS Vo lu m e

FS Vo lu m e

FS Vo lu m e

ZFS

ZFS Sto ra g e Po o l

ZFS

Pro je ct Ja n u s Lin u x Bin a ry Co m p a tib ility

Ru n Lin u x a p p lica tio n s n a tive ly o n So la ris x86 Sta n d - a lo n e e x e cu ta b le s re q u ire n o a d d itio n a l s u p p o rt Ava ila b le in So la ris 1 0 u p d a te 1

Op e n So u rce

Mo re in te g ra tio n o f Op e n So u rce s o ftwa re in to So la ris Mo re o f So la ris in tro d u ce d in to th e Op e n So u rce co m m u n ity Co m m u n ity d e ve lo p e rs s o o n ca n co n trib u te to So la ris

Us e fu l In fo rm a tio n

h ttp :/ / www.s u n .co m / b ig a d m in / x p e rts / h ttp :/ / www.s u n .co m / b ig a d m in / fe a tu re s / a rticle s / m e e t_a rch ite cts .h tm l h ttp :/ / www.s u n .co m / b ig a d m in / co n te n t/ d tra ce

So la ris 1 0
So o n , a t a lo c a t io n n e a r y o u
Su n Micro s ys te m s , In c.

Qu e s tio n s ?

Su n Micro s ys te m s , In c.