Sun 1 Feb15
Sun 1 Feb15
2
Notice
The information contained within this document is strictly confidential and subject to change without notice.
This document is distributed directly and under agreement restricting the use, copying, distribution and
decompilation. No part of this document may be reproduced in any form by any means without the prior written
authorisation of Agilitas IT Solutions Limited.
Documentation is provided ‘as is’ and all expressed or implied conditions and representations, including any
implied fitness for a particular purpose or non -infringement are disclaimed, except to the extent that such
disclaimers are held to be legally invalid.
3
This page is intentionally blank
4
Contents
Preface 7
Solaris introduction
4 Install Solaris – Text Terminal Day 2 53
Install Solaris – Graphics Screen
5
This page is intentionally blank
6
Preface
Training with Agilitas
Agilitas develops training programmes that aim to provide delegates with the
skill set necessary to identify the features and architecture specifics of the Sun
range of servers and storage.
Courses are held in one of our two custom built training suites and provide a
combination of hands on and class taught workshops. This training method
allows delegates to gain invaluable experience of the technology in an
environment optimised for learning.
The computer room at Agilitas is extensively furnished with current and legacy
technology.
Workstations Ultra 5
Ultra 10
Ultra 60
Ultra 80
SunBlade 1000 and 2000
SunBlade 1500 and 2500
Ultra 20
Ultra 40
Ultra 24
Ultra 27
Please note that a minimum of 4 weeks should elapse between course attendances.
7
This page is left intentionally blank
8
Section 1
Hardware naming conventions
9
This page is left intentionally blank
10
Section 1 – Hardware naming conventions
11
This page is intentionally blank
12
13
14
15
16
Section 2
Common hardware basics
17
This page is intentionally blank
18
Section 2 – Common hardware basics
If your Sun system has a full graphics screen, keyboard and mouse, all
diagnostic information will be output on the graphics screen, and all user
interaction will be through the keyboard and mouse.
Older Sun systems have 2 unmanaged serial ports labelled A and B, known as
ttya and ttyb (tty = teletype) and the output from Power On Self Test (POST)
is from ttya.
Newer Sun systems have a Serial Management port in addition to one or two
serial ports. In these systems, all management is via the Serial Management
port.
Port Settings
9600 baud
8 bit
1 stop bit
no parity
Most unmanaged ports use 25-way or 9-way D type connectors and you may
need to vary the cable pin-outs depending on the system you want to connect
to.
For managed ports a Cisco Rollover cable (supplied with this course) will
work.
http://www.chiark.greenend.org.uk/
19
Connecting using an Apple Mac
sudo bash
password
cu –l /dev/cu.usbdriver -s 9600
Connected
Use the ttya port on the system you are connecting from.
Within the connecting system’s Solaris, login as root, then edit the
/etc/remote file. Change hardwire from /dev/term/ to /dev/term/a as below:
20
:el=^Z^U^C^S^Q^O:du:at=hayes:ie=$@:oe=^Z:br#1200:tc=dialers:
dialers:\
:dv=/dev/cua/b:
--------------------------------------------------------------------
The attributes are:
To connect:
connected
Power ON
Verifying NVRAM...Done
Bootmode is 0
[New I2C DIMM address]
MCR0 = 57b2ce06
MCR1 = 80008000
MCR2 = cf3000ff
MCR3 = a00000cf
Ecache Size = 512 KB
NVRAM Test
Icache Test
Dcache Test
MMU Test
FPU Test
Ecache Tag Addr Test
Ecache RAM Addr Test
Clearing E$ Tags Done
Clearing I/D TLBs Done
Probing memory
Done
MEMBASE=0x40000000
MEMSIZE=0x20000000
Data Line Test
Core Memory Test
Clearing memory...including Unix retained memory...Done
Turning ON MMUs Done
Copy ROM to RAM (170040 bytes) Done
Orig PC=0x1fff0007e44 New PC=0xf0f07e9c
21
Processor Speed=648MHz
Memory Data Line Test
Memory Addr Line w/ Ecache Test
ECC Block Memory Test
Looking for Dropin cPOST ... found
Copying Client...Done
Transferring control to Client...
Init PCI
22
MEMBASE=0x40000000
MEMSIZE=0x20000000
Clearing memory...Done
Turning ON MMUs Done
Copy ROM to RAM (170040 bytes) Done
Orig PC=0x1fff0007e44 New PC=0xf0f07e9c
Processor Speed=648MHz
Looking for Dropin FVM ... found
Decompressing Client Done
Transferring control to Client...
ttya initialized
Reset Control: BXIR:0 BPOR:0 SXIR:0 SPOR:1 POR:0
Probing upa at 1f,0 pci pci pci
Probing upa at 0,0 SUNW,UltraSPARC-IIe SUNW,UltraSPARC-IIe (512 Kb)
Loading Support Packages: kbd-translator
Loading onboard drivers: ebus flashprom eeprom idprom SUNW,lomh
Probing /pci@1,1 Device 3 pmu i2c temperature dimm dimm i2c-nvram
idprom motherboard-fru fan-control
lomp
Probing Memory Bank #0 512 Megabytes
Probing Memory Bank #1 512 Megabytes
Probing Memory Bank #2 0 Megabytes
Probing Memory Bank #3 0 Megabytes
Probing /pci@1,1 Device 7 isa power serial se rial
Probing /pci@1,1 Device c network firewire usb
Probing /pci@1,1 Device 3
Probing /pci@1,1 Device d ide disk cdrom
Probing /pci@1,1 Device 5 pci108e,1100 network firewire usb
Probing /pci@1 Device 8 scsi disk tape scsi disk tape
Probing /pci@1 Device 5 SUNW,Expert3D
Probing /pci@1 Device 6 Nothing there
Probing /pci@1 Device 7 Nothing there
? not found.
keyboard not found.
Reset Control: BXIR:0 BPOR:0 SXIR:0 SPOR:1 POR:0
Probing upa at 1f,0 pci pci pci
Probing upa at 0,0 SUNW,UltraSPARC-IIe SUNW,UltraSPARC-IIe (512 Kb)
Loading Support Packages: kbd-translator
Loading onboard drivers: ebus flashprom eeprom idprom SUNW,lomh
Probing /pci@1,1 Device 3 pmu i2c temperature dimm dimm i2c -nvram
idprom motherboard-fru fan-control
lomp
Probing Memory Bank #0 512 Megabytes
Probing Memory Bank #1 512 Megabytes
Probing Memory Bank #2 0 Megabytes
Probing Memory Bank #3 0 Megabytes
Probing /pci@1,1 Device 7 isa power serial serial
Probing /pci@1,1 Device c network firewire usb
Probing /pci@1,1 Device 3
Probing /pci@1,1 Device d ide disk cdrom
Probing /pci@1,1 Device 5 pci108e,1100 network firewire usb
Probing /pci@1 Device 8 scsi disk tape scsi disk tape
Probing /pci@1 Device 5 SUNW,Expert3D
Probing /pci@1 Device 6 Nothing t here
Probing /pci@1 Device 7 Nothing there
Note with the diag-switch set to true, the default boot device is the network.
23
Lights Out Management
If you are dealing with a Serial Management port, the initial connection will
be to a management device such as a Lights Out Management (LOM) card or
a System Controller (SC). The LOM or SC can display system information, but
the functionality of the LOM or SC varies from system to system. The LOM or
SC can also be used to open a console session to the system itself.
There are variants within these flavours depending on the version of the
individual LOM software and of the system model. The models covered in this
course don’t use ELOM.
24
LOM implementation by model
25
LOM Commands
Each flavour of LOM has a set of commands that are entirely different from
the other flavours. The commands are listed in the Sun documentation for
that flavour of LOM and there are help functions within the live LOM
instance. Each LOM requires the user to log in. For best security the system
administrator should have changed and recorded the LOM passwords, but
there are factory set ones that may work. The most useful and most used
LOM function is to open and close a console session into the system itself.
26
Example of LOMlite interaction
LOMlite console
ok
lom>loghistory
Eventlog:
+20h37m1s host power off
+1d+16h18m30s user added 1
+1d+16h19m0s user password changed 1
+1d+16h19m19s user permissions changed 1
+1d+16h22m38s host power on
+1d+16h24m19s host power off
+1d+16h24m26s host power on
+1d+16h27m58s host power off
+1d+16h32m26s user logout 1
+1d+16h32m38s user login 1
lom>showlogs
Eventlog:
+20h37m1s host power off
+1d+16h22m38s host power on
+1d+16h24m19s host power off
+1d+16h24m26s host power on
+1d+16h27m58s host power off
lom>
27
To power-on the system
lom>poweron
lom>
LOM event: +1d+16h24m26s host power on
? not found.
keyboard not found.
ok
Use break sequence #. to return to lom.
ok #.
Set the bootmode to forth to stop the system booting ie stop at the ok prompt
lom>bootmode
bootmode normal
lom>set bootmode forth
lom>bootmode
bootmode forth
lom>poweron
lom>
LOM event: +1d+16h51m14s host power on
?Aborting startup sequence because of lom bootmode "forth".
Input and output on ttya.
Type exit to resume normal startup sequence.
Type help for more information
28
ALOM – login and commands
or
sc>
Help help
To open a console console
To exit a console #. (hash dot)
poweron [-c] {FRU}
poweroff [-y] [-f]
removefru [-y] {FRU}
reset [-y] [-x] [-c]
break [-y] [-c]
bootmode
[normal|reset_nvram|diag|skip_diag|bootscript="string"]
console [-f]
consolehistory [-b lines|-e lines] [-g lines] [-v] [boot|run]
showlogs [-b lines|-e lines] [-g lines] [-v]
setlocator [on|off]
showlocator
showenvironment
showfru
showplatform [-v]
showsc [-v] [param]
shownetwork [-v]
setsc [param] [value]
setupsc
showdate
setdate [[mmdd]HHMM | mmddHHMM[cc]yy][.SS]
resetsc [-y]
flashupdate [-s IPaddr -f pathname] [-v]
setdefaults [-y] [-a]
useradd
userdel [-y]
usershow [username]
userpassword
userperm [c][u][a][r]
password
showusers [-g lines]
logout
help [command]
29
Example of ALOM interaction (on a Sun V1280)
lom> setupnetwork
Network Configuration
---------------------
Is the system controller on a network? [yes]:
Use DHCP or static network settings? [DHCP]: static
Hostname []: 1280-sc IP Address []: 172.20.40.55
Netmask []: 255.255.0.0
Gateway []: 172.20.88.1
DNS Domain []: uk.sun.com
Primary DNS Server []: 172.20.33.22
Secondary DNS Server []: 172.20.33.31
Connection type (ssh, telnet, none) [none]: telnet
Rebooting the SC is required for changes in network settings to take
effect.
lom>
lom> resetsc
Are you sure you want to reboot the system controller now? [no] yes
Waiting for critical processes to finish. This may take a while. Critical
processes have finished.
Rebooting. All network client connections closed. Reestablish any
needed connections.
Mon Oct 25 12:24:31 noname lom: Stopping all services on this SC
Mon Oct 25 12:24:31 noname lom: All services on this SC have been
stopped.
Software Reset...
@(#) SYSTEM CONTROLLER(SC) POST 41 2004/08/18 09:31 PSR =
0x044010e5 PCR = 0x04004000
Memory size = 32MB
Basic sanity checks done. Skipping POST ... ERI Device Present Getting
MAC address for SSC1
Using SCC MAC address
MAC address is 00:03:ba:c0:ff:ee
Hostname: 1280-sc Address: 172.20.40.5
Netmask: 255.255.0.0
Attached TCP/IP interface to eri unit 0 Attaching interface lo0...done
Gateway: 172.20.88.1
interrupt: 100 Mbps full duplex link up
Sun Fire System Firmware
RTOS version: 41
ScApp version: 5.18.0 Build_14
SC POST diag level: off
The date is Monday, October 25, 2004, 12:25:08 PM CEST.
Mon Oct 25 Mon Oct 25 Mon Oct 25 Mon Oct 25 Mon Oct 25 Mon Oct
25 Mon Oct 25 Mon Oct 25 Mon Oct 25
Connected.
lom>
30
Another example (this time on a T2000 )
sc> resetsc
31
ILOM – login and commands
ILOM is more complex than either LOMlite or ALOM. It’s a LINUX variant
that boots from a chip. It has a file and directory structure, and the
commands are embedded in the structure. You need to navigate around to
find the commands you want to run.
The CLI is usable via the Serial Management port with no further
configuration.
Or
-> start /SP/console
32
The BUI is designed to be used as part of a system control network, whereby
a remote system administrator can power cycle systems etc without being on-
site The Network controller must be set up before BUI is usable
To setup network on the system controller connect via the serial port:
login:root
password:changeme
-> cd /SP/network
-> set pendingipaddress=192.168.2.2
-> set pendingipnetmask=255.255.255.0
-> set pendingipgateway=192.168.2.1
-> set pendingipdiscovery=static
-> set commitpending=true
hpps://192.168.2.2
#ssh root@192.168.2.2
If you have a Sun Type 4 or Type 5 keyboard plugged in, the LEDs can be
useful.
33
34
35
36
Section 3
Open Boot Prom (OBP) and BIOS
37
This page is intentionally blank
38
Section 3 - Open Boot Prom (OBP) and BIOS
Open Boot Prom (OBP) is the chip based monitor (or pre-boot) program that
runs as soon as a Sun Sparc-based system is powered up. Intel and AMD
based systems run BIOS.
OBP is a command line based tool that allows a user or engineer to interact
with the system hardware without Solaris “getting in the way”. OBP contains a
minor programming feature that allows persistent parameters to be set that
control the system behaves during it’s boot-up to Solaris. OBP also manages
the way the system self-tests and has some interactive hardware tests.
printenv variables
diag-passes 1 – 999
So if diag-passes has been set to 100 post will run 100 times
before you get any output.
39
Also on some systems if these variables are set
diag-level menus
diag-switch? true
The system will wait at the menu for a response and no output will
go to the graphics terminal.
printenv
setenv
You must always set auto=boot? to false and reset the system
before running any of the following tests:
probe-scsi
probe-scsi will probe the on-board SCSI bus and list any devices on
the bus.
ok
ok probe-scsi-all
/pci@1f,0/pci@1/scsi@8,1
/pci@1f,0/pci@1/scsi@8
Target 0
Unit 0 Disk FUJITSU MAP3735N SUN72G 0401
Target 1
Unit 0 Disk FUJITSU MAP3367N SUN36G 0301
ok
40
probe-scsi-all
On some systems e.g. v890, it will also probe FC-AL and IDE buses.
ok
ok probe-scsi-all
/pci@1f,0/pci@1/scsi@8,1
/pci@1f,0/pci@1/scsi@8
Target 0
ok
watch-net
It firstly does an internal loop back test – this checks the electronics
of the NIC (Network Interface Controller)
ok
ok watch-net
41
up
....................
42
watch-net-all
ok
ok watch-net-all
/pci@1f,0/pci@1,1/network@5,1
gme register test --- succeeded.
Internal loopback test -- succeeded.
Link is -- Using Onboard Transceiver - Link Up.
up
Using Onboard Transceiver - Link Up.
Looking for Ethernet Packets.
'.' is a Good Packet. 'X' is a Bad Packet.
Type any key to stop.
………………
/pci@1f,0/pci@1,1/network@c,1
gme register test --- succeeded.
Internal loopback test -- succeeded.
Link is -- Using Onboard Transceiver - Timeout reading Link
status. Check cable and try again.
Timeout waiting for AutoNegotiation Status to be updated.
Timeout reading Link status. Check cable and try again.
Timeout waiting for AutoNegotiation Status to be updated.
Timeout reading Link status. Check cable and try again.
AutoNegotiation Timeout.
Check Cable or Contact your System Administrator.
Link Down.
down
Using Onboard Transceiver - Timeout waiting for
AutoNegotiation Status to be updated.
Timeout reading Link status. Check cable and try again.
Timeout waiting for AutoNegotiation Status to be updated.
Timeout reading Link status. Check cable and try again.
Timeout waiting for AutoNegotiation Status to be updated.
Timeout reading Link status. Check cable and try again.
AutoNegotiation Timeout.
Check Cable or Contact your System Administrator.
Link Down.
ok
43
From the above output we can determine
NIC-/pci@1f,0/pci@1,1/network@5,1
…………….
NIC-/pci@1f,0/pci@1,1/network@c,1
obdiag
obdiag> help
|================================================= ====|
| obdiag commands |
|==================================================== =|
| | |
| exit | Exit obdiag tool |
| help | Print this help information |
| setenv | Set diagnostic configuration variable to new value |
| printenvs | Print values for diagnostic configuration variables |
| versions | Print selftests, library and obdiag tool versions |
| test-all | Test all devices displayed in the menu |
| test 1,2,5 | Test devices 1, 2 and 5 |
| except 2,5 | Test all devices except devices 2 and 5 |
| what 1,2,5 | Print some selected properties for devices 1, 2 and 5 |
| |
|================================================= ====|
Hit spacebar for diag control information, other key to return to the main menu.
44
You can test everything:
obdiag> test-all
Hit the spacebar to interrupt testing
Testing /pci@1f,0/pci@1/SUNW,Expert3D@5
Starting IFB Selftest
(This will take an estimated
2-4 minutes for the full test)
__________________________________________________________________________
| obdiag |
|_________________________ _________________________ _____________ _________|
| | | |
| 1 SUNW,Expert3D@5 | 2 SUNW,lomh@14,200000 | 3 ebus@c |
| 4 flashprom@10,0 | 5 i2c-nvram@0,a0 | 6 ide@d |
| 7 network@5,1 | 8 network@c,1 | 9 pmu@3 |
| 10 scsi@8 | 11 scsi@8,1 | 12 serial@0,2e8 |
| 13 serial@0,3f8 | 14 usb@5,3 | 15 usb@c,3 |
|____________________________|____________________________|_______________ |
| Commands: test test-all except help what printenvs setenv versions exit |
|__________________________________________________________________________|
obdiag> except 6
Hit the spacebar to interrupt testing
Testing /pci@1f,0/pci@1/SUNW,Expert3D@5
45
Starting IFB Selftest
(This will take an estimated
2-4 minutes for the full test)
If you suspect that one component may have an intermittent fault, you can
change the diag-passes and then run the individual test.
obdiag> printenvs
diag-verbosity = 0
diag-continue? = 0
diag-switch? = true
diag-targets = 0
diag-passes = 3
46
diag-level = max
obdiag> test 1
Hit the spacebar to interrupt testing
Testing /pci@1f,0/pci@1/SUNW,Expert3D@5
Starting IFB Selftest
(This will take an estimated
2-4 minutes for the full test)
47
pattern test db mem 00 ff a5 5a pass
............................... passed
Pass:2 (of 3) Errors:0 (of 0) Tests Failed:0 Elapsed Time: 0:0:0:29
If a test fails you can get information about the failed component:
_________________________________________________________________ _______________
| obdiag |
|____________________________________________________________________ __________|
| | | |
| 1 SUNW,Expert3D@5 | 2 SUNW,lomh@14,200000 | 3 ebus@c |
| 4 flashprom@10,0 | 5 i2c-nvram@0,a0 | 6 ide@d |
| 7 network@5,1 | 8 network@c,1 | 9 pmu@3 |
| 10 scsi@8 | 11 scsi@8,1 | 12 serial@0,2e8 |
| 13 serial@0,3f8 | 14 usb@5,3 | 15 usb@c,3 |
|____________________________|____________________________|____________________ |
| Commands: test test-all except help what printenvs setenv versions exit |
|______________________________________________________________________________ |
obdiag> what 1
Device 1 is /pci@1f,0/pci@1/SUNW,Expert3D@5
version : No version is specified.
name : SUNW,Expert3D
device_type : display
model : SUNW,370-3987
48
To see Firmware versions of components:
_______________________________________________________________________ _________
| obdiag |
|____________________________________________________________ __________________|
| | | |
| 1 SUNW,Expert3D@5 | 2 SUNW,lomh@14,200000 | 3 ebus@c |
| 4 flashprom@10,0 | 5 i2c-nvram@0,a0 | 6 ide@d |
| 7 network@5,1 | 8 network@c,1 | 9 pmu@3 |
| 10 scsi@8 | 11 scsi@8,1 | 12 serial@0,2e8 |
| 13 serial@0,3f8 | 14 usb@5,3 | 15 usb@c,3 |
|____________________________|____________________________|____________________ |
| Commands: test test-all except help what printenvs setenv versions exit |
|______________________________________________________________________ ________ |
obdiag> versions
49
50
51
52
Section 4
Solaris
53
This page is intentionally blank
54
Section 4 - Solaris
If auto-boot? is set to true in OBP, then the system will try and
load Solaris on power-on.
If auto-boot? is set to false in OBP the system will pause after POST
and you have several boot options:
boot –rv
boot -sv
ok boot
55
Jan 31 12:15:33 SFV120 sendmail[263]: My unqualified host name (SFV120) unknown;
sleeping for retry
Jan 31 12:15:33 SFV120 sendmail[269]: My unqualified host n ame (SFV120) unknown;
sleeping for retry
*****************************************************************************
*
* Starting Desktop Login on display :0...
*
* Wait for the Desktop Login screen before logging in.
*
*****************************************************************************
*****************************************************************************
*
* The X-server can not be started on display :0...
*
* See file /var/dt/Xerrors for details.
*
*****************************************************************************
Jan 31 12:16:22 SFV120 java[606]: pkcs11_softtoken: Keystore version failure.
Jan 31 12:16:33 SFV120 sendmail[263]: unable to qualify my own domain name (SFV120) -
- using short name
Jan 31 12:16:33 SFV120 sendmail[269]: unable to qualify my own domain name (SFV120) -
- using short name
ok boot -s
Resetting
56
Jan 31 12:56:46 su: 'su root' succeeded for root on /dev/console
Sun Microsystems Inc. SunOS 5.10 Generic January 2005
#
Single user means no users can login, but the network is up. You
can confirm this with the ifconfig command:
# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232
index 1
inet 127.0.0.1 netmask ff000000
eri0: flags=1000803<UP,BROADCAST,MULTICAST,IPv4> mtu 1500 index 2
inet 192.168.100.207 netmask ffffff00 broadcast 192.168.100.255
ether 0:3:ba:6c:b7:98
#
57
root on /pci@1f,0/pci@1/scsi@8/disk@0,0:a fstype ufs
PCI-device: pci@1,1, simba0
simba0 is /pci@1f,0/pci@1,1
PCI-device: isa@7, ebus1
ebus1 is /pci@1f,0/pci@1,1/isa@7
pseudo-device: dld0
dld0 is /pseudo/dld@0
su0 at ebus1: offset 0,3f8
su0 is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
PCI-device: usb@c,3, ohci0
ohci0 is /pci@1f,0/pci@1,1/usb@c,3
PCI-device: usb@5,3, ohci1
ohci1 is /pci@1f,0/pci@1,1/usb@5,3
cpu0: UltraSPARC-IIe (portid 0 impl 0x13 ver 0x33 clock 648 MHz)
iscsi0 at root
iscsi0 is /iscsi
SUNW,eri0 : Local Ethernet address = 0:3:ba:6c:b7:98PCI-device: network@c,1, eri0
eri0 is /pci@1f,0/pci@1,1/network@c,1
SUNW,eri1 : Local Ethernet address = 0:3:ba:6c:b7:99PCI -device: network@5,1, eri1
eri1 is /pci@1f,0/pci@1,1/network@5,1
dump on /dev/dsk/c1t0d0s1 size 516 MB
Hostname: v120
pseudo-device: zfs0
zfs0 is /pseudo/zfs@0
SUNW,eri0 : 100 Mbps full duplex link up
pseudo-device: devinfo0
devinfo0 is /pseudo/devinfo@0
pseudo-device: tod0
tod0 is /pseudo/tod@0
pseudo-device: pm0
pm0 is /pseudo/pm@0
PCI-device: SUNW,Expert3D@5, ifb0
ifb0 is /pci@1f,0/pci@1/SUNW,Expert3D@5
checking ufs filesystems
/dev/rdsk/c1t0d0s7: is logging.
su1 at ebus1: offset 0,2e8
su1 is /pci@1f,0/pci@1,1/isa@7/serial@0,2e8
Jan 31 16:30:03 v120 sendmail[260]: My unqualified host name (v120) unknown; s leeping
for retry
Jan 31 16:30:03 v120 sendmail[261]: My unqualified host name (v120) unknown; sleeping
for retry
v120 console login: Jan 31 16:30:08 v120 pseudo: pseudo -device: vol0
Jan 31 16:30:08 v120 genunix: vol0 is /pseudo/vol@0
Jan 31 16:30:08 v120 pseudo: pseudo-device: pseudo1
Jan 31 16:30:08 v120 genunix: pseudo1 is /pseudo/zconsnex@1
Jan 31 16:30:08 v120 simba: PCI-device: ebus@c, ebus0
Jan 31 16:30:08 v120 genunix: ebus0 is /pci@1f,0/pci@1,1/ebus@c
Jan 31 16:30:08 v120 scsi: /pci@1f,0/pci@1/scs i@8,1 (glm1):
Jan 31 16:30:08 v120 glm1 supports power management.
Jan 31 16:30:08 v120 scsi: /pci@1f,0/pci@1/scsi@8,1 (glm1):
Jan 31 16:30:08 v120 Rev. 7 Symbios 53c896 found.
Jan 31 16:30:08 v120 simba: PCI-device: scsi@8,1, glm1
Jan 31 16:30:08 v120 genunix: glm1 is /pci@1f,0/pci@1/scsi@8,1
Jan 31 16:30:09 v120 simba: PCI-device: pmu@3, pmubus0
Jan 31 16:30:09 v120 pseudo: pseudo-device: fssnap0
Jan 31 16:30:09 v120 genunix: fssnap0 is /pseudo/fssnap@0
Jan 31 16:30:09 v120 pseudo: pseudo-device: ramdisk1024
Jan 31 16:30:09 v120 genunix: ramdisk1024 is /pseudo/ramdisk@1024
Jan 31 16:30:09 v120 ebus: power0 at ebus1: offset 0,2000
Jan 31 16:30:09 v120 genunix: power0 is /pci@1f,0/pci@1,1/isa@7/power@0,2000
Jan 31 16:30:09 v120 pseudo: pseudo-device: winlock0
Jan 31 16:30:09 v120 genunix: winlock0 is /pseudo/winlock@0
Jan 31 16:30:09 v120 pseudo: pseudo-device: lockstat0
Jan 31 16:30:09 v120 genunix: lockstat0 is /pseudo/lockstat@0
58
Jan 31 16:30:09 v120 pseudo: pseudo-device: fcode0
Jan 31 16:30:09 v120 genunix: fcode0 is /pseudo/fcode@0
Jan 31 16:30:09 v120 pseudo: pseudo-device: llc10
Jan 31 16:30:09 v120 genunix: llc10 is /pseudo/llc1@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: lofi0
Jan 31 16:30:10 v120 genunix: lofi0 is /pseudo/lofi@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: rsm0
Jan 31 16:30:10 v120 genunix: rsm0 is /pseudo/rsm@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: trapstat0
Jan 31 16:30:10 v120 genunix: trapstat0 is /pseudo/trapstat@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: fbt0
Jan 31 16:30:10 v120 genunix: fbt0 is /pseudo/fbt@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: profile0
Jan 31 16:30:10 v120 genunix: profile0 is /pseudo/profile@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: systrace0
Jan 31 16:30:10 v120 genunix: systrace0 is /pseudo/systrace@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: sdt0
Jan 31 16:30:10 v120 genunix: sdt0 is /pseudo/sdt@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: fasttrap0
Jan 31 16:30:10 v120 genunix: fasttrap0 is /pseudo/fasttrap@0
Jan 31 16:30:10 v120 pseudo: pseudo-device: pool0
Jan 31 16:30:10 v120 genunix: pool0 is /pseudo/pool@0
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd0
Jan 31 16:30:11 v120 genunix: wrsmd0 is /pseudo/wrsmd@0
Jan 31 16:30:11 v120 pseudo: pseudo-device: fcsm0
Jan 31 16:30:11 v120 genunix: fcsm0 is /pseudo/fcsm@0
Jan 31 16:30:11 v120 pseudo: pseudo-device: dtrace0
Jan 31 16:30:11 v120 genunix: dtrace0 is /pseudo/dtrace@0
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd1
Jan 31 16:30:11 v120 genunix: wrsmd1 is /pseudo/wr smd@1
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd2
Jan 31 16:30:11 v120 genunix: wrsmd2 is /pseudo/wrsmd@2
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd3
Jan 31 16:30:11 v120 genunix: wrsmd3 is /pseudo/wrsmd@3
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd4
Jan 31 16:30:11 v120 genunix: wrsmd4 is /pseudo/wrsmd@4
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd5
Jan 31 16:30:11 v120 genunix: wrsmd5 is /pseudo/wrsmd@5
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd6
Jan 31 16:30:11 v120 genunix: wrsmd6 is /pseudo/wrsmd@6
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd7
Jan 31 16:30:11 v120 genunix: wrsmd7 is /pseudo/wrsmd@7
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd8
Jan 31 16:30:11 v120 genunix: wrsmd8 is /pseudo/wrsmd@8
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd9
Jan 31 16:30:11 v120 genunix: wrsmd9 is /pseudo/wrsmd@9
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd10
Jan 31 16:30:11 v120 genunix: wrsmd10 is /pseudo/wrsmd@10
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd11
Jan 31 16:30:11 v120 genunix: wrsmd11 is /pseudo/wrsmd@11
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd12
Jan 31 16:30:11 v120 genunix: wrsmd12 is /pseudo/wrsmd@12
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd13
Jan 31 16:30:11 v120 genunix: wrsmd13 is /pseudo/wrsmd@13
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd14
Jan 31 16:30:11 v120 genunix: wrsmd14 is /pseudo/wrsmd@14
Jan 31 16:30:11 v120 pseudo: pseudo-device: wrsmd15
Jan 31 16:30:11 v120 genunix: wrsmd15 is /pseudo/wrsmd@15
Jan 31 16:30:11 v120 pseudo: pseudo-device: fcp0
Jan 31 16:30:11 v120 genunix: fcp0 is /pseudo/fcp@0
*****************************************************************************
*
59
* Starting Desktop Login on display :0...
*
* Wait for the Desktop Login screen before logging in.
*
*****************************************************************************
Jan 31 16:30:30 v120 simba: PCI-device: SUNW,Expert3D@5, ifb0
Jan 31 16:30:30 v120 genunix: ifb0 is /pci@1f,0/pci@1/SUNW,Expert3D@5
*****************************************************************************
*
* The X-server can not be started on display :0...
*
* See file /var/dt/Xerrors for details.
*
*****************************************************************************
ok boot -rv
Drive not ready
Can't read disk label.
Can't open disk label package
Boot device: /pci@1f,0/pci@1/scsi@8/disk@0,0 File and args: -rv
module /platform/sun4u/kernel/sparcv9/unix: text at [0x1000000, 0x107a767] data at
0x1800000
module misc/sparcv9/krtld: text at [0x107a768, 0x10933af] data at 0x184c760
module /platform/sun4u/kernel/sparcv9/genunix: text at [0x10 933b0, 0x11f0f17] data at
0x1852000
module /platform/SUNW,UltraAX-i2/kernel/misc/sparcv9/platmod: text at [0x11f0f18,
0x11f1187] data at 0x18a4558
module /platform/sun4u/kernel/cpu/sparcv9/SUNW,UltraSPARC -IIe: text at [0x11f11c0,
0x11fe4d7] data at 0x18a4cc0
SunOS Release 5.10 Version Generic_118833 -33 64-bit
Copyright 1983-2006 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
Ethernet address = 0:3:ba:6c:b7:98
mem = 1048576K (0x40000000)
avail mem = 1039548416
root nexus = Sun Fire V120 (UltraSPARC-IIe 648MHz)
pseudo0 at root
pseudo0 is /pseudo
scsi_vhci0 at root
scsi_vhci0 is /scsi_vhci
pcipsy0 at root: UPA 0x1f 0x0
pcipsy0 is /pci@1f,0
PCI-device: pci@1, simba1
simba1 is /pci@1f,0/pci@1
/pci@1f,0/pci@1/scsi@8 (glm0):
glm0 supports power management.
/pci@1f,0/pci@1/scsi@8 (glm0):
Rev. 7 Symbios 53c896 found.
PCI-device: scsi@8, glm0
glm0 is /pci@1f,0/pci@1/scsi@8
sd0 at glm0: target 0 lun 0
sd0 is /pci@1f,0/pci@1/scsi@8/sd@0,0
root on /pci@1f,0/pci@1/scsi@8/disk@0,0:a fstype u fs
PCI-device: pci@1,1, simba0
60
simba0 is /pci@1f,0/pci@1,1
PCI-device: isa@7, ebus1
ebus1 is /pci@1f,0/pci@1,1/isa@7
pseudo-device: dld0
dld0 is /pseudo/dld@0
su0 at ebus1: offset 0,3f8
su0 is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
PCI-device: usb@c,3, ohci0
ohci0 is /pci@1f,0/pci@1,1/usb@c,3
PCI-device: usb@5,3, ohci1
ohci1 is /pci@1f,0/pci@1,1/usb@5,3
cpu0: UltraSPARC-IIe (portid 0 impl 0x13 ver 0x33 clock 648 MHz)
iscsi0 at root
iscsi0 is /iscsi
SUNW,eri0 : Local Ethernet address = 0:3:ba:6c:b7:98PCI -device: network@c,1, eri0
eri0 is /pci@1f,0/pci@1,1/network@c,1
SUNW,eri1 : Local Ethernet address = 0:3:ba:6c:b7:99PCI -device: network@5,1, eri1
eri1 is /pci@1f,0/pci@1,1/network@5,1
dump on /dev/dsk/c1t0d0s1 size 516 MB
Configuring devices.
SUNW,eri0 : 100 Mbps full duplex link up
Hostname: v120
pseudo-device: rsm0
rsm0 is /pseudo/rsm@0
pseudo-device: devinfo0
devinfo0 is /pseudo/devinfo@0
pseudo-device: pseudo1
pseudo1 is /pseudo/zconsnex@1
PCI-device: ebus@c, ebus0
ebus0 is /pci@1f,0/pci@1,1/ebus@c
/pci@1f,0/pci@1/scsi@8,1 (glm1):
glm1 supports power management.
/pci@1f,0/pci@1/scsi@8,1 (glm1):
Rev. 7 Symbios 53c896 found.
PCI-device: scsi@8,1, glm1
glm1 is /pci@1f,0/pci@1/scsi@8,1
PCI-device: pmu@3, pmubus0
PCI-device: SUNW,Expert3D@5, ifb0
ifb0 is /pci@1f,0/pci@1/SUNW,Expert3D@5
power0 at ebus1: offset 0,2000
power0 is /pci@1f,0/pci@1,1/isa@7/power@0,2000
su1 at ebus1: offset 0,2e8
su1 is /pci@1f,0/pci@1,1/isa@7/serial@0,2e8
pseudo-device: fssnap0
fssnap0 is /pseudo/fssnap@0
pseudo-device: ramdisk1024
ramdisk1024 is /pseudo/ramdisk@1024
pseudo-device: winlock0
winlock0 is /pseudo/winlock@0
pseudo-device: lockstat0
lockstat0 is /pseudo/lockstat@0
pseudo-device: vol0
vol0 is /pseudo/vol@0
pseudo-device: fcode0
fcode0 is /pseudo/fcode@0
pseudo-device: llc10
llc10 is /pseudo/llc1@0
pseudo-device: pm0
pm0 is /pseudo/pm@0
pseudo-device: tod0
tod0 is /pseudo/tod@0
pseudo-device: lofi0
lofi0 is /pseudo/lofi@0
pseudo-device: trapstat0
61
trapstat0 is /pseudo/trapstat@0
pseudo-device: dtrace0
dtrace0 is /pseudo/dtrace@0
pseudo-device: fbt0
fbt0 is /pseudo/fbt@0
pseudo-device: profile0
profile0 is /pseudo/profile@0
pseudo-device: systrace0
systrace0 is /pseudo/systrace@0
pseudo-device: sdt0
sdt0 is /pseudo/sdt@0
pseudo-device: fasttrap0
fasttrap0 is /pseudo/fasttrap@0
pseudo-device: pool0
pool0 is /pseudo/pool@0
pseudo-device: zfs0
zfs0 is /pseudo/zfs@0
pseudo-device: wrsmd0
wrsmd0 is /pseudo/wrsmd@0
pseudo-device: wrsmd1
wrsmd1 is /pseudo/wrsmd@1
pseudo-device: wrsmd2
wrsmd2 is /pseudo/wrsmd@2
pseudo-device: wrsmd3
wrsmd3 is /pseudo/wrsmd@3
pseudo-device: wrsmd4
wrsmd4 is /pseudo/wrsmd@4
pseudo-device: wrsmd5
wrsmd5 is /pseudo/wrsmd@5
pseudo-device: wrsmd6
wrsmd6 is /pseudo/wrsmd@6
pseudo-device: wrsmd7
wrsmd7 is /pseudo/wrsmd@7
pseudo-device: wrsmd8
wrsmd8 is /pseudo/wrsmd@8
pseudo-device: wrsmd9
wrsmd9 is /pseudo/wrsmd@9
pseudo-device: wrsmd10
wrsmd10 is /pseudo/wrsmd@10
pseudo-device: wrsmd11
wrsmd11 is /pseudo/wrsmd@11
pseudo-device: wrsmd12
wrsmd12 is /pseudo/wrsmd@12
pseudo-device: wrsmd13
wrsmd13 is /pseudo/wrsmd@13
pseudo-device: wrsmd14
wrsmd14 is /pseudo/wrsmd@14
pseudo-device: wrsmd15
wrsmd15 is /pseudo/wrsmd@15
pseudo-device: fcp0
fcp0 is /pseudo/fcp@0
pseudo-device: fcsm0
fcsm0 is /pseudo/fcsm@0
checking ufs filesystems
/dev/rdsk/c1t0d0s7: is logging.
Feb 1 09:14:55 v120 sendmail[274]: My unqualified host name (v120) unknown; sleeping
for retry
Feb 1 09:14:55 v120 sendmail[275]: My unqualified host name (v120) unknown; sleeping
for retry
*****************************************************************************
62
*
* Starting Desktop Login on display :0...
*
* Wait for the Desktop Login screen before logging in.
*
*****************************************************************************
Feb 1 09:15:20 v120 simba: PCI-device: SUNW,Expert3D@5, ifb0
Feb 1 09:15:20 v120 genunix: ifb0 is /pci@1f,0/pci@1/SUNW,Expert3D@5
Feb 1 09:15:21 v120 pseudo: pseudo-device: devinfo0
Feb 1 09:15:21 v120 genunix: devinfo0 is /pseudo/devinfo@0
*****************************************************************************
*
* The X-server can not be started on display :0...
*
* See file /var/dt/Xerrors for details.
*
*****************************************************************************
Feb 1 09:15:42 v120 java[613]: pkcs11_softtoken: Keystore version failure.
Feb 1 09:15:55 v120 sendmail[275]: unable to qualify my own domain name (v120) --
using short name
Feb 1 09:15:55 v120 sendmail[274]: unable to qualify my own domain name (v120) --
using short name
63
Installing Solaris
The Jumpstart and WANboot methods are by far the most common today. A
dedicated system holds a variety of pre-defined Solaris images on disk. The
target system is connected to a shared network, boots from one of the images
and builds itself automatically.
Jumpstart, WANboot and FLAR install methods are the responsibility of the
end user and are not covered in this course.
You will need information about the system’s name, IP address, disk layout
etc. This should be available from the system’s administrator.
This will boot a system to single user from a cdrom. When in single user mode
you can mount the disk drives, which is very useful for diagnosing problems.
64
Login, Navigate and Explore
Password:
Jan 31 21:18:59 v120 login: ROOT LOGIN /dev/console
Last login: Mon Jan 31 16:32:53 on console
Sun Microsystems Inc. SunOS 5.10 Generic January 2005
#
It is a good idea to use the bash shell (the Bourne Again Shell)
The shell is the command line interface that allows the user to interact with
Solaris and the system hardware. Bash is the easiest shell to use. There are
many shell commands:
# bash
bash-3.00#
bash-3.00# ls
bin etc lib opt system vol
cdrom export lost+found platform tmp
dev home mnt proc usr
devices kernel net sbin var
bash-3.00#
The ls command can be used with different flags to get more detail
bash-3.00# ls -lagi
total 624
2 drwxr-xr-x 27 root 1024 Jan 31 14:09 .
2 drwxr-xr-x 27 root 1024 Jan 31 14:09 ..
181881 -rw------- 1 root 77 Sep 10 2008 TTauthority
181892 -rw------- 1 root 100 Sep 10 2008 . Xauthority
181876 -rw------- 1 root 245 Jan 31 14:12 . bash_history
326496 drwxr-xr-x 11 root 512 Sep 10 2008 .dt
181880 -rwxr-xr-x 1 root 5111 Sep 10 2008 .dtprofile
326573 drwx------ 2 root 512 Sep 10 2008 .gconf
326575 drwx------ 2 root 512 Sep 10 2008 . gconfd
326611 drwxr-xr-x 3 root 512 Sep 10 2008 . softwareupdate
326490 drwx------ 3 root 512 Sep 10 2008 . sunw
1423 lrwxrwxrwx 1 root 9 Sep 9 2008 bin -> ./usr/bin
65
326283 drwxr-xr-x 2 nobody 512 Sep 10 2008 cdrom
1476 drwxr-xr-x 17 sys 4096 Jan 31 21:15 dev
6618 drwxr-xr-x 2 sys 512 Jan 31 21:14 devices
1477 drwxr-xr-x 83 sys 4096 Jan 31 21:15 etc
4 drwxr-xr-x 3 sys 512 Sep 9 2008 export
37166 dr-xr-xr-x 1 root 1 Jan 31 21:15 home
2645 drwxr-xr-x 14 sys 512 Sep 9 2008 kernel
1582 drwxr-xr-x 7 bin 5632 Sep 9 2008 lib
3 drwx------ 2 root 8192 Sep 9 2008 lost+found
1590 drwxr-xr-x 2 sys 512 Sep 9 2008 mnt
326487 dr-xr-xr-x 1 root 1 Jan 31 21:15 net
1591 drwxr-xr-x 6 sys 512 Sep 10 2008 opt
3281 drwxr-xr-x 53 sys 2048 Sep 9 2008 platform
1592 dr-xr-xr-x 36 root 258752 Jan 31 21:25 proc
1593 drwxr-xr-x 2 sys 1024 Sep 9 2008 sbin
1598 drwxr-xr-x 4 root 512 Sep 9 2008 system
1601 drwxrwxrwt 6 sys 397 Jan 31 21:16 tmp
28 drwxr-xr-x 39 sys 1024 Sep 9 2008 usr
6 drwxr-xr-x 43 sys 1024 Sep 10 2008 var
326285 dr-xr-xr-x 6 root 512 Jan 31 21:15 vol
cd change directory
bash-3.00# cd usr
bash-3.00# ls
4lib aset j2se news sadm ucb
5bin bin java oasys sbin ucbinclude
X ccs jdk old sfw ucblib
X11 demo kernel openwin share vmsys
X11R6 dict kvm perl5 snadm xpg4
adm dt lib platform spool xpg6
apache games mail preserve src
apache2 gnome man proc staroffice7
appserver include net pub tmp
bash-3.00#
bash-3.00# pwd
/usr
bash-3.00#
df disk free - shows which disk partitions are mounted and their mount
points
bash-3.00# df
/ (/dev/dsk/c1t0d0s0 ): 3730672 blocks 531911 files
/devices (/devices ): 0 blocks 0 files
/system/contract (ctfs ): 0 blocks 2147483623 files
/proc (proc ): 0 blocks 16136 files
/etc/mnttab (mnttab ): 0 blocks 0 files
/etc/svc/volatile (swap ): 2431984 blocks 147294 files
/system/object (objfs ): 0 blocks 2147483504 files
/dev/fd (fd ): 0 blocks 0 files
66
/tmp (swap ): 2431984 blocks 147294 files
/var/run (swap ): 2431984 blocks 147294 files
/export/home (/dev/dsk/c1t0d0s7 ): 128383236 blocks 7734268 files
bash-3.00#
bash-3.00# df -k
Filesystem kbytes used avail capacity Mounted on
/dev/dsk/c1t0d0s0 5808942 3943606 1807247 69% /
/devices 0 0 0 0% /devices
ctfs 0 0 0 0% /system/contract
proc 0 0 0 0% /proc
mnttab 0 0 0 0% /etc/mnttab
swap 1217144 1176 1215968 1% /etc/svc/volatile
objfs 0 0 0 0% /system/object
fd 0 0 0 0% /dev/fd
swap 1216000 32 1215968 1% /tmp
swap 1216016 48 1215968 1% /var/run
/dev/dsk/c1t0d0s7 64255355 63737 63549065 1% /export/home
bash-3.00#
67
ctfs - /system/contract ctfs - no -
objfs - /system/object objfs - no -
swap - /tmp tmpfs - yes -
bash-3.00#
68
The Solaris messages files are located in /var/adm
bash-3.00# cd /var/adm
bash-3.00# ls -lagi
total 684
1602 drwxrwxr-x 9 sys 512 Sep 10 2008 .
6 drwxr-xr-x 43 sys 1024 Sep 10 2008 ..
117192 drwxrwxr-x 5 adm 512 Sep 9 2008 acct
1894 -rw------- 1 bin 0 Nov 9 2006 aculog
1603 drwxr-xr-x 2 adm 512 Sep 9 2008 exacct
46397 -r--r--r-- 1 root 28 Feb 1 09:20 lastlog
1604 drwxr-xr-x 2 adm 512 Sep 9 2008 log
181867 -rw-r--r-- 1 root 210424 Feb 1 09:15 messages
61925 drwxr-xr-x 2 sys 512 Sep 9 2008 pool
117196 drwxrwxr-x 2 sys 512 Sep 9 2008 sa
239138 drwxr-xr-x 2 sys 512 Sep 9 2008 sm.bin
1895 -rw-rw-rw- 1 bin 0 Nov 9 2006 spellhist
1605 drwxr-xr-x 2 sys 512 Sep 9 2008 streams
181884 -rw------- 1 root 66 Jan 31 12:56 sulog
1896 -rw-r--r-- 1 bin 2232 Feb 1 09:20 utmpx
46534 -rw-r--r-- 1 root 0 Sep 10 2008 vold.log
1897 -rw-r--r-- 1 adm 102300 Feb 1 09:20 wtmpx
bash-3.00#
The messages file is 210424kB. These files can grow very large
If you more this file, it may be hundreds of pages. Very time consuming.
Use the tail command to look at the last n lines of the file .
69
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd8
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd8 is /pseudo/wrsmd@8
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd9
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd9 is /pseudo/wrsmd@9
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd10
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd10 is /pseudo/wrsmd@10
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo-device: wrsmd11
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd11 is /pseudo/wrsmd@11
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd12
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd12 is / pseudo/wrsmd@12
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd13
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd13 is /pseudo/wrsmd@13
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd14
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd14 is /pseudo/wrsmd@14
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd15
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] wrsmd15 is /pseudo/wrsmd@15
Feb 1 13:11:13 v120 pseudo: [ID 129642 kern.info] pseudo-device: fcp0
Feb 1 13:11:13 v120 genunix: [ID 936769 kern.info] fcp0 is /pseudo/fcp@0
Feb 1 13:11:25 v120 simba: [ID 370704 kern.info] PCI -device: SUNW,Expert3D@5, ifb0
Feb 1 13:11:25 v120 genunix: [ID 936769 kern.info] ifb0 is / pci@1f,0/pci@1/SUNW,Expert3D@5
Feb 1 13:11:26 v120 pseudo: [ID 129642 kern.info] pseudo -device: vol0
Feb 1 13:11:26 v120 genunix: [ID 936769 kern.info] vol0 is /pseudo/vol@0
Feb 1 13:11:52 v120 java[608]: [ID 807473 user.error] pkcs11_softtoken: Keystor e version failure.
Feb 1 13:12:04 v120 sendmail[272]: [ID 702911 mail.alert] unable to qualify my own domain name
(v120) -- using short name
Feb 1 13:12:04 v120 sendmail[274]: [ID 702911 mail.alert] unable to qualify my own domain name
(v120) -- using short name
bash-3.00#
head -50 xxxxxx will show the first 50 lines of the file
bash-3.00# dmesg
70
Feb 1 12:06:12 v120 genunix: [ID 936769 kern.info] wrsmd13 is /pseudo/wrsmd@13
Feb 1 12:06:12 v120 pseudo: [ID 129642 kern.info] pseudo -device: wrsmd14
Feb 1 12:06:12 v120 genunix: [ID 936769 kern.info] wrsmd14 is /pseudo/wrsmd@14
Feb 1 12:06:12 v120 pseudo: [ID 129642 kern.info] pseudo-device: wrsmd15
Feb 1 12:06:12 v120 genunix: [ID 936769 kern.info] wrsmd15 is /pseudo/wrsmd@15
Feb 1 12:06:12 v120 pseudo: [ID 129642 kern.info] pseudo -device: fcp0
Feb 1 12:06:12 v120 genunix: [ID 936769 kern.info ] fcp0 is /pseudo/fcp@0
Feb 1 12:06:31 v120 simba: [ID 370704 kern.info] PCI -device: SUNW,Expert3D@5, ifb0
Feb 1 12:06:31 v120 genunix: [ID 936769 kern.info] ifb0 is
/pci@1f,0/pci@1/SUNW,Expert3D@5
Feb 1 12:06:31 v120 pseudo: [ID 129642 kern.info] pseud o-device: devinfo0
Feb 1 12:06:31 v120 genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo@0
Feb 1 12:06:52 v120 java[604]: [ID 807473 user.error] pkcs11_softtoken: Keystore version
failure.
prtdiag
bash-3.00# ./prtdiag -v
System Configuration: Sun Microsystems sun4u Sun Fire V120 (UltraSPARC -IIe 648MHz)
System clock frequency: 100 MHz
Memory size: 1024 Megabytes
========================= CPUs
=========================
========================= IO Cards
=========================
Bus# Freq
Brd Type MHz Slot Name Model
--- ---- ---- ---- -------------------------------- ----------------------
0 PCI-1 33 12 ebus
0 PCI-1 33 3 pmu-pci10b9,7101
0 PCI-1 33 3 lomp
0 PCI-1 33 7 isa
0 PCI-1 33 12 network-pci108e,1101 SUNW,pci-eri
0 PCI-1 33 12 usb-pci108e,1103.1
0 PCI-1 33 13 ide-pci10b9,5229
0 PCI-1 33 5 network-pci108e,1101 SUNW,pci-eri
0 PCI-1 33 5 usb-pci108e,1103.1
0 PCI-2 33 8 scsi-glm Symbios,53C896
0 PCI-2 33 8 scsi-glm Symbios,53C896
0 PCI-2 33 5 SUNW,Expert3D SUNW,370-3987
71
========================= HW Revisions
=========================
ASIC Revisions:
---------------
Cheerio: ebus Rev 1
prtdiag can also be run with the –v flag for verbose output
========================= CPUs
=========================
========================= IO Cards
=========================
Bus# Freq
Brd Type MHz Slot Name Model
--- ---- ---- ---- -------------------------------- ----------------------
0 PCI-1 33 12 ebus
0 PCI-1 33 3 pmu-pci10b9,7101
72
0 PCI-1 33 3 lomp
0 PCI-1 33 7 isa
0 PCI-1 33 12 network-pci108e,1101 SUNW,pci-eri
0 PCI-1 33 12 usb-pci108e,1103.1
0 PCI-1 33 13 ide-pci10b9,5229
0 PCI-1 33 5 network-pci108e,1101 SUNW,pci-eri
0 PCI-1 33 5 usb-pci108e,1103.1
0 PCI-2 33 8 scsi-glm Symbios,53C896
0 PCI-2 33 8 scsi-glm Symbios,53C896
0 PCI-2 33 5 SUNW,Expert3D SUNW,370-3987
73
format
format is the disk drive utility and can be used to test a disk drive and map
out bad blocks
bash-3.00# format
Searching for disks...done
FORMAT MENU:
disk - select a disk
type - select (define) a disk type
partition - select (define) a partition table
current - describe the current disk
format - format and analyze the disk
repair - repair a defective sector
label - write label to the disk
analyze - surface analysis
defect - defect list management
backup - search for backup labels
verify - read and display labels
save - save new disk/partition definitions
inquiry - show vendor, product and revision
volname - set 8-character volume name
!<cmd> - execute <cmd>, then return
quit
format> inq
Vendor: FUJITSU
Product: MAP3367N SUN36G
Revision: 0301
format> anal
ANALYZE MENU:
read - read only test (doesn't harm SunOS)
refresh - read then write (doesn't harm data)
test - pattern testing (doesn't harm data)
write - write then read (corrupts data)
compare - write, read, compare (corrupts data)
purge - write, read, write (corrupts data)
verify - write entire disk, then verify (corrupts data)
print - display data buffer
setup - set analysis parameters
config - show analysis parameters
!<cmd> - execute <cmd> , then return
quit
74
Repair defective blocks? yes
Stop after first error? no
Use random bit patterns? no
Number of blocks per transfer: 126 (0/1/19)
Verify media after formatting? yes
Enable extended messages? no
Restore defect list? yes
Restore disk label? yes
Modify if required
analyze> setup
Analyze entire disk[yes]?
Loop continuously[no]?
Enter number of passes[2]:
Repair defective blocks[yes]?
Stop after first error[no]?
Use random bit patterns[no]?
Enter number of blocks per transfer[126, 0/1/19]:
Verify media after formatting[yes]?
Enable extended messages[no]?
Restore defect list[yes]?
Restore disk label[yes]?
analyze> test
Ready to analyze (won't harm data). This takes a long time,
but is interruptable with CTRL-C. Continue? y
pass 0 - pattern = 0xc6dec6de
52/0/90
analyze> test
Ready to analyze (won't harm data). This takes a long time,
but is interruptable with CTRL-C. Continue? y
pass 0 - pattern = 0xc6dec6de
^C 703/6/15
Total of 0 defective blocks repaired.
analyze> quit
FORMAT MENU:
disk - select a disk
type - select (define) a disk type
partition - select (define) a partition table
current - describe the current disk
format - format and analyze the disk
repair - repair a defective sector
label - write label to the disk
analyze - surface analysis
defect - defect list management
backup - search for backup labels
verify - read and display labels
save - save new disk/partition definitions
inquiry - show vendor, product and revision
volname - set 8-character volume name
!<cmd> - execute <cmd>, then return
quit
format> repair
75
This block doesn't appear to be bad. Rep air it anyway? yes
Ready to repair defect, continue? y
Repairing block 10056 (3/12/105)...ok.
format>
76
Status Commands
iostat 5 will update every 5 seconds. The first line is information on bootup, then tty, sd0, sd1, nfs, and cpu
bash-3.00# iostat 5
tty sd0 sd1 nfs1 cpu
tin tout kps tps serv kps tps serv kps tps serv us sy wt id
0 103 54 4 8 1694 30 0 0 0 0 3 3 0 94
0 39 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
77
Example of iostat when simultaneously running format/analyse on sd1
bash-3.00# iostat 5
tty sd0 sd1 nfs1 cpu
tin tout kps tps serv kps tps serv kps tps serv us sy wt id
0 103 54 4 8 1694 30 0 0 0 0 3 3 0 94
0 39 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
1 14 0 0 14 0 0 0 0 0 0 0 1 0 99
1 79 527 47 3 3631 266 0 0 0 10 20 0 0 69
1 166 0 0 0 963 63 1 0 0 0 1 4 0 96
1 160 2 0 13 0 0 0 0 0 0 0 1 0 99
0 10764 5 4 25 48458 769 0 0 0 0 1 12 0 86
0 14658 0 0 0 63190 1003 0 0 0 0 2 15 0 83
0 14593 1 0 11 63024 1000 0 0 0 0 2 16 0 82
0 14662 9 12 23 63202 1003 0 0 0 0 2 16 0 83
0 13951 0 0 0 59512 945 0 0 0 0 2 15 0 83
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
0 13 0 0 0 0 0 0 0 0 0 0 1 0 99
bash-3.00# mpstat 5
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt vmstatidl
0 95 6 0 434 328 603 63 0 0 0 1066 8 4 0 87
0 2 0 0 433 302 157 0 0 0 0 45 0 1 0 99
0 0 0 0 439 324 160 0 0 0 0 29 0 1 0 99
0 0 0 0 416 300 151 4 0 0 0 45 6 1 0 93
0 0 0 0 417 301 152 0 0 0 0 29 0 1 0 99
0 0 0 0 415 300 151 0 0 0 0 43 0 1 0 99
0 0 0 0 417 302 155 0 0 0 0 31 0 1 0 99
78
vmstat Virtual Memory Statistics
bash-3.00# vmstat 5
kthr memory page disk faults cpu
r b w swap free re mf pi po fr de sr s0 s1 -- -- in sy cs us sy id
0 0 0 1224952 808216 19 75 107 0 0 0 34 7 0 0 0 434 847 507 7 4 90
0 0 0 1224768 799776 0 5 6 0 0 0 0 0 0 0 0 450 63 156 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 418 40 156 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 415 48 151 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 3 0 0 0 437 32 153 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 417 46 155 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 416 32 150 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 416 46 154 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 417 32 153 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 416 48 153 0 1 99
0 0 0 1224744 799752 0 0 0 0 0 0 0 0 0 0 0 419 33 153 0 1 99
UDP: IPv4
Local Address Remote Address State
-------------------------------------------------------------------------------
*.route Idle
*.sunrpc Idle
*.* Unbound
*.32771 Idle
TCP: IPv4
Local Address Remote Address Swind Send-Q Rwind Recv-Q State
------------------------------------------------------------------------------------ --------------------------------------------------
*.* *.* 0 0 49152 0 IDLE
79
*.sunrpc *.* 0 0 49152 0 LISTEN
*.* *.* 0 0 49152 0 IDLE
*.ssh *.* 0 0 49152 0 LISTEN
localhost.5987 *.* 0 0 49152 0 LISTEN
localhost.898 *.* 0 0 49152 0 LISTEN
localhost.32771 *.* 0 0 49152 0 LISTEN
localhost.5988 *.* 0 0 49152 0 LISTEN
localhost.32772 *.* 0 0 49152 0 LISTEN
*.telnet *.* 0 0 49152 0 LISTEN
*.ftp *.* 0 0 49152 0 LISTEN
*.32782 *.* 0 0 49152 0 BOUND
localhost.6788 *.* 0 0 49152 0 LISTEN
localhost.6789 *.* 0 0 49152 0 LISTEN
localhost.smtp *.* 0 0 49152 0 LISTEN
localhost.submission *.* 0 0 49152 0 LISTEN
localhost.32780 *.* 0 0 49152 0 LISTEN
TCP: IPv6
Local Address Remote Address Swind Send-Q Rwind Recv-Q State If
--------------------------------------------------------------------------- --------------------------------- ----- ------ ----- ------ ----------- -----
*.* *.* 0 0 49152 0 IDLE
*.ssh *.* 0 0 0 49152 0 LISTEN
*.telnet *.* 0 0 0 49152 0 LISTEN
*.ftp *.* 0 0 0 49152 0 LISTEN
SCTP:
Local Address Remote Address Swind Send-Q Rwind Recv-Q StrsI/O State
--------------------------------------------------------------------- ------- ------------------------------- ------ ------ ------ ------ ------- -----------
0.0.0.0 0.0.0.0 0 0 102400 0 32/32 CLOSED
80
Solaris Administrator’s Quick Reference
/ etc/hostname.{hme0|le0} /etc/nodename;
/etc/inet/hosts; /etc/net/*/hosts; /etc/defautrouter; /etc/resolv.conf
/etc/auto_home
Automount home (indirect) map, sample as follow #### mount home director y
##### jialong bluebear:/export/hom e/jialong
/etc/auto_direct
Automount direct map, sample as follow #### mount /usr/local from a ser ver ####
/usr/local bluebear:/usr/local
/etc/vold.conf
Volume manager configuration.
mount [options] filesr v:/pathname /mnt Mount remote file system. For security, when
possible, mount system as readonly and nosuid.
/etc/rmmount.conf
Removable disk configuration.
Sendmail Configuration
/etc/mail/sendmail.cf
sendmail configuration file.
/etc/mail/aliases aliases file. Must run newaliases after modifying aliases file.
Anti-spam
make sure FEATURE(access_db) is in sendmail.mc create /etc/mail/access with
something like
Author: Jialong He Email: Jialong_he@bigfoot.com
http://www.bigfoot.com/~jialong_he
User Initialization
($HOME/.profile)
Setup Printer
Local printer
/etc/profile
81
lpadmin –p prt_name –v /dev/ecpp0 -D “description” –T PS -I postscript
parallel port: {/dev/ecpp0 | /dev/bpp0}
serial port: {/dev/term/a | /dev/term/b}
lpstat –t
show all printer status.
File Sharing
/etc/vfstab
File mount table (local or NFS).
/etc/dfs/dfstab
File sharing table (NFS ser ver).
/etc/auto_master
Automounter master map, sample as follow #### Master map for automounter
#### /home auto_home -nobrowse /- auto_direct -ro
sh, bash, ksh system wide (per user) init
(system wide init has no effect in CDE environment).
/etc/.login ($HOME/.login)
csh, tcsh system wide (per user) init (system wide init has no effect in CDE
environment).
$HOME/.cshrc
per user csh, tcsh init (order: /etc/.login → $HOME/.cshrc →
$HOME/.login).
/usr/dt/config/Xsession.d/2000.login
system wide init for CDE environment (a script in Xsession.d).
$HOME/.dtprofile
per user init for CDE environment.
/etc/skel/*
Templete files (local.cshrc, local.login, local.profile) copied to new user’s home
director y.
82
Network Configuration
/etc/defaultdomain
NIS/NIS+ domain name.
/etc/defaultrouter
IP address of the default router.
/etc/resolv.conf
Internet domain name, name ser ver and search order. An example of resolv.conf
domain mydomain.com nameser ver 192.168.0.1
search mydomain.com
/etc/nsswitch.conf
specifying information source from files, NIS, NIS+, or DNS.
/etc/hostname.{hme0|le0}
Ipv4 hostname.
/etc/nodename
IPv6 hostname.
/etc/inet/hosts
Host name file (/etc/hosts is a link to this file).
/etc/inet/netmasks
TCP/IP subnet masks.
/etc/inet/protocols
Network protocols.
/etc/inet/ser vices
Network ser vice name and port number.
/etc/notrouter
create this file prevent in.routed or in.rdiscd from starting at
boot time.
/etc/inet/inetd.conf
Internet super daemon configuration file.
cyberpromo.com sendmail.org REL AY spam@buyme.com
83
CDE configuration
$HOME/.dtprofile
per user CDE init file, gemerated from
/{usr|etc}/dt/config/sys.dtprofile. $HOME/.dt/dtwmrc
desktop manager configuration file (pop-up menu when right
click mouse). From /{usr|etc}/dt/config/C/sys.dtwmrc
/usr/dt/appconfig/types/C/dtwm.fp
copy to $HOME/.dt/types/myname.fp and modify it.
REJECT
550 Spammers shan't see sunlight here makemap hash /etc/mail/access <
/etc/mail/access
$HOME/.dt/sessionetc
per user CDE session start file (script with execute perm)
$HOME/.dt/sessionexit
per user CDE exit file (script with execute permission).
/{usr | etc}/dt/config/C/Xresources
control attribute of login screen, for example, to disable session menu,
uncomment following line
/etc/pam.conf
pluggable authentication configuration file.
/etc/power.conf
power configuration.
/etc/printers.conf
BSD printer configuration.
/etc/magic
used by “file” command to determine file type.
/etc/security/*
security audit related files.
/etc/syslog.conf
system log daemon configuration file.
/etc/notrouter
specify this host is not a router.
84
Default info for various programs
/etc/default/power
power management parameters.
/etc/default/Solregis
put DISABLE=1 to disable solaris registration screen.
/etc/default/su
settings for “su” command.
/etc/default/sys-suspend
users permitted to put system in suspend mode.
/etc/default/passwd
minimum password length.
/etc/default/login
login related settings, put CONSOLE=/dev/console
disable root login by telnet (rlogin).
/etc/default/init
time zone, CMASK (default 022)
/etc/default/kbd
KEYBOARD_ABORT=disable
85
Application Configuration
/etc/ssh2/ssh2_configure ($HOME/.ssh2/ssh2_config)
SSH client system wide (per user) configuration file.
/etc/ssh2/sshd2_config ($HOME/.ssh2/sshd2_config)
SSH ser ver system wide (per user) configuration file.
/usr/local/lib/pine.conf
system wide PINE configuration, over write by $HOME/.pinerc
/usr/local/lib/pine.conf.fixed
httpd.conf (https.conf)
Apache web ser ver configuration file. ( www.apache.org)
smb.conf
Samba (window ser ver) configuration file. ( www.samba.org)
Miscellaneous Commands
Disable auto-logout feature for tcsh Put following line in .cshrc or .tcshrc unset
autologout
edit /etc/inittab
remove sc:234:respawn:/usr/lib/saf/sac –t 300
disable serial device (modem) login.
useradd –d homedir –u UID –g GID –c “comment” –s shell add new user account.
man foo | col –b > foo.txt save manual page for command “foo” in pure text.
86
pkgadd –d pkgfile add solaris package file.
boot –r
Reconfiguration system after adding new hardware.
who –r
show current run level.
volcheck –v
check if new floppy/cdrom is inserted.
fuser –u [-k] /cdrom Show which program is using the cdrom (or floppy).
/usr/sbin/eeprom
show settings in eeprom.
/usr/sbin/prtconf –vb
show system information.
newfs –v /dev/rdsk/c0t0d0s6
construct new file system after format.
/usr/sbin/sys-unconfig
Dtlogin*session_menus*sensitive:
/{usr | etc}/dt/config/C/sys.resources
False
session resource, for example, to disable automatic screen lock, set timout to 0
dtsession*lockTimeout: 0
$HOME/.dt/sessions/{current | home}
current (home) session files.
/{usr | etc}/dt/config/Xconfig
configuration file for login screen (dtconfig), after change use
dtconfig –reset
/usr/dt/config/Xstartup
this script run after user login but before user session.
/usr/dt/config/Xaccess
Control access to Xser ver.
87
/usr/dt/bin/Xsession
start CDE session
/usr/dt/config/Xsession.d/*
Scripts auto executed by Xsession.
usr/dt/config/Xsession.ow
start OpenWindow session.
/usr/dt/config/Xreset
Command executed after the session end.
/usr/dt/bin/dtconfig –e|-d|-kill
-e|-d: enable (disable) autostart login ser ver.
-kill: kill dtlogin and all its child process.
$HOME/.dt/icons $/{usr|etc}/dt/appconfig/icons/C
default icons search path.
System Configuration
/etc/ftpusers
users NOT allowed to use FTP.
/etc/system
Kernel parameters Example: disable execution in stack set noexec_user_stac k=1 set
noexec_user_stack_log=1 set maxuprc = 128 # maximum no. of user process set
sys:coredumpsize = 0 # prevent core dump
/etc/hosts.equiv, ($HOME/.rhosts)
system wide (per user) trust hosts.
/etc/motd, (/etc/issue)
message after (before) login.
/etc/shells
allowed shell program.
/etc/initab
run level configuration.
/etc/rc{S, | 1 | 2 | 3 | 5 | 6}.d
scripts for different run levels.
/etc/bootparams
system wide PINE configuration, NOT over write by ~/.pinerc
reconfiguring the system.
rpc.bootparamd configuration file.
88
install_cluster –q -nosave
ndd
install recommended patch cluster.
set TCP/IP parameters
eeprom
change settings in eeprom, like eeprom security-mode=full
Shell Programming
if-then-else
sh, bash, ksh if condition; then action_1; else action_2; fi
csh, tcsh if (condition) then
action_1; else
action_2; endif
foreach
sh, bash, ksh for key in list... ; do actions; done
csh, tcsh foreach key (list) actions end
Rename files foreach i (*)
mv $i $i.old end
do-while
sh, bash, ksh while condition; do actions; done
csh, tcsh while (condition) actions end
http://www.cheat-sheets.org/saved-copy/Solaris_quickref.pdf
89
This page is intentionally blank
90
91
92
93
94
Section 5
Sources of Information
95
This page is intentionally blank
96
Section 5 – Sources of Information
Most of the hands-on sessions in this course are based on material that is
freely available for download from the Oracle Corporation website.
Agilitas is not able to distribute this material, but we strong ly suggest that
you download the material yourself from the links below:
http://www.oracle.com/technetwork/documentation/oracle-sparc-ent-
servers-189996.html#legacyentry
http://www.oracle.com/technetwork/documentation/legacy-workstations-
194016.html#work
97
98
99
100
101
102
103
104
105
This page is intentionally blank
106