You are on page 1of 109

source source cluster :

rcdn9-mc01-nas

========== Source node


:rcdn9-mc01-nas-n04

rcdn9-mc01-nas Source volume :


migen002_gg_REMOTE2_vol010A

Dest Dest cluster:alln01-


c04-svnas
=== Dest node :alln01-
c04-svnas-n03
alln01-c04-svnas Dest
Volume:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

rcdn9-mc01-nas::> net int show -role intercluster

(network interface show)

Logical Status Network


Current Current Is
Vserver Interface Admin/Oper Address/Mask
Node Port Home
----------- ---------- ----------
------------------ ------------- ------- ----
rcdn9-mc01-nas

rcdn9-mc01-nas-n03-ic-lif up/up
10.31.75.20/29 rcdn9-mc01-nas-n03 a1z true
rcdn9-mc01-nas-n04-ic-lif up/up
10.31.75.21/29 rcdn9-mc01-nas-n04 a1z true
2 entries were displayed.

rcdn9-mc01-nas::>

rcdn9-mc01-nas::> vol show


migen002_gg_REMOTE2_vol010A -fields node

node nodes

rcdn9-mc01-nas::> vol show


migen002_gg_REMOTE2_vol010A -fields node
vserver volume
node
------------------- ---------------------------
------------------
rcdn9-mc01-nas-prod migen002_gg_REMOTE2_vol010A
rcdn9-mc01-nas-n04

rcdn9-mc01-nas::> vol show


migen002_gg_REMOTE33_vol012A -fields node
vserver volume
node
------------------- ----------------------------
------------------
rcdn9-mc01-nas-prod migen002_gg_REMOTE33_vol012A
rcdn9-mc01-nas-n04

rcdn9-mc01-nas::>

alln01-c04-svnas::> vol show


sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A -fields node

vserver volume
node
----------------------
-------------------------------------------------- --------------------
alln01-c04-svnas-rcdn9
sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A alln01-c04-svnas-n03

alln01-c04-svnas::> vol show


sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE3_vol001A -fields node
vserver volume
node
----------------------
-------------------------------------------------- --------------------
alln01-c04-svnas-rcdn9
sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE3_vol001A alln01-c04-svnas-n06

alln01-c04-svnas::> vol show


sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE33_vol012A -fields node
vserver volume
node
----------------------
--------------------------------------------------- --------------------
alln01-c04-svnas-rcdn9
sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE33_vol012A alln01-c04-svnas-n01

alln01-c04-svnas::> snapmirror show -destination-


path *sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Progress

Source Destination Mirror


Relationship Total Last
Path Type Path State Status
Progress Healthy Updated

----------- ---- ------------ -------


-------------- --------- ------- --------

rcdn9-mc01-nas-prod:migen002_gg_REMOTE2_vol010A
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A
Snapmirrored Transferring 52.76GB false 05/24 21:14:56

alln01-c04-svnas-n03-ic-lif up/up
173.36.11.230/24 alln01-c04-svnas-n03 a1a-150 true

alln01-c04-svnas::> snapmirror show -destination-


path *sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Progress

Source Destination Mirror


Relationship Total Last

Path Type Path State Status


Progress Healthy Updated

----------- ---- ------------ -------


-------------- --------- ------- --------

rcdn9-mc01-nas-prod:migen002_gg_REMOTE2_vol010A
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A
Snapmirrored Transferring 52.76GB false 05/24 21:17:41

alln01-c04-svnas::> snapmirror show -destination-


path *sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Progress

Source Destination Mirror


Relationship Total Last

Path Type Path State Status


Progress Healthy Updated

----------- ---- ------------ -------


-------------- --------- ------- --------

rcdn9-mc01-nas-prod:migen002_gg_REMOTE2_vol010A
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A
Snapmirrored Transferring 52.76GB false 05/24 21:19:41

rcdn9-mc01-nas::*> node run -node rcdn9-mc01-nas-


n04 -command netstat -s -p tcp
tcp:

794098866676 packets sent

694622193349 data packets


(1809187200109592 bytes)
20740038 data packets
(156029464007 bytes) retransmitted
7184635983 ack-only packets
(403707423 delayed)
0 URG only packets

839 window probe packets

92134912950 window update packets

136383517 control packets

622564645630 packets received

165193472340 acks (for


1807913480527533 bytes)
3186087355 duplicate acks

0 acks for unsent data

534331318994 packets
(941145941958877 bytes) received in-sequence
264909703 completely duplicate
packets (42616155947 bytes)
61265 old duplicate packets

11503 packets with some duplicate


data (45417391 bytes duped)
964412390 out-of-order packets
(2974825972026 bytes)
8630 packets (0 bytes) of data
after window
0 window probes

44104872 window update packets

16 packets received after close

29 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
111913 discarded because
reassembly queue overflow
0 packets in reass queue

63801752 connection requests

9014909 connection accepts


4449 bad connection attempts

0 looped SYN packets

0 listen queue overflows

72509660 connections established


(including accepts)
72821127 connections closed (including
296074 drops)
15811 embryonic connections dropped

165256982806 segments updated rtt (of


122109457614 attempts)
2861467 retransmit timeouts

276788 abrupt retransmit timeouts

102189 subsequent retransmit


timeouts
30 connections dropped by rexmit
timeout
96732036 fast retransmits

29010746 dupacks that did not ultimately


trigger fast retransmit
1347 persist timeouts

0 connections timed out in persist

72539247 keepalive timeouts

72522936 keepalive probes sent

16194 connections dropped by


keepalive
6344072827 correct ACK header predictions

451060244422 correct data packet header


predictions
0 segments dropped at untrusted interface

0 connection requests closed at filter

1489162723 SACK options sent

5190136809 SACK options received

0 RST segments not sent (stream.c


defense)
57 resends due to MTU discovery

28366238002 segments sent using TSO

728360267815947 bytes sent using TSO

2373229800 TSO segments truncated

169633 TSO wrapped sequence space


segments
0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

491507869524 segments received using LRO

931556270934352 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

2878746 socket flushes due to timer

604406899710 socket flushes due to TCP


flags
11196537046 mbufs batched

656293 tcp send window based extreme


flowcontrol
577 zero window increases, 655750
send buffer size increases
0 connection resets in extreme
flowcontrol (of 0 attempts)
1500 is the high threshold for extreme
flowcontrol
0 Bytes in send buffer of last
connection reset
0 Bytes is the send buffer high
water mark value of last connection reset
42 sends, 311 receives max reset
threshold reached for extreme flowcontrol
2903533007 times one or more connections
was idle
608182295 packets transferred to FreeBSD
successfully
51 packets failed to transfer to FreeBSD

11450764 SYN packets received

0 SYN packets dropped due to SYN flood


detection
11708 SYN packets dropped

15916859 receive-buffer appends beyond


capacity
6592 sockets with rcv-buf
appended beyond high-water
0 rcv-buf appends with
tcp_payload < 0 or > sb_max
0 rcv-buf appends with high-water
< 0 or > sb_max
29221 rcv-buf appends with
available space < 0
0 rcv-buf appends resulting in
invalid buffer parameters
0 rcv-buf appends resulting in
contents < 0 or > high-water
0 rcv-buf appends leaving space <
0 or > high-water
7315863 rcv-win calculations < 0:
tcp_input
124371995337 times advertised
rcv-win > calculated rcv-win: tcp_input
0 rcv-win calculations > sb_max:
tcp_input
0 rcv-buf high-water adjustments
> sb_max
0 rcv-buf high-water adjustments
< 0
0 rcv-buf high-water adjustments
< rcv-buf contents
0 decreasing rcv-buf high-water
adjustments
0 rcv-win advertisements > sb_max

0 rcv-win advertisements > rcv-


buf remaining space
0 rcv-win advertisements < 0

0 rcv-win advertisements with


invalid scale factor
0 dropped due to buffer flow
control
0 zero rcv-win advertisements
during buffer flow control

rcdn9-mc01-nas::*>

alln01-c04-svnas::> node run -node alln01-c04-


svnas-n03 -command netstat -s -p tcp

---- Default IPSpace ----

tcp:

14017268638 packets sent

2177353572 data packets


(242102959101 bytes)
1810554 data packets (1584110763
bytes) retransmitted
393545 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
11788408832 ack-only packets
(125522518 delayed)
0 URG only packets
27 window probe packets

43281932 window update packets

6414525 control packets

14681934900 packets received

1588584650 acks (for 242124753315


bytes)
95534225 duplicate acks

0 acks for unsent data

13900590365 packets
(299057095798636 bytes) received in-sequence
16023476 completely duplicate
packets (4236426468 bytes)
36015 old duplicate packets

27781 packets with some dup. data


(272820376 bytes duped)
507599840 out-of-order packets
(9866431253263 bytes)
38 packets (50652 bytes) of data
after window
36 window probes

1492833 window update packets

57 packets received after close

0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
2897 discarded due to memory
problems
2472389 connection requests

1480411 connection accepts

30 bad connection attempts

0 listen queue overflows

2785 ignored RSTs in the windows

3944530 connections established


(including accepts)
3952289 connections closed (including
26410 drops)
3671890 connections updated
cached RTT on close
3672564 connections updated
cached RTT variance on close
2904068 connections updated
cached ssthresh on close
7912 embryonic connections dropped

1588468181 segments updated rtt (of


1284032240 attempts)
839253 retransmit timeouts

19 connections dropped by rexmit


timeout
29 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
18684354 keepalive timeouts

18676476 keepalive probes sent

7878 connections dropped by


keepalive
166748553 correct ACK header predictions

12509544444 correct data packet header


predictions
1481977 syncache entries added

543 retransmitted

465 dupsyn

0 dropped

1480411 completed

0 bucket overflow

0 cache overflow

1453 reset

114 stale

0 aborted

0 badack

0 unreach

0 zone failures

1481977 cookies sent

1 cookie received

14912 hostcache entries added

0 bucket overflow
707941 SACK recovery episodes

847994 segment rexmits in SACK recovery


episodes
120053840 byte rexmits in SACK recovery
episodes
263145361 SACK options (SACK blocks)
received
503044885 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

404284 segments sent using TSO

983261406 bytes sent using TSO

111359 TSO segments truncated

0 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

11024964802 recv upcalls batched in HP

1476812981 recv upcalls made in HP

1415806620 recv upcalls made in HP


because of PSH
53462712 recv upcalls made in HP because
of sb_hiwat
7543649 recv upcalls made in HP because
of both PSH and sb_hiwat
382149117 recv upcall batch timeouts

68899322 times recv upcall read partial


sb_cc in HP
13559902832 segments received using LRO

305004003523357 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
5 Path MTU discovery black hole detection
activations
0 Path MTU discovery black hole detection
min MSS activations
0 Path MTU discovery black hole detection
failures
---- ANYVSERVER IPSpace ----

tcp:

0 packets sent

0 data packets (0 bytes)

0 data packets (0 bytes)


retransmitted
0 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
0 ack-only packets (0 delayed)

0 URG only packets


0 window probe packets

0 window update packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent data

0 packets (0 bytes) received in-


sequence
0 completely duplicate packets (0
bytes)
0 old duplicate packets

0 packets with some dup. data (0


bytes duped)
0 out-of-order packets (0 bytes)

0 packets (0 bytes) of data after


window
0 window probes

0 window update packets

0 packets received after close

0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
0 discarded due to memory
problems
0 connection requests

0 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the windows

0 connections established (including


accepts)
0 connections closed (including 0 drops)

0 connections updated cached RTT


on close
0 connections updated cached RTT
variance on close
0 connections updated cached
ssthresh on close
0 embryonic connections dropped

0 segments updated rtt (of 0 attempts)

0 retransmit timeouts

0 connections dropped by rexmit


timeout
0 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
0 keepalive timeouts

0 keepalive probes sent

0 connections dropped by
keepalive
0 correct ACK header predictions

0 correct data packet header predictions

0 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow
0 SACK recovery episodes

0 segment rexmits in SACK recovery


episodes
0 byte rexmits in SACK recovery episodes

0 SACK options (SACK blocks) received

0 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP because of PSH

0 recv upcalls made in HP because of


sb_hiwat
0 recv upcalls made in HP because of both
PSH and sb_hiwat
0 recv upcall batch timeouts

0 times recv upcall read partial sb_cc in


HP
0 segments received using LRO

0 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
0 Path MTU discovery black hole detection
activations
0 Path MTU discovery black hole detection
min MSS activations
0 Path MTU discovery black hole detection
failures
---- Cluster IPSpace ----

tcp:

8287471991 packets sent

6851902529 data packets


(54876604604674 bytes)
16396 data packets (18407380
bytes) retransmitted
395 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
1383130872 ack-only packets
(1203935457 delayed)
0 URG only packets
40 window probe packets

17999929 window update packets

34422225 control packets

7682694787 packets received

6091207416 acks (for


54875728191476 bytes)
601901239 duplicate acks

0 acks for unsent data

5864709547 packets (4031524343385


bytes) received in-sequence
8568579 completely duplicate
packets (244172 bytes)
541 old duplicate packets

0 packets with some dup. data (0


bytes duped)
126705 out-of-order packets
(551644165 bytes)
0 packets (0 bytes) of data after
window
0 window probes

13995658 window update packets

388845 packets received after


close
0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
0 discarded due to memory
problems
11937581 connection requests

12248402 connection accepts

0 bad connection attempts

0 listen queue overflows

81795 ignored RSTs in the windows

23994428 connections established


(including accepts)
24187224 connections closed (including
350879 drops)
7569997 connections updated
cached RTT on close
7570146 connections updated
cached RTT variance on close
35945 connections updated cached
ssthresh on close
191252 embryonic connections dropped

6091207416 segments updated rtt (of


5808247434 attempts)
15205 retransmit timeouts

8 connections dropped by rexmit


timeout
67 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
7606133 keepalive timeouts

7606133 keepalive probes sent

0 connections dropped by
keepalive
699566443 correct ACK header predictions

963413041 correct data packet header


predictions
12248436 syncache entries added

8 retransmitted

0 dupsyn

30 dropped

12248402 completed

0 bucket overflow

0 cache overflow

34 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

12248466 cookies sent

0 cookies received

716 hostcache entries added

0 bucket overflow
66 SACK recovery episodes

1411 segment rexmits in SACK recovery


episodes
12578380 byte rexmits in SACK recovery
episodes
137714 SACK options (SACK blocks)
received
67963 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

1233297376 segments sent using TSO

52486996644652 bytes sent using TSO

2948019454 TSO segments truncated

12219 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

13497481 recv upcalls batched in HP

753939827 recv upcalls made in HP

753926592 recv upcalls made in HP because


of PSH
12740 recv upcalls made in HP because of
sb_hiwat
495 recv upcalls made in HP because of
both PSH and sb_hiwat
5721 recv upcall batch timeouts

422 times recv upcall read partial sb_cc


in HP
1741302630 segments received using LRO

1749838662778 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
1 Path MTU discovery black hole detection
activation
0 Path MTU discovery black hole detection
min MSS activations
1 Path MTU discovery black hole detection
failure
---- ips_4294967289 IPSpace ----

tcp:

0 packets sent

0 data packets (0 bytes)

0 data packets (0 bytes)


retransmitted
0 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
0 ack-only packets (0 delayed)

0 URG only packets


0 window probe packets

0 window update packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent data

0 packets (0 bytes) received in-


sequence
0 completely duplicate packets (0
bytes)
0 old duplicate packets

0 packets with some dup. data (0


bytes duped)
0 out-of-order packets (0 bytes)

0 packets (0 bytes) of data after


window
0 window probes

0 window update packets

0 packets received after close

0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
0 discarded due to memory
problems
0 connection requests

0 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the windows

0 connections established (including


accepts)
0 connections closed (including 0 drops)

0 connections updated cached RTT


on close
0 connections updated cached RTT
variance on close
0 connections updated cached
ssthresh on close
0 embryonic connections dropped

0 segments updated rtt (of 0 attempts)

0 retransmit timeouts

0 connections dropped by rexmit


timeout
0 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
0 keepalive timeouts

0 keepalive probes sent

0 connections dropped by
keepalive
0 correct ACK header predictions

0 correct data packet header predictions

0 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow
0 SACK recovery episodes

0 segment rexmits in SACK recovery


episodes
0 byte rexmits in SACK recovery episodes

0 SACK options (SACK blocks) received

0 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP because of PSH

0 recv upcalls made in HP because of


sb_hiwat
0 recv upcalls made in HP because of both
PSH and sb_hiwat
0 recv upcall batch timeouts

0 times recv upcall read partial sb_cc in


HP
0 segments received using LRO

0 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
0 Path MTU discovery black hole detection
activations
0 Path MTU discovery black hole detection
min MSS activations
0 Path MTU discovery black hole detection
failures
---- ips_4294967293 IPSpace ----

tcp:

0 packets sent

0 data packets (0 bytes)

0 data packets (0 bytes)


retransmitted
0 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
0 ack-only packets (0 delayed)

0 URG only packets


0 window probe packets

0 window update packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent data

0 packets (0 bytes) received in-


sequence
0 completely duplicate packets (0
bytes)
0 old duplicate packets

0 packets with some dup. data (0


bytes duped)
0 out-of-order packets (0 bytes)

0 packets (0 bytes) of data after


window
0 window probes

0 window update packets

0 packets received after close

0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
0 discarded due to memory
problems
0 connection requests

0 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the windows

0 connections established (including


accepts)
0 connections closed (including 0 drops)

0 connections updated cached RTT


on close
0 connections updated cached RTT
variance on close
0 connections updated cached
ssthresh on close
0 embryonic connections dropped

0 segments updated rtt (of 0 attempts)

0 retransmit timeouts

0 connections dropped by rexmit


timeout
0 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
0 keepalive timeouts

0 keepalive probes sent

0 connections dropped by
keepalive
0 correct ACK header predictions

0 correct data packet header predictions

0 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow
0 SACK recovery episodes

0 segment rexmits in SACK recovery


episodes
0 byte rexmits in SACK recovery episodes

0 SACK options (SACK blocks) received

0 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP because of PSH

0 recv upcalls made in HP because of


sb_hiwat
0 recv upcalls made in HP because of both
PSH and sb_hiwat
0 recv upcall batch timeouts

0 times recv upcall read partial sb_cc in


HP
0 segments received using LRO

0 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
0 Path MTU discovery black hole detection
activations
0 Path MTU discovery black hole detection
min MSS activations
0 Path MTU discovery black hole detection
failures
---- ACP IPSpace ----

tcp:

4936175 packets sent

1001541 data packets (24037092


bytes)
0 data packets (0 bytes)
retransmitted
0 data packets unnecessarily
retransmitted
0 resends initiated by MTU
discovery
1931534 ack-only packets (0
delayed)
0 URG only packets
0 window probe packets

0 window update packets

2003100 control packets

4263185 packets received

2932997 acks (for 24967007 bytes)

312581 duplicate acks

0 acks for unsent data

1242649 packets (62313245 bytes)


received in-sequence
0 completely duplicate packets (0
bytes)
0 old duplicate packets

0 packets with some dup. data (0


bytes duped)
1 out-of-order packet (0 bytes)

0 packets (0 bytes) of data after


window
0 window probes

0 window update packets

71670 packets received after


close
0 discarded for bad checksums

0 discarded for bad header offset


fields
0 discarded because packet too
short
0 discarded due to memory
problems
1001542 connection requests

16 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the windows

1001557 connections established


(including accepts)
1001558 connections closed (including 1
drop)
0 connections updated cached RTT
on close
0 connections updated cached RTT
variance on close
0 connections updated cached
ssthresh on close
0 embryonic connections dropped

2932997 segments updated rtt (of 3004442


attempts)
13 retransmit timeouts

1 connection dropped by rexmit


timeout
0 persist timeouts

0 connections dropped by persist


timeout
0 Connections (fin_wait_2) dropped
because of timeout
0 keepalive timeouts

0 keepalive probes sent

0 connections dropped by
keepalive
1001343 correct ACK header predictions

312763 correct data packet header


predictions
16 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

16 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

16 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow
0 SACK recovery episodes

0 segment rexmits in SACK recovery


episodes
0 byte rexmits in SACK recovery episodes

0 SACK options (SACK blocks) received

0 SACK options (SACK blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit set

0 packets with ECN ECT(0) bit set

0 packets with ECN ECT(1) bit set

0 successful ECN handshakes

0 times ECN reduced the congestion window

0 times in ONTAP flow control

0 times exited ONTAP flow control

0 times in ONTAP flow control for zero


send window
0 times in ONTAP flow control for non-
zero send window
0 connection resets due to ONTAP extreme
flow control
0 times in ONTAP extreme flow control

0 is the maximum flow control reset


threshold reached during receive
0 is the maximum flow control reset
threshold reached during send
0 bytes is send buffer value during last
reset
0 bytes is send buffer hiwat mark during
last reset
0 times the receive window was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space segments

0 segments sent using TSO6

0 bytes sent using TSO6


0 TSO6 segments truncated

0 TSO6 wrapped sequence space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP because of PSH

0 recv upcalls made in HP because of


sb_hiwat
0 recv upcalls made in HP because of both
PSH and sb_hiwat
0 recv upcall batch timeouts

0 times recv upcall read partial sb_cc in


HP
0 segments received using LRO

0 bytes received using LRO

0 segments received using LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5 signature


received
0 packets with invalid tcp-md5 signature
received
0 packets with tcp-md5 signature mismatch

0 packets with unexpected tcp-md5


signature received
0 packets without expected tcp-md5
signature received
0 Path MTU discovery black hole detection
activations
0 Path MTU discovery black hole detection
min MSS activations
0 Path MTU discovery black hole detection
failures

alln01-c04-svnas::>

rcdn9-mc01-nas::*> debug csm session show


-error-stats

#Deferred #Timed Out


Node Pointer #Backpressured
#Timeouts Timeouts Responses
------------ ---------------- ---------------
---------- --------- ----------
rcdn9-mc01-nas-n03

ffffff800a844028 0
0 0 0
ffffff800a866028 0
0 0 0
ffffff800ab30028 0
0 0 0
ffffff800ab52028 0
0 0 0
ffffff800ab74028 0
0 0 0
ffffff800ac1e028 0
0 0 0
ffffff800ac40028 0
0 0 0
ffffff800ac62028 0
0 0 0
ffffff800ad72028 0
0 0 0
ffffff800ad94028 0
0 0 0
ffffff800adb6028 0
0 0 0
ffffff800add8028 0
0 0 0
ffffff800adfa028 0
0 0 0
ffffff800ae1c028 0
0 0 0
ffffff800ae3e028 0
0 0 0
ffffff800ae60028 0
0 0 0
ffffff800ae82028 0
0 0 0
ffffff800aea4028 0
0 0 0
ffffff800ddc4028 0
0 0 0
ffffff800de08028 0
26 0 0
ffffff800de90028 0
12 0 0
ffffff800def6028 0
0 0 0
ffffff800df18028 0
0 0 0
ffffff800df3a028 0
0 0 0
ffffff800dfc5028 0
0 0 0
ffffff800dfe7028 0
20 0 0
ffffff800e009028 0
0 0 0
ffffff800e02b028 0
0 0 0
ffffff800e04d028 0
0 0 0
ffffff800e091028 0
0 0 0
ffffff800e0b3028 0
0 0 0
ffffff800e15d028 0
0 0 0
ffffff800e1e5028 0
0 0 0
ffffff800e24b028 0
0 0 0
ffffff800e28f028 1
0 0 0
ffffff800e2b1028 0
0 0 0
ffffff800e2d3028 0
0 0 0
ffffff800e2f5028 0
0 0 0
ffffff800e35b028 0
0 0 0
ffffff800e37d028 0
0 0 0
ffffff800e3e3028 0
0 0 0
ffffff800e427028 0
0 0 0
ffffff800e449028 0
0 0 0
ffffff800e48d028 0
0 0 0
ffffff800e4af028 0
0 0 0
ffffff800e515028 0
0 0 0
ffffff800e559028 0
0 0 0
ffffff800e59d028 0
0 0 0
ffffff800e5bf028 0
0 0 0
ffffff800e5e1028 0
0 0 0
ffffff800e603028 0
0 0 0
ffffff800e625028 0
0 0 0
ffffff800e647028 0
0 0 0
ffffff800e669028 0
0 0 0
ffffff800e6ad028 0
0 0 0
ffffff800e6cf028 0
0 0 0
ffffff800e6f1028 0
0 0 0
ffffff800e757028 0
0 0 0
ffffff800e779028 0
0 0 0
ffffff800e7df028 0
0 0 0
ffffff800e801028 0
0 0 0
ffffff800e823028 28
0 0 0
ffffff800e845028 0
0 0 0
ffffff800e8ab028 0
0 0 0
ffffff800e8cd028 0
0 0 0
ffffff800e8ef028 0
16 0 0
ffffff800e911028 0
0 0 0
ffffff800e999028 0
0 0 0
ffffff800e9ff028 0
0 0 0
ffffff800ea21028 0
0 0 0
ffffff800ea43028 0
0 0 0
ffffff800ef3c028 0
0 0 0
ffffff800ef5e028 0
0 0 0
ffffff800ef80028 0
0 0 0
ffffff800efc4028 0
0 0 0
ffffff800efe6028 0
0 0 0
ffffff800f04c028 0
0 0 0
ffffff800f06e028 0
0 0 0
ffffff800f0b2028 0
0 0 0
ffffff800f0d4028 0
0 0 0
ffffff800f0f6028 0
0 0 0
ffffff800f118028 0
0 0 0
ffffff800f13a028 0
0 0 0
ffffff800f15c028 0
0 0 0
ffffff800f17e028 0
0 0 0
ffffff800f1a0028 0
0 0 0
ffffff800f1c2028 0
0 0 0
ffffff800f1e4028 0
0 0 0
ffffff800f206028 0
0 0 0
ffffff800f228028 0
0 0 0
ffffff800f26c028 0
0 0 0
ffffff800f2d2028 0
0 0 0
ffffff800f2f4028 0
0 0 0
ffffff800f338028 0
0 0 0
ffffff800f37c028 0
0 0 0
ffffff800f39e028 0
0 0 0
ffffff800f3c0028 0
0 0 0
ffffff800f404028 0
0 0 0
ffffff800f46a028 0
0 0 0
ffffff800f4f2028 278
0 0 0
ffffff800f536028 0
0 0 0
ffffff800f558028 0
0 0 0
ffffff800f57a028 0
0 0 0
ffffff800f5be028 0
0 0 0
ffffff800f778028 0
0 0 0
ffffff800f79a028 0
0 0 0
ffffff800f7bc028 0
0 0 0
ffffff800f822028 0
0 0 0
ffffff800f844028 0
0 0 0
ffffff800f9ba028 0
0 0 0
ffffff800fa20028 0
0 0 0
ffffff800fa42028 0
0 0 0
ffffff800fa64028 0
0 0 0
ffffff8010140028 0
0 0 0
ffffff8010162028 0
0 0 0
ffffff80101a6028 0
0 0 0
ffffff80101c8028 0
0 0 0
ffffff80101ea028 0
0 0 0
ffffff801020c028 0
0 0 0
ffffff8010250028 0
0 0 0
ffffff8010272028 0
0 0 0
ffffff80102b6028 0
0 0 0
ffffff80102d8028 0
0 0 0
ffffff801031c028 0
0 0 0
ffffff801033e028 0
0 0 0
ffffff8010382028 0
0 0 0
ffffff80103a4028 0
0 0 0
ffffff80103c6028 0
0 0 0
ffffff80103e8028 0
0 0 0
ffffff801042c028 0
0 0 0
ffffff801044e028 0
0 0 0
ffffff8010470028 16
0 0 0
ffffff8010492028 0
0 0 0
ffffff80104d6028 0
0 0 0
ffffff80104f8028 0
0 0 0
ffffff801051a028 0
0 0 0
ffffff801053c028 0
0 0 0
ffffff8010580028 0
0 0 0
ffffff80105a2028 0
0 0 0
ffffff80105c4028 0
0 0 0
ffffff80105e6028 0
2 0 0
ffffff801062a028 0
0 0 0
ffffff801066e028 0
27 0 0
ffffff80106b2028 0
0 0 0
ffffff80106d4028 0
0 0 0
ffffff80106f6028 0
0 0 0
ffffff8010718028 0
0 0 0
ffffff801073a028 0
0 0 0
ffffff801075c028 0
0 0 0
ffffff801077e028 0
0 0 0
ffffff80107a0028 0
0 0 0
ffffff80107c2028 0
0 0 0
ffffff80107e4028 0
191 0 0
ffffff8010828028 0
0 0 0
ffffff801084a028 0
0 0 0
ffffff801086c028 0
0 0 0
ffffff801088e028 0
0 0 0
ffffff80108b0028 0
0 0 0
ffffff80108d2028 0
0 0 0
ffffff80108f4028 0
0 0 0
ffffff8010916028 0
0 0 0
ffffff8010938028 0
0 0 0
ffffff801095a028 0
0 0 0
rcdn9-mc01-nas-n04

ffffff800a822028 0
0 0 0
ffffff800a844028 0
0 0 0
ffffff800abda028 0
0 0 0
ffffff800abfc028 0
0 0 0
ffffff800ac1e028 0
0 0 0
ffffff800ac62028 0
0 0 0
ffffff800ac84028 0
0 0 0
ffffff800aca6028 0
0 0 0
ffffff800acc8028 0
0 0 0
ffffff800acea028 0
0 0 0
ffffff800ad0c028 0
0 0 0
ffffff800ad2e028 0
0 0 0
ffffff800ad50028 0
0 0 0
ffffff800ad94028 0
3 0 0
ffffff800adb6028 0
0 0 0
ffffff800add8028 0
0 0 0
ffffff800adfa028 0
0 0 0
ffffff800ae1c028 0
0 0 0
ffffff800ae3e028 38
0 0 0
ffffff800ae60028 0
0 0 0
ffffff800dd7f028 0
0 0 0
ffffff800dda1028 0
0 0 0
ffffff800ddc3028 0
0 0 0
ffffff800de07028 0
0 0 0
ffffff800de4b028 0
0 0 0
ffffff800de6d028 0
13 0 0
ffffff800de8f028 0
0 0 0
ffffff800ded3028 0
0 0 0
ffffff800df17028 0
0 0 0
ffffff800df39028 0
0 0 0
ffffff800df5b028 0
0 0 0
ffffff800df7d028 0
0 0 0
ffffff800df9f028 0
0 0 0
ffffff800dfe3028 0
0 0 0
ffffff800e005028 0
0 0 0
ffffff800e027028 0
0 0 0
ffffff800e049028 0
0 0 0
ffffff800e06b028 0
0 0 0
ffffff800e0af028 0
0 0 0
ffffff800e0d1028 0
0 0 0
ffffff800e0f3028 0
0 0 0
ffffff800e137028 0
0 0 0
ffffff800e159028 0
0 0 0
ffffff800e19d028 0
0 0 0
ffffff800e1bf028 0
0 0 0
ffffff800e225028 0
0 0 0
ffffff800e247028 0
0 0 0
ffffff800e269028 0
0 0 0
ffffff800e2ad028 0
0 0 0
ffffff800e2cf028 0
0 0 0
ffffff800e313028 0
0 0 0
ffffff800e335028 0
0 0 0
ffffff800e357028 0
0 0 0
ffffff800e379028 0
0 0 0
ffffff800e39b028 0
0 0 0
ffffff800e401028 0
0 0 0
ffffff800e445028 0
0 0 0
ffffff800e467028 0
0 0 0
ffffff800e4ab028 0
0 0 0
ffffff800e4cd028 0
0 0 0
ffffff800e533028 0
0 0 0
ffffff800e555028 0
0 0 0
ffffff800e577028 0
0 0 0
ffffff800e599028 0
0 0 0
ffffff800e5dd028 6
0 0 0
ffffff800e5ff028 0
0 0 0
ffffff800e621028 0
0 0 0
ffffff800e643028 0
0 0 0
ffffff800e665028 0
9 0 0
ffffff800e6a9028 0
0 0 0
ffffff800e6cb028 0
0 0 0
ffffff800e70f028 0
0 0 0
ffffff800e7b9028 0
0 0 0
ffffff800e7fd028 0
0 0 0
ffffff800e81f028 0
0 0 0
ffffff800e841028 0
0 0 0
ffffff800e8a7028 0
17 0 0
ffffff800e8eb028 0
0 0 0
ffffff800e90d028 0
0 0 0
ffffff800e92f028 0
0 0 0
ffffff800e951028 0
0 0 0
ffffff800e973028 0
0 0 0
ffffff800e995028 0
0 0 0
ffffff800e9b7028 0
0 0 0
ffffff800e9fb028 0
0 0 0
ffffff800ea1d028 0
0 0 0
ffffff800ef1f028 0
0 0 0
ffffff800ef41028 0
0 0 0
ffffff800ef85028 0
0 0 0
ffffff800efa7028 0
0 0 0
ffffff800efc9028 0
0 0 0
ffffff800efeb028 0
0 0 0
ffffff800f00d028 0
0 0 0
ffffff800f051028 0
0 0 0
ffffff800f073028 0
0 0 0
ffffff800f095028 0
0 0 0
ffffff800f0b7028 0
0 0 0
ffffff800f0d9028 0
0 0 0
ffffff800f0fb028 0
0 0 0
ffffff800f11d028 0
0 0 0
ffffff800f13f028 0
0 0 0
ffffff800f161028 0
0 0 0
ffffff800f1a5028 0
0 0 0
ffffff800f22d028 0
0 0 0
ffffff800f24f028 0
0 0 0
ffffff800f271028 0
0 0 0
ffffff800f293028 0
0 0 0
ffffff800f31b028 0
0 0 0
ffffff800f35f028 0
0 0 0
ffffff800f3c5028 0
0 0 0
ffffff800f607028 0
0 0 0
ffffff800f7c1028 0
0 0 0
ffffff800f7e3028 0
0 0 0
ffffff800f805028 0
0 0 0
ffffff800f827028 0
0 0 0
ffffff800f849028 47
16 0 0
ffffff800f86b028 0
0 0 0
ffffff800f8d1028 0
0 0 0
ffffff800f915028 0
0 0 0
ffffff800f937028 0
0 0 0
ffffff800f97b028 0
0 0 0
ffffff800f99d028 0
0 0 0
ffffff800faf1028 0
154 0 0
ffffff800fb13028 0
0 0 0
ffffff800fb57028 0
0 0 0
ffffff800fbbd028 0
0 0 0
ffffff80100c6028 0
0 0 0
ffffff80100e8028 0
0 0 0
ffffff801012c028 0
0 0 0
ffffff801014e028 0
0 0 0
ffffff8010170028 0
0 0 0
ffffff8010192028 0
0 0 0
ffffff80101b4028 0
0 0 0
ffffff801023c028 0
0 0 0
ffffff8010261028 0
0 0 0
ffffff8010283028 0
0 0 0
ffffff80102a5028 0
0 0 0
ffffff80102c7028 0
0 0 0
ffffff801030b028 0
0 0 0
ffffff801034f028 0
0 0 0
ffffff80103d7028 0
0 0 0
ffffff80103f9028 0
0 0 0
ffffff801041b028 0
0 0 0
ffffff8010440028 0
0 0 0
ffffff8010462028 0
0 0 0
ffffff8010484028 0
0 0 0
ffffff80104a6028 0
51 0 0
ffffff80104c8028 0
0 0 0
ffffff80104ea028 0
0 0 0
ffffff801052e028 0
0 0 0
ffffff8010550028 142
11 0 0
ffffff80105b6028 0
0 0 0
ffffff80105d8028 0
0 0 0
ffffff80105fa028 0
0 0 0
ffffff801061c028 0
0 0 0
ffffff801063e028 0
0 0 0
ffffff8010660028 0
0 0 0
ffffff8010682028 0
0 0 0
ffffff80106a4028 0
0 0 0
ffffff80106c6028 0
0 0 0
ffffff80106e8028 0
0 0 0
ffffff801070a028 0
0 0 0
ffffff801074e028 0
0 0 0
ffffff8010770028 0
0 0 0
ffffff8010792028 0
0 0 0
328 entries were displayed.

rcdn9-mc01-nas::*> version

NetApp Release 9.1P17: Thu Feb 28 08:05:25 UTC


2019

alln01-c04-svnas-n03

fffffe00219ce028 0
0 0 0 0 0 0
fffffe00219ef028 0
0 0 0 0 0 0
fffffe0033a28028 0
0 0 0 0 0 0
fffffe0033a49028 0
0 0 0 0 0 0
fffffe0033a6a028 0
0 0 0 0 0 0
fffffe0033a8b028 0
0 0 0 0 0 0
fffffe0033aac028 0
0 0 0 0 0 0
fffffe0033acd028 0
0 0 0 0 0 0
fffffe0033aee028 0
0 0 0 0 0 0
fffffe0033b0f028 0
0 0 0 0 0 0
fffffe0033b51028 0
0 0 0 0 0 0
fffffe0033b72028 0
0 0 0 0 0 0
fffffe0033de5028 0
0 0 0 0 0 0
fffffe0033e06028 0
0 0 0 0 0 0
fffffe0033e27028 0
0 0 0 0 0 0
fffffe0033e48028 0
0 0 0 0 0 0
fffffe0033eed028 0
0 0 0 0 0 0
fffffe0033f0e028 0
0 0 0 0 0 0
fffffe0033f50028 0
0 0 0 0 0 0
fffffe0033fd4028 0
0 0 0 0 0 0
fffffe0033ff5028 0
0 0 0 0 0 0
fffffe0034016028 0
0 0 0 0 0 0
fffffe0034037028 0
0 0 0 0 0 0
fffffe0034058028 0
0 0 0 0 0 0
fffffe0034079028 0
0 0 0 0 0 0
fffffe003413f028 0
0 0 0 0 0 0
fffffe0034160028 0
0 0 0 0 0 0
fffffe0034181028 0
0 0 0 0 0 0
fffffe00341a2028 0
0 0 0 0 0 0
fffffe00341c3028 0
0 0 0 0 0 0
fffffe0034226028 0
0 0 0 0 0 0
fffffe0034247028 0
0 0 0 0 0 0
fffffe0034268028 0
0 0 0 0 0 0
fffffe0034289028 0
0 0 0 0 0 0
fffffe00342cb028 0
0 0 0 0 0 0
fffffe003432e028 0
0 0 0 0 0 0
fffffe0034370028 0
0 0 0 0 0 0
fffffe00343b2028 0
0 0 0 0 0 0
fffffe00343d3028 0
0 0 0 0 0 0
fffffe00343f4028 0
0 0 0 0 0 0
fffffe0034415028 0
0 0 0 0 0 0
fffffe0034436028 0
0 0 0 0 0 0
fffffe0034478028 0
0 0 0 0 0 0
fffffe0034499028 0
0 0 0 0 0 0
fffffe00344ba028 0
0 0 0 0 0 0
fffffe00344db028 0
0 0 0 0 0 0
fffffe00355f0028 0
0 0 0 0 0 0
fffffe0035611028 0
0 0 0 0 0 0
fffffe0035632028 0
0 0 0 0 0 0
fffffe00356d7028 0
0 0 0 0 0 0
fffffe0035719028 0
0 0 0 0 0 0
fffffe003573a028 0
0 0 0 0 0 0
fffffe00357df028 0
0 0 0 0 0 0
fffffe0035800028 0
0 0 0 0 0 0
fffffe0035821028 0
0 0 0 0 0 0
fffffe0035842028 0
0 0 0 0 0 0
fffffe00358a5028 0
0 0 0 0 0 0
fffffe003596b028 0
0 0 0 0 0 0
fffffe003598c028 0
0 0 0 0 0 0
fffffe00359ad028 0
0 0 0 0 0 0
fffffe0035a52028 0
0 0 0 0 0 0
fffffe0035a73028 0
0 0 0 0 0 0
fffffe0035a94028 0
0 0 0 0 0 0
fffffe0035ab5028 0
0 0 0 0 0 0
fffffe0035af7028 0
0 0 0 0 0 0
fffffe0035b18028 0
0 0 0 0 0 0
fffffe0035b39028 0
0 0 0 0 0 0
fffffe0035b5a028 0
0 0 0 0 0 0
fffffe0035bbd028 0
0 0 0 0 0 0
fffffe0035bff028 0
0 0 0 0 0 0
fffffe0035c41028 0
0 0 0 0 0 0
fffffe0035c62028 0
0 0 0 0 0 0
fffffe0035c83028 0
0 0 0 0 0 0
fffffe0035dcd028 0
0 0 0 0 0 0
fffffe0035e0f028 0
0 0 0 0 0 0
fffffe0035e30028 0
0 0 0 0 0 0
fffffe0035f9b028 0
0 0 0 0 0 0
fffffe0035fdd028 0
0 0 0 0 0 0
fffffe0035ffe028 0
0 0 0 0 0 0
fffffe0036040028 0
0 0 0 0 0 0
fffffe0036061028 0
0 0 0 0 0 0
fffffe0036082028 0
0 0 0 0 0 0
fffffe00360a3028 0
0 0 0 0 0 0
fffffe00360c4028 0
0 0 0 0 0 0
fffffe0036106028 0
0 0 0 0 0 0
fffffe0036127028 0
0 0 0 0 0 0
fffffe0036148028 0
0 0 0 0 0 0
fffffe0036169028 0
0 0 0 0 0 0
fffffe003618a028 0
0 0 0 0 0 0
fffffe00361ab028 0
0 0 0 0 0 0
fffffe00368f5028 0
0 0 0 0 0 0
fffffe0036cf4028 0
0 0 0 0 0 0
fffffe0036d15028 0
0 0 0 0 0 0
fffffe0036ddb028 0
0 0 0 0 0 0
fffffe0036e1d028 0
0 0 0 0 0 0
fffffe0036e3e028 0
0 0 0 0 0 0
fffffe0036ea1028 0
0 0 0 0 0 0
fffffe0036f04028 0
0 0 0 0 0 0
fffffe0036f46028 0
0 0 0 0 0 0
fffffe0036f67028 0
0 0 0 0 0 0
fffffe0036f88028 0
0 0 0 0 0 0
fffffe0036fca028 0
0 0 0 0 0 0
fffffe0036feb028 0
0 0 0 0 0 0
fffffe00371b9028 0
0 0 0 0 0 0
fffffe00371da028 0
0 0 0 0 0 0
fffffe003725e028 0
0 0 0 0 0 0
fffffe0037303028 0
0 0 0 0 0 0
fffffe00373a8028 0
0 0 0 0 0 0
fffffe003742c028 0
0 0 0 0 0 0
fffffe00374f2028 0
0 0 0 0 0 0
fffffe0037513028 0
0 0 0 0 0 0
fffffe0037534028 0
0 0 0 0 0 0
fffffe00385dc028 0
0 0 0 0 0 0
fffffe0038660028 0
0 0 0 0 0 0
fffffe0038681028 0
0 0 0 0 0 0
fffffe00386e4028 0
0 0 0 0 0 0
fffffe0038705028 0
0 0 0 0 0 0
fffffe0038747028 0
0 0 0 0 0 0
fffffe0038768028 0
0 0 0 0 0 0
fffffe0038789028 0
0 0 0 0 0 0
fffffe003884f028 0
0 0 0 0 0 0
fffffe0038870028 0
0 0 0 0 0 0
fffffe0038891028 0
0 0 0 0 0 0
fffffe00388b2028 0
0 0 0 0 0 0
fffffe00388d3028 0
0 0 0 0 0 0
fffffe0038915028 0
0 0 0 0 0 0

alln01-c04-svnas::*> version

NetApp Release 9.5P9: Mon Oct 28


09:18:10 UTC 2019

alln01-c04-svnas::*>

alln01-c04-svnas::> snapmirror show


-destination-path *sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A
Progress

Source Destination Mirror


Relationship Total Last

Path Type Path State


Status Progress Healthy Updated

----------- ---- ------------


------- -------------- --------- ------- --------

rcdn9-mc01-nas-
prod:migen002_gg_REMOTE2_vol010A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A Snapmirrored Transferring
52.76GB false 05/24 21:40:26

alln01-c04-svnas::> snapmirror abort


-destination-path alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Operation is queued: snapmirror


abort for the relationship with destination "alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A".

alln01-c04-svnas::> snapmirror show


-destination-path *sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Progress

Source Destination Mirror


Relationship Total Last

Path Type Path State


Status Progress Healthy Updated

----------- ---- ------------


------- -------------- --------- ------- --------

rcdn9-mc01-nas-
prod:migen002_gg_REMOTE2_vol010A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A Snapmirrored Idle - false
-

alln01-c04-svnas::> snapmirror show


-destination-path alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Source
Path: rcdn9-mc01-nas-prod:migen002_gg_REMOTE2_vol010A
Destination
Path: alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A

Relationship
Type: XDP

Relationship Group
Type: none

SnapMirror
Schedule: daily2

SnapMirror Policy
Type: vault

SnapMirror
Policy: snapvault90

Tries
Limit: -

Throttle
(KB/sec): unlimited

Mirror
State: Snapmirrored

Relationship
Status: Idle

File Restore File


Count: -

File Restore File


List: -

Transfer
Snapshot: -

Snapshot
Progress: -

Total
Progress: -

Network Compression
Ratio: -

Snapshot
Checkpoint: 51.94GB

Newest
Snapshot: daily.2020-05-18_0010

Newest Snapshot
Timestamp: 05/18 00:10:00

Exported
Snapshot: daily.2020-05-18_0010
Exported Snapshot
Timestamp: 05/18 00:10:00

Healthy: false

Unhealthy
Reason: Transfer failed.

Destination Volume
Node: alln01-c04-svnas-n03

Relationship
ID: 0b6698db-0719-11ea-8b80-00a098af1c35

Current Operation
ID: -

Transfer
Type: -

Transfer
Error: -

Current
Throttle: -

Current Transfer
Priority: -

Last Transfer
Type: update

Last Transfer
Error: Transfer aborted.

Last Transfer
Size: -

Last Transfer Network Compression


Ratio: -

Last Transfer
Duration: -

Last Transfer
From: rcdn9-mc01-nas-prod:migen002_gg_REMOTE2_vol010A

Last Transfer End


Timestamp: 05/24 21:41:03

Progress Last
Updated: -

Relationship
Capability: 8.2 and above

Lag
Time: 165:31:33

Identity Preserve Vserver


DR: -

Volume MSIDs
Preserved: -

Is Auto Expand
Enabled: -

Number of Successful
Updates: 133

Number of Failed
Updates: 1

Number of Successful
Resyncs: 0

Number of Failed
Resyncs: 0

Number of Successful
Breaks: 0

Number of Failed
Breaks: 0

Total Transfer
Bytes: 24888893396874

Total Transfer Time in


Seconds: 544472

alln01-c04-svnas::>

rcdn9-mc01-nas::*> snapmirror list-


destinations -source-volume-node rcdn9-mc01-nas-n04 -destination-path

rcdn9-mc01-nas::*> systemshell -node


rcdn9-mc01-nas-n04 sudo sysctl net.inet.tcp.reass.maxqueuelen=10000
(system node systemshell)

net.inet.tcp.reass.maxqueuelen: 2000
-> 10000

rcdn9-mc01-nas::*> systemshell -node


rcdn9-mc01-nas-n04 sudo sysctl net.inet.tcp.reass.maxqueuelen
(system node systemshell)
net.inet.tcp.reass.maxqueuelen:
10000

rcdn9-mc01-nas::*>

[root@rtp1-vm-san-mgr1 ~]# cat snap


| grep XDP | grep alln01-c04-svnas

rcdn9-mc01-nas-
prod:migen002_APPS_GG_REMOTE44_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_APPS_GG_REMOTE44_vol001 Idle - - 8d445893-
8d45-11e7-b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_CMIX_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_CMIX_vol001 Idle - - e3314388-dbc4-11e7-b058-
00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_CMIX_vol002 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_CMIX_vol002 Idle - - ec9ed45c-dbc4-11e7-b058-
00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_CMIX_vol003 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_CMIX_vol003 Idle - - 488b5bc3-f44e-11e6-af37-
00a098af2d51
rcdn9-mc01-nas-
prod:migen002_OA_CRTPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_OA_CRTPRD_vol001 Idle - - 0c283c42-5ecb-11e7-
a56c-00a098af2a11
rcdn9-mc01-nas-prod:migen002_acl XDP
alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_acl Idle - - 81273825-dee9-
11e7-b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_app_BAMPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_app_BAMPRD_vol001 Idle - - 4b0de6e5-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_app_CMWPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_app_CMWPRD_vol001 Idle - - 973864ca-8d45-
11e7-b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_app_ECPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_app_ECPRD_vol001 Idle - - 4da1ff33-f44e-11e6-
af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_app_ODBPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_app_ODBPRD_vol001 Idle - - 50330bed-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_app_OPSPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_app_OPSPRD_vol001 Idle - - 52bdc766-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_admin XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_admin Idle - - 554ffd59-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_backup XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_backup Idle - - 57feeeb2-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_binlog XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_binlog Idle - - 5a9dda8b-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_data XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_data Idle - - 5d39d98e-f44e-11e6-
af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_mysql XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_mysql Idle - - 5fcb275e-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_ccrcmemcach_product XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_ccrcmemcach_product Idle - - 626bcc40-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_CLF_vol007A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_CLF_vol007A Transferring 86.30MB 05/24
21:35:03 2757308e-9c42-11e8-b331-00a098af1b4b
rcdn9-mc01-nas-
prod:migen002_gg_CSF_vol005A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_CSF_vol005A Transferring 27.43GB 05/24
21:35:03 679048ea-f44e-11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE1_vol009A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE1_vol009A Idle - - 6a27656d-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE2_vol010A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A Transferring 52.08GB 05/24
21:35:03 0b6698db-0719-11ea-8b80-00a098af1c35
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE34_vol019A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE34_vol019A Idle - - 7221328a-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE37_vol001A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE37_vol001A Idle - - 74c7eece-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE3_vol001A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE3_vol001A Transferring 276.0GB 05/24
21:35:03 776d6085-f44e-11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE_vol013A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE_vol013A Idle - - 7a14944e-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-prod:migen002_vol001
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_vol001 Idle - -
70093657-98f1-11e7-b058-00a098af1b3d

rcdn9-mc01-nas-prod:migen002_vol002
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_vol002 Idle - -
10ac6b57-5ecb-11e7-a56c-00a098af2a11
rcdn9-mc01-nas-prod:migen002_vol003
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen002_vol003 Transferring
383.0GB 05/24 21:35:03 6f0ecfd1-5626-11e7-a56c-00a098af2a11
rcdn9-mc01-nas-
prod:migen003_CSFPRD02_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_CSFPRD02_vol001 Idle - - 03a180c5-dbc5-11e7-
b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen003_DMRPRD_vol004 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_DMRPRD_vol004 Idle - - 7cbd23bb-f44e-11e6-
af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen003_FINPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_FINPRD_vol001 Idle - - 19d2dbc2-dbc5-11e7-
b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen003_MMXPRD_vol005 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_MMXPRD_vol005 Idle - - df367dc3-870a-11e8-
b7fa-00a098af2d51
rcdn9-mc01-nas-
prod:migen003_OPOPRD_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_OPOPRD_vol001 Idle - - 26248e96-dbc5-11e7-
9b0e-00a098af2fdb
rcdn9-mc01-nas-
prod:migen003_ggcssw_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_ggcssw_vol001 Idle - - 4505fc46-dbc5-11e7-
b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen003_svs_brm_apps_xxmd XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen003_svs_brm_apps_xxmd Idle - - 4e3c7fd3-dbc5-
11e7-b058-00a098af1b3d
rcdn9-mc01-nas-prod:migen003_vol001
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen003_vol001 Idle - -
59818b73-dbc5-11e7-b058-00a098af1b3d

rcdn9-mc01-nas-prod:migen003_vol002
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen003_vol002 Idle - -
63bd5e58-dbc5-11e7-b058-00a098af1b3d

rcdn9-mc01-nas-prod:migen004_vol001
XDP alln01-c04-svnas-rcdn9:sv_rcdn9_mc01_nas_prod_migen004_vol001 Transferring
8.52GB 05/24 21:35:03 f0fb6a13-135a-11e7-a56c-00a098af2a11
[root@rtp1-vm-san-mgr1 ~]# cat snap
| grep XDP | grep alln01-c04-svnas | grep REM

rcdn9-mc01-nas-
prod:migen002_APPS_GG_REMOTE44_vol001 XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_APPS_GG_REMOTE44_vol001 Idle - - 8d445893-
8d45-11e7-b058-00a098af1b3d
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE1_vol009A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE1_vol009A Idle - - 6a27656d-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE2_vol010A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE2_vol010A Transferring 52.08GB 05/24
21:35:03 0b6698db-0719-11ea-8b80-00a098af1c35
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE34_vol019A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE34_vol019A Idle - - 7221328a-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE37_vol001A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE37_vol001A Idle - - 74c7eece-f44e-
11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE3_vol001A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE3_vol001A Transferring 276.0GB 05/24
21:35:03 776d6085-f44e-11e6-af37-00a098af2d51
rcdn9-mc01-nas-
prod:migen002_gg_REMOTE_vol013A XDP alln01-c04-svnas-
rcdn9:sv_rcdn9_mc01_nas_prod_migen002_gg_REMOTE_vol013A Idle - - 7a14944e-f44e-
11e6-af37-00a098af2d51
[root@rtp1-vm-san-mgr1 ~]#

alln01-c01-
prod:migen018_tableau_vol001->alln01-c07-svnas-
alln01:sv_alln01_c01_prod_migen018_tableau_vol001

alln01-c04-svnas::*> systemshell
alln01-c04-svnas-n03 "sudo tcpdump -n -B 40000 -i a1a-150 -s 200 -C 1000 -W 2 -w
/mroot/etc/crash/tcpdump_destination.trc host 10.31.75.21"

(system node systemshell)

tcpdump: listening on a1a-150, link-


type EN10MB (Ethernet), capture size 200 bytes

^C3988 packets captured

73399 packets received by filter

0 packets dropped by kernel

rcdn9-mc01-nas::*>

rcdn9-mc01-nas::*>

rcdn9-mc01-nas::*> node run -node


rcdn9-mc01-nas-n04 pktt start a1z -d /etc/crash -s 10G -b 10m -m 200 -i
173.36.11.230
Warning: TSO is enabled on interface
a1z.
A trace captured at another
point may not have a 1-to-1 frame correspondence with this trace.
a1z: started packet trace
rcdn9-mc01-nas::*>

rcdn9-mc01-nas::*> node run -node


rcdn9-mc01-nas-n04 pktt stop all

pktt not active on interface e4a

Warning: TSO is enabled on interface


a1z.
A trace captured at another
point may not have a 1-to-1 frame correspondence with this trace.
a1z: Tracing stopped and packet
trace buffers released.

pktt not active on interface e8a

pktt not active on interface e0M

pktt not active on interface lo

pktt not active on interface losk

pktt not active on interface e0S-16

pktt not active on interface a1a-170

pktt not active on interface a1a-172

rcdn9-mc01-nas::> autosupport invoke


-node rcdn9-mc01-nas-n04 -type all -

-message -uri -force

rcdn9-mc01-nas::> autosupport invoke


-node rcdn9-mc01-nas-n04 -type all -message SV

The AutoSupport was successfully


invoked on node "rcdn9-mc01-nas-n04" (sequence number: 906).

rcdn9-mc01-nas::> row 0

(rows)

rcdn9-mc01-nas::> node run -node


rcdn9-mc01-nas-n04 -command netstat -s -p tcp

tcp:

794239659229 packets sent

694738775546 data
packets (1809416031329627 bytes)

20740297 data
packets (156030157099 bytes) retransmitted

7185952286 ack-only
packets (403805708 delayed)

0 URG only packets

839 window probe


packets

92157792294 window
update packets

136397974 control
packets

622697079245 packets
received

165207223433 acks
(for 1808142242859205 bytes)

3186409379 duplicate
acks

0 acks for unsent


data

534454867771 packets
(941360539517073 bytes) received in-sequence

264967879 completely
duplicate packets (42621833216 bytes)

61320 old duplicate


packets

11503 packets with


some duplicate data (45417391 bytes duped)

964698990 out-of-
order packets (2975583334626 bytes)

8630 packets (0
bytes) of data after window

0 window probes

44108342 window
update packets

16 packets received
after close

29 discarded for bad


checksums
0 discarded for bad
header offset fields

0 discarded because
packet too short

111913 discarded
because reassembly queue overflow

0 packets in reass queue

63808216 connection requests

9016461 connection accepts

4449 bad connection attempts

0 looped SYN packets

0 listen queue overflows

72517671 connections
established (including accepts)

72829142 connections closed


(including 296079 drops)

15811 embryonic connections


dropped

165270740531 segments
updated rtt (of 122119303630 attempts)

2861557 retransmit timeouts

276804 abrupt
retransmit timeouts

102190 subsequent
retransmit timeouts

30 connections
dropped by rexmit timeout

96737042 fast retransmits

29014454 dupacks that did


not ultimately trigger fast retransmit

1347 persist timeouts

0 connections timed out in


persist

72555732 keepalive timeouts

72539421 keepalive
probes sent
16194 connections
dropped by keepalive

6344174393 correct ACK


header predictions

451177844744 correct data


packet header predictions

0 segments dropped at
untrusted interface

0 connection requests closed


at filter

1489532305 SACK options sent

5190777419 SACK options


received

0 RST segments not sent


(stream.c defense)

57 resends due to MTU


discovery

28366238002 segments sent


using TSO

728360267815947 bytes sent


using TSO

2373229800 TSO segments


truncated

169633 TSO wrapped sequence


space segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

491625077391 segments
received using LRO

931769824775181 bytes
received using LRO

0 segments received using


LRO6

0 bytes received using LRO6


2879515 socket flushes due
to timer

604537373919 socket flushes


due to TCP flags

11198247918 mbufs batched

656299 tcp send window based


extreme flowcontrol

577 zero window


increases, 655756 send buffer size increases

0 connection resets in
extreme flowcontrol (of 0 attempts)

1500 is the high threshold


for extreme flowcontrol

0 Bytes in send
buffer of last connection reset

0 Bytes is the send


buffer high water mark value of last connection reset

42 sends, 311 receives max


reset threshold reached for extreme flowcontrol

2904147039 times one or more


connections was idle

608328434 packets
transferred to FreeBSD successfully

51 packets failed to
transfer to FreeBSD

11452974 SYN packets


received

0 SYN packets dropped due to


SYN flood detection

11709 SYN packets dropped

15921648 receive-buffer
appends beyond capacity

6593 sockets with


rcv-buf appended beyond high-water

0 rcv-buf appends
with tcp_payload < 0 or > sb_max

0 rcv-buf appends
with high-water < 0 or > sb_max

29229 rcv-buf
appends with available space < 0

0 rcv-buf appends
resulting in invalid buffer parameters

0 rcv-buf appends
resulting in contents < 0 or > high-water

0 rcv-buf appends
leaving space < 0 or > high-water

7318055 rcv-win
calculations < 0: tcp_input

124382192499 times
advertised rcv-win > calculated rcv-win: tcp_input

0 rcv-win
calculations > sb_max: tcp_input

0 rcv-buf high-water
adjustments > sb_max

0 rcv-buf high-water
adjustments < 0

0 rcv-buf high-water
adjustments < rcv-buf contents

0 decreasing rcv-buf
high-water adjustments

0 rcv-win
advertisements > sb_max

0 rcv-win
advertisements > rcv-buf remaining space

0 rcv-win
advertisements < 0

0 rcv-win
advertisements with invalid scale factor

0 dropped due to
buffer flow control

0 zero rcv-win
advertisements during buffer flow control

rcdn9-mc01-nas::> set diag

Warning: These diagnostic commands


are for use by NetApp personnel only.
Do you want to continue? {y|n}: y

rcdn9-mc01-nas::*> debug csm session


show -error-stats -node rcdn9-mc01-nas-n04

#Deferred #Timed Out


Node Pointer
#Backpressured #Timeouts Timeouts Responses

------------ ----------------
--------------- ---------- --------- ----------

rcdn9-mc01-nas-n04

ffffff800a822028
0 0 0 0

ffffff800a844028
0 0 0 0

ffffff800abda028
0 0 0 0

ffffff800abfc028
0 0 0 0

ffffff800ac1e028
0 0 0 0

ffffff800ac62028
0 0 0 0

ffffff800ac84028
0 0 0 0

ffffff800aca6028
0 0 0 0

ffffff800acc8028
0 0 0 0

ffffff800acea028
0 0 0 0

ffffff800ad0c028
0 0 0 0

ffffff800ad2e028
0 0 0 0

ffffff800ad50028
0 0 0 0

ffffff800ad94028
0 3 0 0
ffffff800adb6028
0 0 0 0

ffffff800add8028
0 0 0 0

ffffff800adfa028
0 0 0 0

ffffff800ae1c028
0 0 0 0

ffffff800ae3e028
38 0 0 0

ffffff800ae60028
0 0 0 0

ffffff800dd7f028
0 0 0 0

ffffff800dda1028
0 0 0 0

ffffff800ddc3028
0 0 0 0

ffffff800de07028
0 0 0 0

ffffff800de4b028
0 0 0 0

ffffff800de6d028
0 13 0 0

ffffff800de8f028
0 0 0 0

ffffff800ded3028
0 0 0 0

ffffff800df17028
0 0 0 0

ffffff800df39028
0 0 0 0

ffffff800df5b028
0 0 0 0

ffffff800df7d028
0 0 0 0

ffffff800df9f028
0 0 0 0

ffffff800dfe3028
0 0 0 0
ffffff800e005028
0 0 0 0

ffffff800e027028
0 0 0 0

ffffff800e049028
0 0 0 0

ffffff800e06b028
0 0 0 0

ffffff800e0af028
0 0 0 0

ffffff800e0d1028
0 0 0 0

ffffff800e0f3028
0 0 0 0

ffffff800e137028
0 0 0 0

ffffff800e159028
0 0 0 0

ffffff800e19d028
0 0 0 0

ffffff800e1bf028
0 0 0 0

ffffff800e225028
0 0 0 0

ffffff800e247028
0 0 0 0

ffffff800e269028
0 0 0 0

ffffff800e2ad028
0 0 0 0

ffffff800e2cf028
0 0 0 0

ffffff800e313028
0 0 0 0

ffffff800e335028
0 0 0 0

ffffff800e357028
0 0 0 0

ffffff800e379028
0 0 0 0

ffffff800e39b028
0 0 0 0

ffffff800e401028
0 0 0 0

ffffff800e445028
0 0 0 0

ffffff800e467028
0 0 0 0

ffffff800e4ab028
0 0 0 0

ffffff800e4cd028
0 0 0 0

ffffff800e533028
0 0 0 0

ffffff800e555028
0 0 0 0

ffffff800e577028
0 0 0 0

ffffff800e599028
0 0 0 0

ffffff800e5dd028
6 0 0 0

ffffff800e5ff028
0 0 0 0

ffffff800e621028
0 0 0 0

ffffff800e643028
0 0 0 0

ffffff800e665028
0 9 0 0

ffffff800e6a9028
0 0 0 0

ffffff800e6cb028
0 0 0 0

ffffff800e70f028
0 0 0 0

ffffff800e7b9028
0 0 0 0
ffffff800e7fd028
0 0 0 0

ffffff800e81f028
0 0 0 0

ffffff800e841028
0 0 0 0

ffffff800e8a7028
0 17 0 0

ffffff800e8eb028
0 0 0 0

ffffff800e90d028
0 0 0 0

ffffff800e92f028
0 0 0 0

ffffff800e951028
0 0 0 0

ffffff800e973028
0 0 0 0

ffffff800e995028
0 0 0 0

ffffff800e9b7028
0 0 0 0

ffffff800e9fb028
0 0 0 0

ffffff800ea1d028
0 0 0 0

ffffff800ef1f028
0 0 0 0

ffffff800ef41028
0 0 0 0

ffffff800ef85028
0 0 0 0

ffffff800efa7028
0 0 0 0

ffffff800efc9028
0 0 0 0

ffffff800efeb028
0 0 0 0

ffffff800f00d028
0 0 0 0
ffffff800f051028
0 0 0 0

ffffff800f073028
0 0 0 0

ffffff800f095028
0 0 0 0

ffffff800f0b7028
0 0 0 0

ffffff800f0d9028
0 0 0 0

ffffff800f0fb028
0 0 0 0

ffffff800f11d028
0 0 0 0

ffffff800f13f028
0 0 0 0

ffffff800f161028
0 0 0 0

ffffff800f1a5028
0 0 0 0

ffffff800f22d028
0 0 0 0

ffffff800f24f028
0 0 0 0

ffffff800f271028
0 0 0 0

ffffff800f293028
0 0 0 0

ffffff800f31b028
0 0 0 0

ffffff800f35f028
0 0 0 0

ffffff800f3c5028
0 0 0 0

ffffff800f607028
0 0 0 0

ffffff800f7c1028
0 0 0 0

ffffff800f7e3028
0 0 0 0

ffffff800f805028
0 0 0 0

ffffff800f827028
0 0 0 0

ffffff800f849028
47 16 0 0

ffffff800f86b028
0 0 0 0

ffffff800f8d1028
0 0 0 0

ffffff800f915028
0 0 0 0

ffffff800f937028
0 0 0 0

ffffff800f97b028
0 0 0 0

ffffff800f99d028
0 0 0 0

ffffff800faf1028
0 156 0 0

ffffff800fb13028
0 0 0 0

ffffff800fb57028
0 0 0 0

ffffff800fbbd028
0 0 0 0

ffffff80100c6028
0 0 0 0

ffffff80100e8028
0 0 0 0

ffffff801012c028
0 0 0 0

ffffff801014e028
0 0 0 0

ffffff8010170028
0 0 0 0

ffffff8010192028
0 0 0 0
ffffff80101b4028
0 0 0 0

ffffff801023c028
0 0 0 0

ffffff8010261028
0 0 0 0

ffffff8010283028
0 0 0 0

ffffff80102a5028
0 0 0 0

ffffff80102c7028
0 0 0 0

ffffff801030b028
0 0 0 0

ffffff801034f028
0 0 0 0

ffffff80103d7028
0 0 0 0

ffffff80103f9028
0 0 0 0

ffffff801041b028
0 0 0 0

ffffff8010440028
0 0 0 0

ffffff8010462028
0 0 0 0

ffffff8010484028
0 0 0 0

ffffff80104a6028
0 57 0 0

ffffff80104c8028
0 0 0 0

ffffff80104ea028
0 0 0 0

ffffff801052e028
0 0 0 0

ffffff8010550028
142 11 0 0

ffffff80105b6028
0 0 0 0
ffffff80105d8028
0 0 0 0

ffffff80105fa028
0 0 0 0

ffffff801061c028
0 0 0 0

ffffff801063e028
0 0 0 0

ffffff8010660028
0 0 0 0

ffffff8010682028
0 0 0 0

ffffff80106a4028
0 0 0 0

ffffff80106c6028
0 0 0 0

ffffff80106e8028
0 0 0 0

ffffff801070a028
0 0 0 0

ffffff801074e028
0 0 0 0

ffffff8010770028
0 0 0 0

ffffff8010792028
0 0 0 0

165 entries were displayed.

alln01-c04-svnas::*> autosupport
invoke -node

alln01-c04-svnas::*> set admin

alln01-c04-svnas::> autosupport
invoke -node alln01-c04-svnas-n03 -type

test performance all


alln01-c04-svnas::> autosupport
invoke -node alln01-c04-svnas-n03 -type all -message SV

The AutoSupport was successfully


invoked on node "alln01-c04-svnas-n03" (sequence number: 2771).

alln01-c04-svnas::> node run -node


alln01-c04-svnas-n03 -command netstat -s -p tcp

---- Default IPSpace ----

tcp:

14017426068 packets sent

2177463612 data
packets (242140270692 bytes)

1810572 data packets


(1584113695 bytes) retransmitted

393546 data packets


unnecessarily retransmitted

0 resends initiated
by MTU discovery

11788452371 ack-only
packets (125558730 delayed)

0 URG only packets

27 window probe
packets

43282574 window
update packets

6417716 control
packets

14682092889 packets received

1588694912 acks (for


242162067831 bytes)

95562282 duplicate
acks

0 acks for unsent


data

13900691752 packets
(299057113608225 bytes) received in-sequence

16026330 completely
duplicate packets (4236429228 bytes)
36021 old duplicate
packets

27781 packets with


some dup. data (272820376 bytes duped)

507599854 out-of-
order packets (9866431259487 bytes)

38 packets (50652
bytes) of data after window

36 window probes

1493843 window
update packets

57 packets received
after close

0 discarded for bad


checksums

0 discarded for bad


header offset fields

0 discarded because
packet too short

2897 discarded due


to memory problems

2473568 connection requests

1481240 connection accepts

30 bad connection attempts

0 listen queue overflows

2785 ignored RSTs in the


windows

3946538 connections
established (including accepts)

3954328 connections closed


(including 26411 drops)

3672834 connections
updated cached RTT on close

3673508 connections
updated cached RTT variance on close

2904713 connections
updated cached ssthresh on close
7912 embryonic connections
dropped

1588577499 segments updated


rtt (of 1284131790 attempts)

839271 retransmit timeouts

19 connections
dropped by rexmit timeout

29 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

18689944 keepalive timeouts

18682066 keepalive
probes sent

7878 connections
dropped by keepalive

166767235 correct ACK header


predictions

12509562444 correct data


packet header predictions

1482806 syncache entries


added

543 retransmitted

465 dupsyn

0 dropped

1481240 completed

0 bucket overflow

0 cache overflow

1453 reset

114 stale

0 aborted

0 badack

0 unreach

0 zone failures
1482806 cookies sent

1 cookie received

14915 hostcache entries


added

0 bucket overflow

707941 SACK recovery


episodes

847994 segment rexmits in


SACK recovery episodes

120053840 byte rexmits in


SACK recovery episodes

263145383 SACK options (SACK


blocks) received

503044898 SACK options (SACK


blocks) sent

0 SACK scoreboard overflow

0 packets with ECN CE bit


set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window

0 times in ONTAP flow


control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control

0 times in ONTAP extreme


flow control
0 is the maximum flow
control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset

0 bytes is send buffer hiwat


mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

404300 segments sent using


TSO

983304734 bytes sent using


TSO

111359 TSO segments


truncated

0 TSO wrapped sequence space


segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

11024964802 recv upcalls


batched in HP

1476828432 recv upcalls made


in HP

1415822071 recv upcalls made


in HP because of PSH

53462712 recv upcalls made


in HP because of sb_hiwat

7543649 recv upcalls made in


HP because of both PSH and sb_hiwat

382149117 recv upcall batch


timeouts

68899322 times recv upcall


read partial sb_cc in HP
13559946491 segments
received using LRO

305004005853297 bytes
received using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received

5 Path MTU discovery black


hole detection activations

0 Path MTU discovery black


hole detection min MSS activations

0 Path MTU discovery black


hole detection failures

---- ANYVSERVER IPSpace ----

tcp:

0 packets sent

0 data packets (0
bytes)

0 data packets (0
bytes) retransmitted

0 data packets
unnecessarily retransmitted

0 resends initiated
by MTU discovery

0 ack-only packets
(0 delayed)

0 URG only packets

0 window probe
packets

0 window update
packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent


data

0 packets (0 bytes)
received in-sequence

0 completely
duplicate packets (0 bytes)

0 old duplicate
packets

0 packets with some


dup. data (0 bytes duped)

0 out-of-order
packets (0 bytes)

0 packets (0 bytes)
of data after window

0 window probes

0 window update
packets

0 packets received
after close

0 discarded for bad


checksums

0 discarded for bad


header offset fields

0 discarded because
packet too short

0 discarded due to
memory problems

0 connection requests

0 connection accepts

0 bad connection attempts


0 listen queue overflows

0 ignored RSTs in the


windows

0 connections established
(including accepts)

0 connections closed
(including 0 drops)

0 connections
updated cached RTT on close

0 connections
updated cached RTT variance on close

0 connections
updated cached ssthresh on close

0 embryonic connections
dropped

0 segments updated rtt (of 0


attempts)

0 retransmit timeouts

0 connections
dropped by rexmit timeout

0 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

0 keepalive timeouts

0 keepalive probes
sent

0 connections
dropped by keepalive

0 correct ACK header


predictions

0 correct data packet header


predictions

0 syncache entries added

0 retransmitted

0 dupsyn
0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow

0 SACK recovery episodes

0 segment rexmits in SACK


recovery episodes

0 byte rexmits in SACK


recovery episodes

0 SACK options (SACK blocks)


received

0 SACK options (SACK blocks)


sent

0 SACK scoreboard overflow

0 packets with ECN CE bit


set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window
0 times in ONTAP flow
control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control

0 times in ONTAP extreme


flow control

0 is the maximum flow


control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset

0 bytes is send buffer hiwat


mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space


segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP


because of PSH
0 recv upcalls made in HP
because of sb_hiwat

0 recv upcalls made in HP


because of both PSH and sb_hiwat

0 recv upcall batch timeouts

0 times recv upcall read


partial sb_cc in HP

0 segments received using


LRO

0 bytes received using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received

0 Path MTU discovery black


hole detection activations

0 Path MTU discovery black


hole detection min MSS activations

0 Path MTU discovery black


hole detection failures

---- Cluster IPSpace ----

tcp:

8289916800 packets sent

6853919754 data
packets (54877784807699 bytes)

16401 data packets


(18407828 bytes) retransmitted

395 data packets


unnecessarily retransmitted

0 resends initiated
by MTU discovery

1383542794 ack-only
packets (1204309744 delayed)

0 URG only packets

40 window probe
packets

18004454 window
update packets

34433357 control
packets

7685142544 packets received

6093216509 acks (for


54876907991191 bytes)

602085913 duplicate
acks

0 acks for unsent


data

5866717525 packets
(4032645243988 bytes) received in-sequence

8570760 completely
duplicate packets (244300 bytes)

541 old duplicate


packets

0 packets with some


dup. data (0 bytes duped)

126777 out-of-order
packets (552032465 bytes)

0 packets (0 bytes)
of data after window

0 window probes

14000767 window
update packets

388961 packets
received after close

0 discarded for bad


checksums
0 discarded for bad
header offset fields

0 discarded because
packet too short

0 discarded due to
memory problems

11941553 connection requests

12252436 connection accepts

0 bad connection attempts

0 listen queue overflows

81829 ignored RSTs in the


windows

24002223 connections
established (including accepts)

24195171 connections closed


(including 350982 drops)

7572678 connections
updated cached RTT on close

7572827 connections
updated cached RTT variance on close

35954 connections
updated cached ssthresh on close

191462 embryonic connections


dropped

6093216509 segments updated


rtt (of 5810241639 attempts)

15210 retransmit timeouts

8 connections
dropped by rexmit timeout

67 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

7607681 keepalive timeouts

7607681 keepalive
probes sent
0 connections
dropped by keepalive

699781956 correct ACK header


predictions

963657787 correct data


packet header predictions

12252471 syncache entries


added

8 retransmitted

0 dupsyn

30 dropped

12252436 completed

0 bucket overflow

0 cache overflow

35 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

12252501 cookies sent

0 cookies received

717 hostcache entries added

0 bucket overflow

66 SACK recovery episodes

1411 segment rexmits in SACK


recovery episodes

12578380 byte rexmits in


SACK recovery episodes

137791 SACK options (SACK


blocks) received

68010 SACK options (SACK


blocks) sent

0 SACK scoreboard overflow


0 packets with ECN CE bit
set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window

0 times in ONTAP flow


control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control

0 times in ONTAP extreme


flow control

0 is the maximum flow


control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset

0 bytes is send buffer hiwat


mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

1233315534 segments sent


using TSO

52487292260764 bytes sent


using TSO

2948024927 TSO segments


truncated
12219 TSO wrapped sequence
space segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

13498344 recv upcalls


batched in HP

754120609 recv upcalls made


in HP

754107370 recv upcalls made


in HP because of PSH

12744 recv upcalls made in


HP because of sb_hiwat

495 recv upcalls made in HP


because of both PSH and sb_hiwat

5721 recv upcall batch


timeouts

422 times recv upcall read


partial sb_cc in HP

1741700380 segments received


using LRO

1750089918942 bytes received


using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received
1 Path MTU discovery black
hole detection activation

0 Path MTU discovery black


hole detection min MSS activations

1 Path MTU discovery black


hole detection failure

---- ips_4294967289 IPSpace ----

tcp:

0 packets sent

0 data packets (0
bytes)

0 data packets (0
bytes) retransmitted

0 data packets
unnecessarily retransmitted

0 resends initiated
by MTU discovery

0 ack-only packets
(0 delayed)

0 URG only packets

0 window probe
packets

0 window update
packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent


data

0 packets (0 bytes)
received in-sequence

0 completely
duplicate packets (0 bytes)

0 old duplicate
packets

0 packets with some


dup. data (0 bytes duped)

0 out-of-order
packets (0 bytes)

0 packets (0 bytes)
of data after window

0 window probes

0 window update
packets

0 packets received
after close

0 discarded for bad


checksums

0 discarded for bad


header offset fields

0 discarded because
packet too short

0 discarded due to
memory problems

0 connection requests

0 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the


windows

0 connections established
(including accepts)

0 connections closed
(including 0 drops)

0 connections
updated cached RTT on close

0 connections
updated cached RTT variance on close

0 connections
updated cached ssthresh on close

0 embryonic connections
dropped

0 segments updated rtt (of 0


attempts)
0 retransmit timeouts

0 connections
dropped by rexmit timeout

0 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

0 keepalive timeouts

0 keepalive probes
sent

0 connections
dropped by keepalive

0 correct ACK header


predictions

0 correct data packet header


predictions

0 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added


0 bucket overflow

0 SACK recovery episodes

0 segment rexmits in SACK


recovery episodes

0 byte rexmits in SACK


recovery episodes

0 SACK options (SACK blocks)


received

0 SACK options (SACK blocks)


sent

0 SACK scoreboard overflow

0 packets with ECN CE bit


set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window

0 times in ONTAP flow


control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control

0 times in ONTAP extreme


flow control

0 is the maximum flow


control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset
0 bytes is send buffer hiwat
mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space


segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP


because of PSH

0 recv upcalls made in HP


because of sb_hiwat

0 recv upcalls made in HP


because of both PSH and sb_hiwat

0 recv upcall batch timeouts

0 times recv upcall read


partial sb_cc in HP

0 segments received using


LRO

0 bytes received using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received

0 Path MTU discovery black


hole detection activations

0 Path MTU discovery black


hole detection min MSS activations

0 Path MTU discovery black


hole detection failures

---- ips_4294967293 IPSpace ----

tcp:

0 packets sent

0 data packets (0
bytes)

0 data packets (0
bytes) retransmitted

0 data packets
unnecessarily retransmitted

0 resends initiated
by MTU discovery

0 ack-only packets
(0 delayed)

0 URG only packets

0 window probe
packets

0 window update
packets

0 control packets

0 packets received

0 acks (for 0 bytes)

0 duplicate acks

0 acks for unsent


data
0 packets (0 bytes)
received in-sequence

0 completely
duplicate packets (0 bytes)

0 old duplicate
packets

0 packets with some


dup. data (0 bytes duped)

0 out-of-order
packets (0 bytes)

0 packets (0 bytes)
of data after window

0 window probes

0 window update
packets

0 packets received
after close

0 discarded for bad


checksums

0 discarded for bad


header offset fields

0 discarded because
packet too short

0 discarded due to
memory problems

0 connection requests

0 connection accepts

0 bad connection attempts

0 listen queue overflows

0 ignored RSTs in the


windows

0 connections established
(including accepts)

0 connections closed
(including 0 drops)

0 connections
updated cached RTT on close
0 connections
updated cached RTT variance on close

0 connections
updated cached ssthresh on close

0 embryonic connections
dropped

0 segments updated rtt (of 0


attempts)

0 retransmit timeouts

0 connections
dropped by rexmit timeout

0 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

0 keepalive timeouts

0 keepalive probes
sent

0 connections
dropped by keepalive

0 correct ACK header


predictions

0 correct data packet header


predictions

0 syncache entries added

0 retransmitted

0 dupsyn

0 dropped

0 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted
0 badack

0 unreach

0 zone failures

0 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow

0 SACK recovery episodes

0 segment rexmits in SACK


recovery episodes

0 byte rexmits in SACK


recovery episodes

0 SACK options (SACK blocks)


received

0 SACK options (SACK blocks)


sent

0 SACK scoreboard overflow

0 packets with ECN CE bit


set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window

0 times in ONTAP flow


control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control
0 times in ONTAP extreme
flow control

0 is the maximum flow


control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset

0 bytes is send buffer hiwat


mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space


segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP


because of PSH

0 recv upcalls made in HP


because of sb_hiwat

0 recv upcalls made in HP


because of both PSH and sb_hiwat

0 recv upcall batch timeouts

0 times recv upcall read


partial sb_cc in HP

0 segments received using


LRO
0 bytes received using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received

0 Path MTU discovery black


hole detection activations

0 Path MTU discovery black


hole detection min MSS activations

0 Path MTU discovery black


hole detection failures

---- ACP IPSpace ----

tcp:

4937687 packets sent

1001848 data packets


(24044460 bytes)

0 data packets (0
bytes) retransmitted

0 data packets
unnecessarily retransmitted

0 resends initiated
by MTU discovery

1932125 ack-only
packets (0 delayed)

0 URG only packets

0 window probe
packets

0 window update
packets
2003714 control
packets

4264489 packets received

2933895 acks (for


24974659 bytes)

312676 duplicate
acks

0 acks for unsent


data

1243028 packets
(62332126 bytes) received in-sequence

0 completely
duplicate packets (0 bytes)

0 old duplicate
packets

0 packets with some


dup. data (0 bytes duped)

1 out-of-order
packet (0 bytes)

0 packets (0 bytes)
of data after window

0 window probes

0 window update
packets

71693 packets
received after close

0 discarded for bad


checksums

0 discarded for bad


header offset fields

0 discarded because
packet too short

0 discarded due to
memory problems

1001849 connection requests

16 connection accepts

0 bad connection attempts


0 listen queue overflows

0 ignored RSTs in the


windows

1001864 connections
established (including accepts)

1001865 connections closed


(including 1 drop)

0 connections
updated cached RTT on close

0 connections
updated cached RTT variance on close

0 connections
updated cached ssthresh on close

0 embryonic connections
dropped

2933895 segments updated rtt


(of 3005361 attempts)

13 retransmit timeouts

1 connection dropped
by rexmit timeout

0 persist timeouts

0 connections
dropped by persist timeout

0 Connections (fin_wait_2)
dropped because of timeout

0 keepalive timeouts

0 keepalive probes
sent

0 connections
dropped by keepalive

1001648 correct ACK header


predictions

312858 correct data packet


header predictions

16 syncache entries added

0 retransmitted

0 dupsyn
0 dropped

16 completed

0 bucket overflow

0 cache overflow

0 reset

0 stale

0 aborted

0 badack

0 unreach

0 zone failures

16 cookies sent

0 cookies received

0 hostcache entries added

0 bucket overflow

0 SACK recovery episodes

0 segment rexmits in SACK


recovery episodes

0 byte rexmits in SACK


recovery episodes

0 SACK options (SACK blocks)


received

0 SACK options (SACK blocks)


sent

0 SACK scoreboard overflow

0 packets with ECN CE bit


set

0 packets with ECN ECT(0)


bit set

0 packets with ECN ECT(1)


bit set

0 successful ECN handshakes

0 times ECN reduced the


congestion window

0 times in ONTAP flow


control

0 times exited ONTAP flow


control

0 times in ONTAP flow


control for zero send window

0 times in ONTAP flow


control for non-zero send window

0 connection resets due to


ONTAP extreme flow control

0 times in ONTAP extreme


flow control

0 is the maximum flow


control reset threshold reached during receive

0 is the maximum flow


control reset threshold reached during send

0 bytes is send buffer value


during last reset

0 bytes is send buffer hiwat


mark during last reset

0 times the receive window


was closed

0 dropped due to flowcontrol

0 segments sent using TSO

0 bytes sent using TSO

0 TSO segments truncated

0 TSO wrapped sequence space


segments

0 segments sent using TSO6

0 bytes sent using TSO6

0 TSO6 segments truncated

0 TSO6 wrapped sequence


space segments

0 recv upcalls batched in HP

0 recv upcalls made in HP

0 recv upcalls made in HP


because of PSH
0 recv upcalls made in HP
because of sb_hiwat

0 recv upcalls made in HP


because of both PSH and sb_hiwat

0 recv upcall batch timeouts

0 times recv upcall read


partial sb_cc in HP

0 segments received using


LRO

0 bytes received using LRO

0 segments received using


LRO6

0 bytes received using LRO6

0 packets with valid tcp-md5


signature received

0 packets with invalid tcp-


md5 signature received

0 packets with tcp-md5


signature mismatch

0 packets with unexpected


tcp-md5 signature received

0 packets without expected


tcp-md5 signature received

0 Path MTU discovery black


hole detection activations

0 Path MTU discovery black


hole detection min MSS activations

0 Path MTU discovery black


hole detection failures

alln01-c04-svnas::> debug csm


session show -error-stats -node alln01-c04-svnas-n03

Error: "csm" is not a recognized


command

alln01-c04-svnas::> set diag


Warning: These diagnostic commands
are for use by NetApp personnel only.

Do you want to continue? {y|n}: y

alln01-c04-svnas::*> debug csm


session show -error-stats -node alln01-c04-svnas-n03

#Backpressured #Backpressured #Backpressured #Deferred #Timed Out

Node Pointer
#Backpressured NoSendContext NoDefQueue DefQueueFull #Timeouts Timeouts
Responses
------------ ----------------
-------------- -------------- -------------- -------------- ---------- ---------
----------
alln01-c04-svnas-n03

fffffe00219ce028
0 0 0 0 0 0 0

fffffe00219ef028
0 0 0 0 0 0 0

fffffe0033a28028
0 0 0 0 0 0 0

fffffe0033a49028
0 0 0 0 0 0 0

fffffe0033a6a028
0 0 0 0 0 0 0

fffffe0033a8b028
0 0 0 0 0 0 0

fffffe0033aac028
0 0 0 0 0 0 0

fffffe0033acd028
0 0 0 0 0 0 0

fffffe0033aee028
0 0 0 0 0 0 0

fffffe0033b0f028
0 0 0 0 0 0 0

fffffe0033b51028
0 0 0 0 0 0 0

fffffe0033b72028
0 0 0 0 0 0 0
fffffe0033de5028
0 0 0 0 0 0 0

fffffe0033e06028
0 0 0 0 0 0 0

fffffe0033e27028
0 0 0 0 0 0 0

fffffe0033e48028
0 0 0 0 0 0 0

fffffe0033eed028
0 0 0 0 0 0 0

fffffe0033f0e028
0 0 0 0 0 0 0

fffffe0033f50028
0 0 0 0 0 0 0

fffffe0033fd4028
0 0 0 0 0 0 0

fffffe0033ff5028
0 0 0 0 0 0 0

fffffe0034016028
0 0 0 0 0 0 0

fffffe0034037028
0 0 0 0 0 0 0

fffffe0034058028
0 0 0 0 0 0 0

fffffe0034079028
0 0 0 0 0 0 0

fffffe003413f028
0 0 0 0 0 0 0

fffffe0034160028
0 0 0 0 0 0 0

fffffe0034181028
0 0 0 0 0 0 0

fffffe00341a2028
0 0 0 0 0 0 0

fffffe00341c3028
0 0 0 0 0 0 0

fffffe0034226028
0 0 0 0 0 0 0

fffffe0034247028
0 0 0 0 0 0 0
fffffe0034268028
0 0 0 0 0 0 0

fffffe0034289028
0 0 0 0 0 0 0

fffffe00342cb028
0 0 0 0 0 0 0

fffffe003432e028
0 0 0 0 0 0 0

fffffe0034370028
0 0 0 0 0 0 0

fffffe00343b2028
0 0 0 0 0 0 0

fffffe00343d3028
0 0 0 0 0 0 0

fffffe00343f4028
0 0 0 0 0 0 0

fffffe0034415028
0 0 0 0 0 0 0

fffffe0034436028
0 0 0 0 0 0 0

fffffe0034478028
0 0 0 0 0 0 0

fffffe0034499028
0 0 0 0 0 0 0

fffffe00344ba028
0 0 0 0 0 0 0

fffffe00344db028
0 0 0 0 0 0 0

fffffe00355f0028
0 0 0 0 0 0 0

fffffe0035611028
0 0 0 0 0 0 0

fffffe0035632028
0 0 0 0 0 0 0

fffffe00356d7028
0 0 0 0 0 0 0

fffffe0035719028
0 0 0 0 0 0 0

fffffe003573a028
0 0 0 0 0 0 0

fffffe00357df028
0 0 0 0 0 0 0

fffffe0035800028
0 0 0 0 0 0 0

fffffe0035821028
0 0 0 0 0 0 0

fffffe0035842028
0 0 0 0 0 0 0

fffffe00358a5028
0 0 0 0 0 0 0

fffffe003596b028
0 0 0 0 0 0 0

fffffe003598c028
0 0 0 0 0 0 0

fffffe00359ad028
0 0 0 0 0 0 0

fffffe0035a52028
0 0 0 0 0 0 0

fffffe0035a73028
0 0 0 0 0 0 0

fffffe0035a94028
0 0 0 0 0 0 0

fffffe0035ab5028
0 0 0 0 0 0 0

fffffe0035af7028
0 0 0 0 0 0 0

fffffe0035b18028
0 0 0 0 0 0 0

fffffe0035b39028
0 0 0 0 0 0 0

fffffe0035b5a028
0 0 0 0 0 0 0

fffffe0035bbd028
0 0 0 0 0 0 0

fffffe0035bff028
0 0 0 0 0 0 0

fffffe0035c41028
0 0 0 0 0 0 0
fffffe0035c62028
0 0 0 0 0 0 0

fffffe0035c83028
0 0 0 0 0 0 0

fffffe0035dcd028
0 0 0 0 0 0 0

fffffe0035e0f028
0 0 0 0 0 0 0

fffffe0035e30028
0 0 0 0 0 0 0

fffffe0035f9b028
0 0 0 0 0 0 0

fffffe0035fdd028
0 0 0 0 0 0 0

fffffe0035ffe028
0 0 0 0 0 0 0

fffffe0036040028
0 0 0 0 0 0 0

fffffe0036061028
0 0 0 0 0 0 0

fffffe0036082028
0 0 0 0 0 0 0

fffffe00360a3028
0 0 0 0 0 0 0

fffffe00360c4028
0 0 0 0 0 0 0

fffffe0036106028
0 0 0 0 0 0 0

fffffe0036127028
0 0 0 0 0 0 0

fffffe0036148028
0 0 0 0 0 0 0

fffffe0036169028
0 0 0 0 0 0 0

fffffe003618a028
0 0 0 0 0 0 0

fffffe00361ab028
0 0 0 0 0 0 0

fffffe00368f5028
0 0 0 0 0 0 0
fffffe0036cf4028
0 0 0 0 0 0 0

fffffe0036d15028
0 0 0 0 0 0 0

fffffe0036ddb028
0 0 0 0 0 0 0

fffffe0036e1d028
0 0 0 0 0 0 0

fffffe0036e3e028
0 0 0 0 0 0 0

fffffe0036ea1028
0 0 0 0 0 0 0

fffffe0036f04028
0 0 0 0 0 0 0

fffffe0036f46028
0 0 0 0 0 0 0

fffffe0036f67028
0 0 0 0 0 0 0

fffffe0036f88028
0 0 0 0 0 0 0

fffffe0036fca028
0 0 0 0 0 0 0

fffffe0036feb028
0 0 0 0 0 0 0

fffffe00371b9028
0 0 0 0 0 0 0

fffffe00371da028
0 0 0 0 0 0 0

fffffe003725e028
0 0 0 0 0 0 0

fffffe0037303028
0 0 0 0 0 0 0

fffffe00373a8028
0 0 0 0 0 0 0

fffffe003742c028
0 0 0 0 0 0 0

fffffe00374f2028
0 0 0 0 0 0 0

fffffe0037513028
0 0 0 0 0 0 0

fffffe0037534028
0 0 0 0 0 0 0

fffffe00385dc028
0 0 0 0 0 0 0

fffffe0038660028
0 0 0 0 0 0 0

fffffe0038681028
0 0 0 0 0 0 0

fffffe00386e4028
0 0 0 0 0 0 0

fffffe0038705028
0 0 0 0 0 0 0

fffffe0038747028
0 0 0 0 0 0 0

fffffe0038768028
0 0 0 0 0 0 0

fffffe0038789028
0 0 0 0 0 0 0

fffffe003884f028
0 0 0 0 0 0 0

fffffe0038870028
0 0 0 0 0 0 0

fffffe0038891028
0 0 0 0 0 0 0

fffffe00388b2028
0 0 0 0 0 0 0

fffffe00388d3028
0 0 0 0 0 0 0

fffffe0038915028
0 0 0 0 0 0 0

126 entries were displayed.

alln01-c04-svnas::*>

You might also like