Professional Documents
Culture Documents
Abstract
These Application Notes illustrate a sample configuration of Avaya Aura Communication
Manager Release 5.2 with SIP Trunks to Acme Packet Net-Net 4500 Session Director at two
sites. For business continuity, a primary site uses Avaya S8730 Servers, and a secondary site
uses an Avaya S8500 Server as an Enterprise Survivable Server (ESS). At each site, two
Avaya C-LAN cards as well as the Processor Ethernet of the sites Avaya Server are
configured for SIP Trunking to the inside realm of an Acme Packet Net-Net 4500 Session
Director. On the outside realm, each Acme Packet Net-Net 4500 Session Director is
connected to a SIP network simulating a public SIP Service Provider. Within each site, the
Acme Packet Net-Net 4500 Session Director is configured for load spreading and fast fail-over
of inbound calls to the enterprise from the PSTN. For outbound calls to the PSTN,
Communication Manager is configured for location-based routing for trunk selection and
Look-Ahead Routing for trunk fail-over.
These Application Notes complement previously published Application Notes, focusing on the
new Communication Manager 5.2 capability to use the Processor Ethernet of the Avaya
S8730 Servers and Avaya ESS as the Avaya interface for SIP Trunk signaling.
JRR; Reviewed:
SPOC 7/21/2009
1 of 70
CM-PE-NN4500
1. Introduction
These Application Notes illustrate a sample configuration of Avaya Aura Communication
Manager Release 5.2 with SIP Trunks to Acme Packet Net-Net 4500 Session Director at two
sites. A primary site uses Avaya S8730 Servers, and a secondary site uses an Avaya S8500
Server as an Enterprise Survivable Server (ESS). At each site, two Avaya C-LAN cards as well
as the Processor Ethernet of the sites Avaya server are configured for SIP Trunking to the
Session Director using TCP for the SIP signaling connectivity. Each Session Director is also
connected to a SIP network simulating a SIP Service Provider. Since most SIP Service Providers
use UDP for SIP signaling, the SIP signaling connectivity from the Acme Packet Net-Net 4500
toward the outside realm uses UDP.
These Application Notes complement previously published Application Notes [JRR] that
covered the C-LAN based SIP Trunking and survivability considerations when various failures
are induced. Figure 1 is repeated from reference [JRR], but the detailed configuration and call
verifications from reference [JRR] will not be repeated in these Application Notes. These
Application Notes build upon the configuration documented in [JRR] by adding SIP Trunking
from the Processor Ethernet of the Avaya S8730 Servers, as well as the Avaya S8500 ESS.
JRR; Reviewed:
SPOC 7/21/2009
2 of 70
CM-PE-NN4500
The network shown in Figure 1 remains in place for the verification of these Application Notes.
Figure 2 omits many of the details, but illustrates (in orange) the addition of two new SIP trunks
(32, 62) via the Processor Ethernet of the Avaya S8730 Servers and Avaya S8500 ESS.
3 of 70
CM-PE-NN4500
enterprise and the (simulated) SIP Service Provider flows through the Acme Packet Net-Net
4500.
A customer interested in SIP Trunk survivability may want a redundant pair of Acme Packet
Net-Net 4500 Session Directors at each site. Although the sample configuration verified in these
Application Notes used only a single Acme Packet Net-Net 4500 at each site, the Acme Packet
configuration shown in Appendix A of reference [JRR] was prepared as if there were a high
availability Acme Packet configuration at each site. Actual verification testing of the Acme
Packet Net-Net 4500 High Availability configuration with Communication Manager was
performed as part of Avaya DevConnect compliance testing, and the Application Notes in
reference [AP-HA] documents the configuration and testing results.
JRR; Reviewed:
SPOC 7/21/2009
4 of 70
CM-PE-NN4500
As shown in Figure 3, the DID number 732-852-1816 is preferentially routed to the primary site,
but can fail-over to the secondary site. The DID number 732-852-2940 is preferentially routed to
the secondary site, but can fail-over to the primary site. Communication Manager can map any
received telephone number to any destination via the incoming call handling table of the trunk
group receiving the call. During testing, calls arriving via the primary site SIP trunks were
directed to users at both the primary and the secondary sites, and vice-versa.
JRR; Reviewed:
SPOC 7/21/2009
5 of 70
CM-PE-NN4500
Sag-recursion
Session-agent
configuration for
ping-method
OPTIONS
Avaya Aura
Communication
Manager Concept
SIP Signaling Group and
SIP Trunk Group
Route-Pattern with
multiple SIP Trunk
Groups
Notes
To summarize the Acme Packet Net-Net 4500 configuration, a session agent is defined for
each C-LAN at the site, and the processor Ethernet of the Avaya S8730 Server or Avaya
S8500 ESS, depending on the site. A session agent group (SAG) is configured to group the
session agents, and a strategy for distribution of calls to the session agents that are members of
the group is specified. In the sample configuration, once an inbound call reaches an enterprise
site, the Session Director is configured for round-robin call distribution to the members of the
session agent group. If connectivity to a particular session agent fails, and the Acme Packet NetNet 4500 has not yet detected the failure, an inbound call directed to the failed session agent will
encounter a transaction timeout. The transaction timeout will cause the call to be directed to
another session agent at the same site automatically. In addition, the failed session agent will be
marked out-of-service so that subsequent inbound calls will flow to an operational session agent
without experiencing the timeout. If all session agents that are part of the session agent group
experience a transaction timeout, then a SIP 408 message would be returned to the SIP Service
JRR; Reviewed:
SPOC 7/21/2009
6 of 70
CM-PE-NN4500
Provider. If all session agents that are part of the session agent group are already marked out of
service, then a SIP 503 Service Unavailable would be returned to the SIP Service Provider.
Similarly, if the public side of the Session Director experienced failures for an outbound call
from Communication Manager, Communication Manager would receive no SIP response after
100 TRYING, a 408 Transaction Timeout, or a 503 Service Unavailable, depending on the
particular failure scenario. Note that all these conditions are triggers for Communication
Manager Look-Ahead Routing. Reference [LAR] documents another sample configuration for
Look-Ahead Routing, and includes a more complete list of SIP triggers.
In the sample configuration, the Acme Packet Net-Net 4500 at a given site does not have session
agents to the other site. It is presumed that a production SIP Service Provider can redirect calls
from one site to another based on failure conditions, such as a timeout, or the return of a 503
Service Unavailable.
7 of 70
CM-PE-NN4500
familiar with Avaya trunk states, this is similar to the Communication Manager behavior for a
trunk marked in the Out-of-service/Far-end state.
When an Avaya SIP signaling group is marked with Enable Layer 3 Test = y,
Communication Manager will periodically send a SIP OPTIONS method to the far-end of the
signaling group. When the Acme Packet Net-Net 4500 receives such a SIP OPTIONS, it checks
the logical next-hop. In the sample configuration, the next hop is the SIP Service Provider.
If there is no in-service next-hop, then the Acme Packet Net-Net 4500 returns a 503 Service
Unavailable to Communication Manager. Communication Manager will then mark the SIP
signaling group for bypass, and the corresponding SIP trunk group will be marked Out-ofservice/Far-end. For example, if the Acme Packet Net-Net 4500 has detected that the SIP
Service Provider network has failed, then a SIP OPTIONS from the Avaya session agent will
receive a 503, and the Avaya trunks will be marked for bypass, which is appropriate. In this
state, although outbound calls from the enterprise will not select the trunk, if an inbound call is
received, the network has apparently recovered. The call will be accepted, and the Avaya SIP
trunk group will be marked in-service.
JRR; Reviewed:
SPOC 7/21/2009
8 of 70
CM-PE-NN4500
Software
Avaya Aura Communication Manager
Release 5.2 (947.3) with and without SP1
(patch 17294)
Avaya Aura Communication Manager
Release 5.2 (947.3) with and without SP1
(patch 17294)
Release 2.9 H.323
N/A
CX6.1.0 patch 3
12.4(15)T7
12.4(11)XW7
JRR; Reviewed:
SPOC 7/21/2009
9 of 70
CM-PE-NN4500
The S8730 Server can be accessed via a web interface in an internet browser. The following
screen shows the initial screen. To add Processor Ethernet to an existing configuration such as
the configuration documented in [JRR], select Configure Server under Installation, as shown.
Navigate to Set Identities. The following screen shows the lower portion of the Set Identities
page before any changes are made. Note that the Processor Ethernet (PE) drop-down initially
indicates UNUSED.
JRR; Reviewed:
SPOC 7/21/2009
10 of 70
CM-PE-NN4500
The following screen shows the lower portion of this same screen, where Ethernet 2 is being
selected in the Processor Ethernet (PE) drop-down. In this case, Ethernet 2 is the Corporate
LAN interface, and the Processor Ethernet and Corporate LAN interface will be the same.
Select the Continue button to proceed. The screen below shows a portion of the resulting
screen, with the IP Addresses from the sample configuration populated in the mandatory fields,
indicated by a red star. The active server IP Address is 2.2.87.13. This is the IP Address that
will be associated with the Processor Ethernet or procr of the active S8730 Server.
JRR; Reviewed:
SPOC 7/21/2009
11 of 70
CM-PE-NN4500
At the conclusion of the process, a screen such as the following should be displayed.
At the conclusion of the process on both S8730 Servers, the Status Summary page may be used
to check the Processor Ethernet status, as shown below.
JRR; Reviewed:
SPOC 7/21/2009
12 of 70
CM-PE-NN4500
Page
NODE NAMES
Type
IP
IP
IP
IP
IP
IP
IP
IP
Name
nn4500-prisite
nn4500-secsite
procr
tn2602-1a11
tn2602-2a07
tn2602-2b07
val-1a07
val-2a08
IP Address
2.2.85.45
2.2.185.145
2.2.87.13
2.2.185.4
2.2.26.3
2.2.26.2
2.2.185.25
2.2.85.25
Page
1 of
IP INTERFACES
Type: PROCR
Target socket load: 19200
Enable Interface? y
Network Region: 3
IPV4 PARAMETERS
Node Name: procr
Subnet Mask: /24
JRR; Reviewed:
SPOC 7/21/2009
13 of 70
CM-PE-NN4500
The following screen lists the IP interfaces, which now includes the bold procr at the end of
the list.
list ip-interface all
Page
IP INTERFACES
ON Type
Slot
Code/Sfx
02A02 TN799
y VAL
01A07 TN2501
02B02 TN799
y C-LAN
01A10 TN799
y VAL
02A08 TN2501
y PROCR
Node Name/
IP-Address
--------------c-lan
2.2.185.2
c-lan2a02
2.2.85.2
val-1a07
2.2.185.25
tn2602-2a07
2.2.26.3
tn2602-2b07
2.2.26.2
tn2602-1a11
2.2.185.4
c-lan2b02
2.2.85.20
c-lan1A10
2.2.185.20
val-2a08
2.2.85.25
2.2.87.13
Mask
Gateway Node
Net
Rgn
VLAN
---/24
--------------Gateway001
--1
---n
/24
Gateway002
/24
Gateway001
/24
Gateway003
/24
Gateway003
/24
Gateway001
/24
Gateway002
/24
Gateway001
/24
Gateway002
/24
2.2.87.1
n
3
JRR; Reviewed:
SPOC 7/21/2009
14 of 70
CM-PE-NN4500
The following screen shows the addition of signaling group 32. The Near-end Node Name is
procr and the Far-end Node Name is the node name of the Acme Packet Net-Net 4500 at the
primary site. The Far-end Network Region is configured to region 3. In normal operation,
when all network elements are up, signaling group 32 will be in-service, under the control of the
active S8730 Server. If the ESS becomes active, signaling group 32 will be out-of-service from
the point of view of the ESS. The ESS will never receive a response from the primary site
Session Director at the far-end of signaling group 32.
add signaling-group 32
Group Number: 32
Page
1 of
IMS Enabled? n
Near-end Node Name: procr
Near-end Listen Port: 5060
y
n
n
6
The following screen shows the addition of signaling group 62. The Near-end Node Name is
procr and the Far-end Node Name is the node name of the Acme Packet Net-Net 4500 at the
secondary site. The Far-end Network Region is configured to region 1. In normal operation,
when all network elements are up, signaling group 62 will be out-of-service from the point of
view of the active S8730 Server, which will never receive a SIP 200 OK response from the
secondary site Session Director at the far-end of signaling group 62. However, when the ESS
is active, signaling group 62 will come in-service from the point of view of the ESS.
add signaling-group 62
Group Number: 62
Page
1 of
IMS Enabled? n
Near-end Node Name: procr
Near-end Listen Port: 5060
y
n
n
6
15 of 70
CM-PE-NN4500
sip. The two new SIP trunk groups are conceptually the same as those defined for trunk
groups 30, 31, 60, and 61 in reference [JRR].
The following shows page 1 for trunk group 32. The Number of Members field defines how
many simultaneous calls are permitted for the trunk group, and can be coordinated with Acme
Packet Net-Net 4500 call admission control features if desired.
add trunk-group 32
Page
1 of
21
TRUNK GROUP
Group Number:
Group Name:
Direction:
Dial Access?
Queue Length:
Service Type:
32
SIP-PSTN-PE
two-way
n
0
public-ntwrk
The following shows Page 2 for trunk group 32. All parameters shown are default values, except
for the Preferred Minimum Session Refresh Interval, which has been changed from 600 to 900
to avoid unnecessary SIP messaging with the Cisco products used to simulate the SIP Service
Provider. As such, this screen will not be shown for trunk group 62.
add trunk-group 32
Group Type: sip
TRUNK PARAMETERS
Unicode Name: yes
SCCAN? n
Page
2 of
21
The following shows Page 3 for trunk group 32. All parameters shown are at default values. As
such, this screen will not be shown for trunk group 62.
change trunk-group 30
TRUNK FEATURES
ACA Assignment? n
Page
3 of
21
Measured: none
Maintenance Tests? y
JRR; Reviewed:
SPOC 7/21/2009
16 of 70
CM-PE-NN4500
The following shows Page 4 for trunk group 32. All parameters shown are at default values. As
such, this screen will not be shown for trunk group 62. Depending on the Service Provider, it
may be necessary to enter a specific value, such as 101, in the Telephone Event Payload Type
associated with DTMF signaling. Check with the specific service provider. Similarly, some
Service Providers may require that the fields Support Request History and Send Diversion
Header be changed from default values for proper support of redirection features such as
Extension to Cellular or call forwarding off-net.
change trunk-group 30
Page
4 of
21
PROTOCOL VARIATIONS
Mark Users as Phone? n
Prepend '+' to Calling Number? n
Send Transferring Party Information? n
Send Diversion Header? n
Support Request History? y
Telephone Event Payload Type:
The following shows Page 1 for trunk group 62. Remaining pages match trunk group 32.
add trunk-group 62
Page
1 of
21
TRUNK GROUP
Group Number:
Group Name:
Direction:
Dial Access?
Queue Length:
Service Type:
62
Group Type:
SIP-PSTN-ESS-PE
COR:
two-way
Outgoing Display?
n
0
public-ntwrk
Auth Code?
sip
CDR Reports: y
1
TN: 1
TAC: 162
n
Night Service:
n
Signaling Group: 62
Number of Members: 10
JRR; Reviewed:
SPOC 7/21/2009
17 of 70
CM-PE-NN4500
change route-pattern 30
Page
Pattern Number: 30 Pattern Name: SIP-PSTN-P
SCCAN? n
Secure SIP? n
Grp FRL NPA Pfx Hop Toll No. Inserted
No
Mrk Lmt List Del Digits
Dgts
1: 32
0
1
2: 31
0
1
3: 30
0
1
4: 60
0
1
5: 61
0
1
6: 62
0
1
1:
2:
3:
4:
5:
6:
y
y
y
y
y
y
rest
rest
rest
rest
rest
rest
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
n
n
n
n
n
n
n
n
n
n
n
n
1 of
DCS/
QSIG
Intw
n
n
n
n
n
n
IXC
user
user
user
user
user
user
Route pattern 60 will be used for calls that prefer the SIP trunks at the secondary site, but may
use the SIP trunks at the primary site, if the SIP trunks at the secondary site are busy or failed.
As with route-pattern 30, LAR is configured to next to allow calls to complete automatically in
failure scenarios. Although not necessary, trunk group 62, associated with the Processor
Ethernet of the ESS, is listed after the C-LAN based trunks at the secondary site, since trunk
group 62 will be out-of-service during normal operation.
change route-pattern 60
Page
Pattern Number: 60 Pattern Name: SIP-PSTN-S
SCCAN? n
Secure SIP? n
Grp FRL NPA Pfx Hop Toll No. Inserted
No
Mrk Lmt List Del Digits
Dgts
1: 61
0
1
2: 60
0
1
3: 62
0
1
4: 31
0
1
5: 30
0
1
6: 32
0
1
1:
2:
3:
4:
5:
6:
y
y
y
y
y
y
rest
rest
rest
rest
rest
rest
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
y
JRR; Reviewed:
SPOC 7/21/2009
n
n
n
n
n
n
n
n
n
n
n
n
1 of
DCS/
QSIG
Intw
n
n
n
n
n
n
IXC
user
user
user
user
user
user
18 of 70
CM-PE-NN4500
JRR; Reviewed:
SPOC 7/21/2009
Total
Min Max
11
11
Route
Pattern
60
Call
Type
natl
Node
Num
Page
1 of
Percent Full:
2
1
ANI
Reqd
n
19 of 70
CM-PE-NN4500
The following screen shows a sample ARS configuration for location 3. If a user at location 3,
such as extension 52020, dials the ARS access code followed by 1-732-852-XXXX, the call will
select route pattern 30.
change ars analysis 1732 location 3
ARS DIGIT ANALYSIS TABLE
Location: 1
Dialed
String
1732852
Total
Min Max
11
11
Route
Pattern
30
Call
Type
natl
Node
Num
Page
1 of
Percent Full:
2
1
ANI
Reqd
n
Page
1 of
30
Page
1 of
30
JRR; Reviewed:
SPOC 7/21/2009
20 of 70
CM-PE-NN4500
Page
1 of
JRR; Reviewed:
SPOC 7/21/2009
22 : 00
06 : 00
daily
y
21 of 70
CM-PE-NN4500
JRR; Reviewed:
SPOC 7/21/2009
22 of 70
CM-PE-NN4500
JRR; Reviewed:
SPOC 7/21/2009
23 of 70
CM-PE-NN4500
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
Access the console port of the Session Director using a PC and a terminal emulation
program such as HyperTerminal. Use the following settings for the serial port on the PC.
Bits per second: 115200
Data bits: 8
Parity : None
Stop bits: 1
Flow control: None
Log in to the Session Director with the user password.
Enable the Superuser mode by entering the enable command and then the superuser
password. The command prompt will change to include a # instead of a > while in
Superuser mode. This level of system access (i.e., at the acmesystem# prompt) will be
referred to as the main level of the ACLI. Specific sub-levels of the ACLI will then be
accessed to configure specific elements and specific parameters of those elements.
In Superuser mode, enter the configure terminal command. The configure terminal
command is used to access the system level where all operating and system elements may
be configured. This level of system access will be referred to as the configuration level.
Enter the name of an element to be configured (e.g., system).
Enter the name of a sub-element, if any (e.g., phy-interface).
Enter the name of an element parameter followed by its value (e.g., name s0p0).
Enter done to save changes to the element. Use of the done command causes the system
to save and display the settings for the current element.
Enter exit as many times as is necessary to return to the configuration level.
Repeat Steps 4 - 8 to configure all the elements.
Enter exit to return to the main level.
Type save-config to save the entire configuration.
Type activate-config to activate the entire configuration.
After accessing different levels of the ACLI to configure elements and parameters, it is necessary
to return to the main level to run certain tasks such as saving the configuration, activating the
configuration, or rebooting the system.
JRR; Reviewed:
SPOC 7/21/2009
24 of 70
CM-PE-NN4500
the external untrusted network, and Ethernet slot 1 / port 0 was connected to the internal
corporate LAN. A network interface was defined for each physical interface to assign it a
routable IP address.
Section 6 documents an issue where the Avaya ESS will expect a response to ICMP ping from
the far-end of SIP trunks, upon activation and control by an ESS running version 5.2 plus SP1.
Although this is a problem to be resolved in a subsequent software load, the commands below
allow a work-around to be implemented on the Acme Packet Session Director at the secondary
site. In the output below, the only changes to the configuration documented in reference [JRR]
are shown in bold. In short, this allows signaling group 62 to remain in-service after an ESS
takes over, if the ESS is running version 5.2 SP1. See Section 5.7.1.2 for verification of this
work-around for signaling group 62.
**sbcsecsite-pri# config t
**sbcsecsite-pri(configure)# system network-interface
**sbcsecsite-pri(network-interface)# select
<name>:<sub-port-id>:
1: wancom1:0 ip=
gw=
2: wancom2:0 ip=
gw=
3: s0p0:0
ip=10.3.3.145
gw=10.3.3.1
4: s1p0:0
ip=2.2.185.145
gw=2.2.185.1
selection: 4
**sbcsecsite-pri(network-interface)# add-hip-ip 2.2.185.145
**sbcsecsite-pri(network-interface)# add-icmp-ip 2.2.185.145
**sbcsecsite-pri(network-interface)# done
network-interface
name
s1p0
sub-port-id
0
description
hostname
ip-address
2.2.185.145
pri-utility-addr
2.2.185.146
sec-utility-addr
2.2.185.147
netmask
255.255.255.0
gateway
2.2.185.1
<text removed>
hip-ip-list
2.2.185.145
ftp-address
icmp-address
2.2.185.145
<text removed>
**sbcsecsite-pri(network-interface)# exit
**sbcsecsite-pri(system)# exit
**sbcsecsite-pri(configure)# exit
**sbcsecsite-pri# save
checking configuration
Save-Config received, processing.
waiting for request to finish
Request to 'SAVE-CONFIG' has Finished,
Save complete
Currently active and saved configurations do not match!
To sync & activate, run 'activate-config' or 'reboot activate'.
*sbcsecsite-pri# activate-config
Activate-Config received, processing.
waiting for request to finish
Request to 'ACTIVATE-CONFIG' has Finished,
Activate Complete
JRR; Reviewed:
SPOC 7/21/2009
25 of 70
CM-PE-NN4500
4.4. Realm
A realm represents a group of related Session Director components. Defining realms allows
flows to pass through a connection point between two networks. Two realms were defined for
the interoperability test. The OUTSIDE realm was defined for the external network and the
INSIDE realm was defined for the internal network. The realm configuration documented in
Section 4.4 of reference [JRR] applies; no changes are necessary due to the use of Processor
Ethernet SIP trunks in Communication Manager.
26 of 70
CM-PE-NN4500
Director will redirect the call to another session agent in the SAG. In the context of a
session agent group whose members are comprised of session agents with different
capabilities, the max-sessions parameter could be used to effect changes to the
distribution of sessions across the various agents.
ping-method: OPTIONS;hops=0 The SIP OPTIONS message will be sent to the peer to
verify that the SIP connection is functional. In addition, this parameter causes the Session
Director to set the Max-Forward field to 0 in outbound OPTIONS pings generated by the
Session Director to this session-agent.
ping-interval: Specifies the interval between SIP OPTIONS pings in seconds. Since
the intent is to monitor the health of the connection, pings may be suppressed if there is
traffic to/from the session-agent that shows the connection is up.
ping-in-service-response-codes: Although not configured as part of the base
verification testing, this parameter can be used to specify the list of response codes that
keep a session agent in-service. By default, any response from the session agent is
enough to keep the session agent in service. If it is desired that only a 200 OK response
is a valid response to OPTIONS to mark the session agent in-service, then 200 can be
entered. Note that Communication Manager will respond to OPTIONS with a 503 in
various conditions where the SIP trunk group corresponding to the SIP signaling group
would not be able to process a call. Examples include when the SIP trunk group is
administratively busied out, or when the trunk group is in-service, but there are no
available resources to handle a call (e.g. all trunk members in use for calls). Other cases
where the Processor Ethernet SIP trunks will respond with a 503 are documented in the
verifications in Section 5.
out-service-response-codes Although not defined in the sample configuration, this
parameter can be used to specify the list of OPTIONS ping response codes that take a
session agent out-of-service.
options trans-timeouts=1 This parameter defines the number of consecutive non-ping
transaction timeouts that will cause the session agent to be marked out-of-service. For
example, with this option set to 1, if an INVITE is sent to an Avaya session agent that is
currently marked in-service, but no response is received resulting in a transaction
timeout, the session agent will be immediately marked out-of-service. In the sample
configuration, where session agent groups are used, this allows future calls to flow to inservice session agents in the group without experiencing a delay due to a transaction
timeout. Note that an explicit error response, such as a 503, is not considered a
transaction timeout.
reuse-connections TCP Enables TCP connection re-use.
tcp-keepalive enabled Enables standard TCP Keep-Alives
tcp-reconn-interval 10 Specifies the idle time, in seconds, before TCP keep-alive
messages are sent.
JRR; Reviewed:
SPOC 7/21/2009
27 of 70
CM-PE-NN4500
The key settings for the session agent to the active S8730 Server are shown below. This
configuration is added on the Acme Packet Session Director at the primary site only.
session-agent
hostname
ip-address
port
state
app-protocol
app-type
transport-method
realm-id
egress-realm-id
description
carriers
allow-next-hop-lp
constraints
max-sessions
< text removed for brevity >
ping-method
ping-interval
ping-send-mode
ping-in-service-response-codes
out-service-response-codes
options
reuse-connections
tcp-keepalive
tcp-reconn-interval
< text removed for brevity >
2.2.87.13
2.2.87.13
5060
enabled
SIP
StaticTCP
INSIDE
S8730-PE-Active-IP
enabled
disabled
0
OPTIONS;hops=0
16
keep-alive
trans-timeouts=1
TCP
enabled
10
The key settings for the session agent to the ESS are shown below. This configuration is
added on the Acme Packet Session Director at the secondary site only.
session-agent
hostname
ip-address
port
state
app-protocol
app-type
transport-method
realm-id
egress-realm-id
description
carriers
allow-next-hop-lp
constraints
max-sessions
< text removed for brevity >
ping-method
ping-interval
ping-send-mode
ping-in-service-response-codes
out-service-response-codes
options
reuse-connections
tcp-keepalive
tcp-reconn-interval
< text removed for brevity >
JRR; Reviewed:
SPOC 7/21/2009
2.2.185.88
2.2.185.88
5060
enabled
SIP
StaticTCP
INSIDE
ESS-PE
enabled
disabled
0
OPTIONS;hops=0
16
keep-alive
trans-timeouts=1
TCP
enabled
10
28 of 70
CM-PE-NN4500
JRR; Reviewed:
SPOC 7/21/2009
29 of 70
CM-PE-NN4500
Since the session agent group ENTERPRISE already exists, and the only desired change is
for the dest parameter to include the Processor Ethernet entry, the following approach can
be used to change only the dest. The commands shown below were issued on the Session
Director at the primary site. The IP Addresses of the destination session agents can be
included inside parenthesis, separated by spaces, as shown in bold below.
acmesbc-pri# config t
acmesbc-pri(configure)# session-router
acmesbc-pri(session-router)# session-group
acmesbc-pri(session-agent-group)# select
<group-name>:
1: SERV_PROVIDER
2: ENTERPRISE
selection: 2
acmesbc-pri(session-agent-group)# dest (2.2.85.2 2.2.85.20 2.2.87.13)
acmesbc-pri(session-agent-group)# show
session-group
group-name
ENTERPRISE
description
state
enabled
app-protocol
SIP
strategy
RoundRobin
dest
2.2.85.2
2.2.85.20
2.2.87.13
trunk-group
sag-recursion
enabled
stop-sag-recurse
401,407
acmesbc-pri(session-agent-group)#
acmesbc-pri(session-agent-group)# done
JRR; Reviewed:
SPOC 7/21/2009
30 of 70
CM-PE-NN4500
For the Acme Packet Net-Net 4500 at the secondary site, the configuration can also be
updated to add the session agent for the S8500 ESS to the existing ENTERPRISE SAG.
To show an alternative approach, a different syntax is shown in bold below. Rather than
including all the destinations within parenthesis, the dest +2.2.185.88 approach was used to
add the session agent for the ESS to the SAG ENTERPRISE. The before and after
configuration can be observed in the show output below.
sbcsecsite-pri(session-router)# session-group
sbcsecsite-pri(session-agent-group)# select
<group-name>:
1: SERV_PROVIDER
2: ENTERPRISE
selection: 2
sbcsecsite-pri(session-agent-group)# show
session-group
group-name
ENTERPRISE
description
state
enabled
app-protocol
SIP
strategy
RoundRobin
dest
2.2.185.2
2.2.185.20
trunk-group
sag-recursion
enabled
stop-sag-recurse
401,407
last-modified-by
admin@2.2.4.150
last-modified-date
2009-04-14 11:47:50
sbcsecsite-pri(session-agent-group)# dest +2.2.185.88
sbcsecsite-pri(session-agent-group)# show
session-group
group-name
ENTERPRISE
description
state
enabled
app-protocol
SIP
strategy
RoundRobin
dest
2.2.185.2
2.2.185.20
2.2.185.88
trunk-group
sag-recursion
enabled
stop-sag-recurse
401,407
last-modified-by
admin@2.2.4.150
last-modified-date
2009-04-14 11:47:50
sbcsecsite-pri(session-agent-group)#
sbcsecsite-pri(session-agent-group)# done
31 of 70
CM-PE-NN4500
session agents to direct media to the Acme Packet Net-Net 4500. Two steering pools were
defined, one for each realm. The steering pools documented in Section 4.10 of reference [JRR]
apply; no changes are necessary due to the use of Processor Ethernet SIP trunks in
Communication Manager. Consult reference [AP1] for more information, including a means to
use steering pool configuration for call admission control.
JRR; Reviewed:
SPOC 7/21/2009
32 of 70
CM-PE-NN4500
5. Verifications
This section illustrates expected behaviors and sample results, focusing on calls using the
Processor Ethernet SIP trunks. Reference [JRR] can be consulted for a robust set of related call
verifications using the C-LAN SIP trunks, including failure scenarios. Section 6 documents test
observations that resulted in product modification requests.
Com
PN Num
1
1
2
2
Intf
Loc
1A01
2A01
Intf
Type
IPSI
IPSI
Port IPSI
Ntwk Gtway
Ste Loc
up
1A01
up
2A01
Pri/
Sec
Loc
1A01
2A01
Pri/
Cntl Connected
Sec
Clus Clus(ter)
State
ID IDs
actv-aa
1
1
2
actv-aa
1
1
2
The following screen, taken from the active S8730 Server during normal operation, shows that
the primary and secondary site IPSIs are controlled by the S8730 Server and in-service".
list ipserver-interface
IP SERVER INTERFACE INFORMATION
Port
Ntwk
Num
---1
Pri/
Sec
Bd Loc
-----1A01
2A01
Primary/
Secondary
IP Address
--------------2.2.185.9
Primary/
Secondary
Host Name
---------------2.2.185.9
Primary/
Secondary Serv
DHCP ID
State
--------- ----ipsi-A01a IN
Control
State
------actv-aa
2.2.85.9
2.2.85.9
ipsi-A02a
actv-aa 0.0.0.0
JRR; Reviewed:
SPOC 7/21/2009
IN
State Of
Health
C P E G
------0.0.0.0
33 of 70
CM-PE-NN4500
The following screen, taken during normal operation, shows that the ESS with IP Address
2.2.185.88 is registered with up-to-date translations.
list survivable-processor
Name
SURVIVABLE PROCESSORS
IP Address
Reg Act
Type
ESSCid002Sid003 ESS S
S83LSP-in-G250 LSP
S83LSP-in-G700 LSP
2.2.185.88
2.2.25.88
2.2.1.88
y
y
y
n
n
n
Translations
Updated
22:00 6/18/2009
22:00 6/18/2009
22:00 6/18/2009
Net
Rgn
1
2
4
In normal operation, when all network elements are functioning, and the active Avaya S8730
is processing all calls, incoming and outgoing SIP trunk calls to the enterprise can use SIP trunk
groups 30, 31, 32, 60, or 61. Table 2 shows the expected states during normal operation. Trunk
group 62 will not be used during normal operation because Communication Manager trunk
group 62 will be out-of-service (OOS). Also, the secondary site Acme Packet session agent to
the ESS will be out-of-service.
Avaya Trunk
Group (TG) &
Service State via
Avaya S8730
Servers
30 (C-LAN)
in-service
31 (C-LAN)
in-service
32 (S8730 PE)
in-service
60 (C-LAN)
in-service
61 (C-LAN)
in-service
62 (S8730 PE)
Out-of-service /
Far-End
Reason for
Avaya
Service State
OK response
to OPTIONS
OK response
to OPTIONS
OK response
to OPTIONS
OK response
to OPTIONS
OK response
to OPTIONS
S8730 PE is
not a session
agent in the
secondary site
NN4500
Primary Site
NN4500
Session Agent
& Service
State
SA 2.2.85.2
In-service
SA 2.2.85.20
In-service
SA 2.2.87.13
In-service
N/A
N/A
N/A
Secondary
Site NN4500
Session Agent
& Service
State
N/A
N/A
N/A
SA 2.2.185.2
In-service
SA 2.2.185.20
In-service
SA 2.2.185.88
Out-of-Service
Reason for
Acme Packet
Service State
Where
Applicable
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
No SIP response from
ESS at secondary site,
ESS not active
JRR; Reviewed:
SPOC 7/21/2009
34 of 70
CM-PE-NN4500
During normal operation, signaling group 62 will be marked for bypass, as shown below. The
Session Director at the secondary site does not respond at the SIP level to the OPTIONS message
sent by the active S8730 Server procr, the near-end of signaling group 62.
status signaling-group 62
STATUS SIGNALING GROUP
Group ID:
Group Type:
Signaling Type:
Group State:
62
sip
facility associated signaling
far-end bypass
During normal operation, the members of trunk group 62 will all be out-of-service/far-end as
shown in the abridged output below. Signaling group 62 and trunk group 62 will only be inservice when the ESS is active (e.g., controlling a port network or gateway).
status trunk 62
Page
Port
Service State
0062/001
0062/002
0062/003
0062/004
T00140
T00141
T00142
T00143
OOS/FE-idle
OOS/FE-idle
OOS/FE-idle
OOS/FE-idle
5.1.1. Incoming Calls from PSTN Arriving via SIP Trunk to Primary Site
Using the sample configuration, incoming PSTN calls arriving via the primary site will be
distributed in a round-robin fashion to the three session agents in the SAG ENTERPRISE.
These include the two C-LAN session agents previously illustrated in reference [JRR] as well as
the new session agent corresponding to the Processor Ethernet of the active S8730 Server.
The following show sipd agent command was run on the primary Acme Packet Net-Net 4500
after three inbound PSTN calls via the primary site Session Director. All session agents are inservice. Session agent 10.3.3.40 (the SIP Service Provider) shows 3 Active Inbound sessions.
The three session agents that are members of the SAG ENTERPRISE each show one Active
Outbound session, as a result of the round-robin distribution.
acmesbc-pri# show sipd agent
10:27:29-34 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.40
I
3
0.0
0
2.2.85.2
I
0
0.0
0
2.2.85.20
I
0
0.0
0
2.2.87.13
I
0
0.0
0
The following trace output shows a call incoming on signaling group 32 / trunk group 32 from
PSTN telephone 732-852-2550. The incoming call handling table for trunk group 32 mapped the
received number (21816) to extension 52020. Extension 52020 is an IP Telephone with IP
Address 2.2.1.109 in Region 3. Initially, the IP Media Processor in region 3 (2.2.26.4) is used,
JRR; Reviewed:
SPOC 7/21/2009
35 of 70
CM-PE-NN4500
but as can be seen in the final trace output, once the call is answered, the final RTP media path is
ip-direct from the IP Telephone (2.2.1.109) to the inside of the Acme Packet Net-Net 4500
at the primary site (2.2.85.45).
list trace tac 132
Page
LIST TRACE
time
10:59:36
10:59:36
10:59:36
10:59:36
10:59:36
10:59:36
10:59:36
10:59:42
10:59:42
10:59:42
data
Calling party trunk-group 32 member 1 cid 0xa97
Calling Number & Name 7328522496 NO-CPName
active trunk-group 32 member 1 cid 0xa97
dial 52020
ring station
52020 cid 0xa97
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.26.4]:13828
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49160
rgn:3 [2.2.26.4]:13820
active station
52020 cid 0xa97
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49160
rgn:3 [2.2.1.109]:19036
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.85.45]:49160
The following portion of a Wireshark trace shows an incoming call using the S8730 Processor
Ethernet. In frame 49, the Service Provider delivers the inbound INVITE to the Session Director
at the primary site. In Frame 51, the Session Director sends the INVITE to the S8730 Processor
Ethernet. The call proceeds as usual using the S8730 Processor Ethernet.
JRR; Reviewed:
SPOC 7/21/2009
36 of 70
CM-PE-NN4500
In the next example, a call arrives via the Processor Ethernet SIP trunk (32), and the call is
directed to call vector 1 via a VDN (x51081) that plays an announcement (x22232), and then
collects and verifies password digits from a caller. This type of call verifies proper collection of
DTMF via RFC 2833, and also illustrates the Communication Manager audio group concept that
allows announcements to be sourced from the local Avaya gateway. Audio groups enable
efficient utilization of resources, and also provide redundancy benefits.
From the bolded rows, note that the tone receiver as well as the announcements are sourced from
a board in the 2A carrier at the primary site.
list trace tac 132
Page
LIST TRACE
time
11:05:34
11:05:34
11:05:34
11:05:34
11:05:34
11:05:34
11:05:36
11:05:36
11:05:36
11:05:50
11:05:50
data
Calling party trunk-group 32 member 1 cid 0xa9f
Calling Number & Name 7328522496 NO-CPName
active trunk-group 32 member 1 cid 0xa9f
dial 51081
ring vector 1
cid 0xa9f
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49172
rgn:3 [2.2.26.4]:13956
tone-receiver
02AXX04 cid 0xa9f
active announcement
22232 cid 0xa9f
hear audio-group 1 board 02A08 ext 22232 cid 0xa9f
active announcement
22234 cid 0xa9f
hear audio-group 1 board 02A08 ext 22234 cid 0xa9f
JRR; Reviewed:
SPOC 7/21/2009
37 of 70
CM-PE-NN4500
In the next example, a call arrives via the Processor Ethernet site SIP trunk (32), and the call is
directed to Avaya call vector 3 via a VDN (x51082) that plays an announcement (x22555) and
collects digits for call routing. This also shows the locally-sourced announcements, verifies
DTMF collection using RFC 2833, and illustrates a call that arrives via the primary site
Processor Ethernet SIP trunk, but connects with a user (x51003) at the secondary site.
list trace tac 132
Page
LIST TRACE
time
11:09:13
11:09:13
11:09:13
11:09:13
11:09:13
11:09:13
11:09:15
11:09:15
11:09:15
11:09:26
11:09:26
11:09:26
11:09:31
11:09:31
11:09:31
data
Calling party trunk-group 32 member 1 cid 0xaa3
Calling Number & Name 7328522496 NO-CPName
active trunk-group 32 member 1 cid 0xaa3
dial 51082
ring vector 3
cid 0xaa3
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49178
rgn:3 [2.2.26.4]:14040
tone-receiver
02B0108 cid 0xaa3
active announcement
22555 cid 0xaa3
hear audio-group 1 board 02A08 ext 22555 cid 0xaa3
dial 51003
ring station
51003 cid 0xaa3
G711MU ss:off ps:20
rgn:1 [2.2.185.200]:3472
rgn:3 [2.2.26.4]:14048
active station
51003 cid 0xaa3
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49178
rgn:1 [2.2.185.200]:3472
G711MU ss:off ps:20
rgn:1 [2.2.185.200]:3472
rgn:3 [2.2.85.45]:49178
JRR; Reviewed:
SPOC 7/21/2009
38 of 70
CM-PE-NN4500
Page
LIST TRACE
time
16:25:53
16:25:53
16:25:53
16:25:53
16:25:53
16:25:53
16:25:53
16:25:59
16:25:59
16:25:59
data
dial 9917328522550 route:ARS
route-pattern 30 preference 1 cid 0xa0b
seize trunk-group 32 member 2 cid 0xa0b
Setup digits 7328522550
Calling Number & Name 7328522020 John Public
Proceed trunk-group 32 member 2 cid 0xa0b
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.26.4]:2764
active trunk-group 32 member 2 cid 0xa0b
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:58096
rgn:3 [2.2.85.45]:49154
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.1.109]:58096
The following portion of a Wireshark trace shows an outgoing call using the S8730 Processor
Ethernet. In frame 1670, Communication Manager uses the S8730 Processor Ethernet to send an
INVITE to the primary site Session Director. In frame 1673, the Session Director sends the
INVITE on to the Service Provider. The call proceeds as usual using the S8730 Processor
Ethernet.
JRR; Reviewed:
SPOC 7/21/2009
39 of 70
CM-PE-NN4500
Outbound calls were also made to PSTN destinations requiring a log-in with password, such as a
messaging system, to verify that DTMF was working properly in the outbound direction. The
following is an example Communication Manager trace using the Processor Ethernet SIP trunk
62. The call is placed from an H.323 IP Telephone (x52020). When the call is answered, the
call is shuffled to ip-direct, from the IP Telephone (2.2.1.109) to the primary site Session
Director (2.2.85.45). After the user hears the prompt for password input, and begins to enter
digits at 10:07:18, the media shuffles back to the Media Processor serving region 3 at 2.2.26.4.
Once user digit entry ends, and the user in this case is listening to a voice message, the media
shuffles back to ip-direct, as can be seen at 10:07:56. This behavior is not unique to calls using
Processor Ethernet SIP Trunks.
list trace tac 132
Page
LIST TRACE
time
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:13
10:07:18
10:07:18
10:07:56
10:07:56
data
dial 9917328523500 route:ARS
route-pattern 30 preference 1 cid 0xa81
seize trunk-group 32 member 13 cid 0xa81
Setup digits 7328523500
Calling Number & Name 7328522020 John Public
Proceed trunk-group 32 member 13 cid 0xa81
active trunk-group 32 member 13 cid 0xa81
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.26.4]:13388
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.85.45]:49154
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.1.109]:19036
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.26.4]:13416
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.26.4]:13424
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.85.45]:49154
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49154
rgn:3 [2.2.1.109]:19036
5.1.3. Incoming Calls from PSTN Arriving Via PSTN to Secondary Site
Using the sample configuration, incoming PSTN calls arriving via the secondary site will be
distributed in a round-robin fashion to the session agents in the SAG ENTERPRISE defined in
the secondary site Session Director. These include the two C-LAN session agents previously
verified in reference [JRR] as well as the new session agent corresponding to the Processor
Ethernet of the ESS. Under normal operation, as noted previously, the session agent
corresponding to the Processor Ethernet of the ESS will be out-of-service from the point of view
of the secondary site Session Director. Therefore, incoming calls from the PSTN arriving via the
secondary site are identical to those shown in Section 5.1.3 of reference [JRR].
JRR; Reviewed:
SPOC 7/21/2009
40 of 70
CM-PE-NN4500
To illustrate the behavior, the following show sipd agent command was run on the secondary
Acme Packet Net-Net 4500 after three inbound PSTN calls via the secondary site. Observe that
session agent 2.2.185.88 is out of service. Session agent 10.3.3.1 (the SIP Service Provider)
shows 3 Active Inbound sessions. Session agent 2.2.185.2 show two Active Outbound sessions,
and session agent 2.2.185.20 shows one Active Outbound session, as a result of the round-robin
distribution, and the bypass of the out-of-service session agent in the SAG ENTERPRISE.
sbcsecsite-pri# show sipd agent
11:33:28-56 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.1
I
3
0.0
0
2.2.185.2
I
0
0.0
0
2.2.185.20
I
0
0.0
0
2.2.185.88
O
0
0.0
0
Pri/
Sec
Bd Loc
-----1A01
2A01
Primary/
Secondary
IP Address
--------------2.2.185.9
2.2.85.9
JRR; Reviewed:
SPOC 7/21/2009
Primary/
Secondary
Host Name
---------------2.2.185.9
2.2.85.9
Primary/
Secondary Serv
DHCP ID
State
--------- ----ipsi-A01a IN
ipsi-A02a OUT
Control
State
------actv-aa
active
State Of
Health
C P E G
------0.0.0.0
0.1.1.0
41 of 70
CM-PE-NN4500
Table 3 shows the expected states from the point of view of the active Avaya S8730 Server,
when the WAN is down, and the primary site is controlled by the active Avaya S8730 Server,
and the secondary site is controlled by the Avaya ESS. Incoming and outgoing SIP trunk calls at
the primary site can use SIP trunk groups 30, 31, and 32.
Avaya Trunk
Group (TG) &
Service State
via Avaya
S8730 Server
30 (C-LAN)
in-service
31 (C-LAN)
in-service
32 (S8730 PE)
in-service
60 (C-LAN)
Out-of-service /
Near-End
61 (C-LAN)
Out-of-service /
Near-End
62 (S8730 PE)
Out-of-service /
Far-End
Secondary Site
NN4500
Session Agent
& Service
State
N/A
SA 2.2.185.2
In-service
Reason for
Acme Packet
Service State
Where
Applicable
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
Any SIP response to
OPTIONS
SA 2.2.185.20
In-service
SA 2.2.185.88
In-Service
N/A
N/A
Table 3: S8730 Controls Primary Site, ESS Controls Secondary Site, S8730 States
JRR; Reviewed:
SPOC 7/21/2009
42 of 70
CM-PE-NN4500
Table 4 shows the expected states from the point of view of the Avaya ESS, when the WAN is
down, and the primary site is controlled by the active Avaya S8730 Server, and the secondary
site is controlled by the ESS. Incoming and outgoing SIP trunk calls at the secondary site can use
SIP trunk groups 60, 61, and 62. Trunk group 62 and the corresponding session agent in the
secondary site Session Director come in-service when the Avaya ESS becomes active.
Avaya Trunk
Group (TG) &
Service State
via Avaya
S8500 ESS
30 (C-LAN)
Out-of-service /
Near-End
31 (C-LAN)
Out-of-service /
Near-End
32 (S8500
procr)
Out-of-service /
Far-End
60 (C-LAN)
In-service
61 (C-LAN)
In-service
62 (S8500
procr)
In-service
Reason for
Avaya
Service State
via ESS
ESS not
controlling
cabinet
containing
C-LAN
ESS not
controlling
cabinet
containing
C-LAN
No response
from primary
site Session
Director
OK response
to OPTIONS
OK response
to OPTIONS
See Section
5.7
Primary Site
NN4500
Session Agent
& Service
State
SA 2.2.85.2
In-service
Secondary
Site NN4500
Session Agent
& Service
State
N/A
Reason for
Acme Packet
Service State
Where
Applicable
Any SIP response to
OPTIONS
SA 2.2.85.20
In-service
N/A
SA 2.2.87.13
In-service
N/A
N/A
SA 2.2.185.2
In-service
SA 2.2.185.20
In-service
SA 2.2.185.88
In-Service
N/A
N/A
Table 4: S8730 Controls Primary Site, ESS Controls Secondary Site, ESS States
JRR; Reviewed:
SPOC 7/21/2009
43 of 70
CM-PE-NN4500
The following screen, taken from the primary site Session Director in this condition, shows that
all the session agents configured on the primary site Session Director are in-service.
acmesbc-pri# show sipd agent
10:12:11-46 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.40
I
0
0.0
0
2.2.85.2
I
0
0.0
0
2.2.85.20
I
0
0.0
0
2.2.87.13
I
0
0.0
0
JRR; Reviewed:
SPOC 7/21/2009
44 of 70
CM-PE-NN4500
Once the ESS is active, an incoming call from the PSTN via the secondary site can be distributed
by the secondary site Session Director to the Processor Ethernet interface of the ESS (as well as
the C-LAN session agents in the secondary site). That is, the Session Director will mark the
session agent to the ESS in-service, since the ESS begins responding to the SIP OPTIONS
messages from the Session Director. The following screen illustrates the agent state. The screen
below and the previous screen were taken during the testing of ESS take-over of the secondary
site, and the timestamps are therefore relevant. At roughly 11:08, a failure to the WAN was
induced. By roughly 11:12 (IPSI no-service timer was configured for 3 minutes), all the session
agents at the secondary site were in-service, under the control of the ESS.
11:12:42-40 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.1
I
0
0.0
0
2.2.185.2
I
0
0.0
0
2.2.185.20
I
0
0.0
0
2.2.185.88
I
0
0.0
0
At this point, in Communication Manager running on the ESS, signaling groups 60 through 62,
and trunk groups 60 through 62, are in-service and eligible for call activity.
The following screen shows an example distribution of 3 inbound calls via the secondary site
Session Director, when the ESS is controlling cabinet 1. Note that 3 inbound calls are active
from the PSTN (10.3.3.1), and these three calls have been distributed in a round-robin fashion to
each of the three session agents, including the ESS Processor Ethernet (2.2.185.88).
sbcsecsite-pri# show sipd ag
11:36:10-38 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.1
I
3
0.0
0
2.2.185.2
I
0
0.0
0
2.2.185.20
I
0
0.0
0
2.2.185.88
I
0
0.0
0
The following portion of a Wireshark trace shows an incoming call using the S8500 ESS
Processor Ethernet. In frame 16472, the Service Provider delivers the inbound INVITE to the
Session Director at the secondary site. In Frame 16474, the Session Director sends the INVITE
to the S8500 ESS Processor Ethernet. The call proceeds as usual using the ESS Processor
Ethernet.
JRR; Reviewed:
SPOC 7/21/2009
45 of 70
CM-PE-NN4500
The following status screen, taken from the ESS, shows an active call via the Processor Ethernet
of the ESS, using signaling group and trunk group 62.
status trunk 62
Member
Port
0062/001
0062/002
0062/003
0062/004
T00140
T00141
T00142
T00143
Page
Page
The following portion of a Wireshark trace shows an outgoing call using the S8500 ESS
Processor Ethernet. In frame 75, Communication Manager running on the ESS sends an INVITE
via the S8500 Processor Ethernet to the secondary site Session Director. In frame 78, the
JRR; Reviewed:
SPOC 7/21/2009
46 of 70
CM-PE-NN4500
Session Director sends the INVITE to the Service Provider. The call proceeds as usual using the
S8500 ESS Processor Ethernet.
If the configuration were different, such that a call from the secondary site user was directed to a
routing pattern where the SIP trunks at the primary site were listed before the SIP trunks at the
secondary site, see Section 6.
Pri/
Sec
Bd Loc
-----1A01
2A01
Primary/
Secondary
IP Address
--------------2.2.185.9
Primary/
Secondary
Host Name
---------------2.2.185.9
Primary/
Secondary Serv
DHCP ID
State
--------- ----ipsi-A01a IN
Control
State
------actv-aa
2.2.85.9
2.2.85.9
ipsi-A02a
actv-aa 0.0.0.0
JRR; Reviewed:
SPOC 7/21/2009
IN
State Of
Health
C P E G
------0.0.0.0
47 of 70
CM-PE-NN4500
The following screen, taken from the primary site Session Director, shows that the two C-LAN
session agents at the primary site are back in-service, since the ESS is in control of the cabinets
at both sites. In this case, the session agent to the S8730 Processor Ethernet is out-of-service,
since the type of failure induced was a failure of the S8730 server pair.
acmesbc-pri# show sipd agent
08:33:40-58 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.40
I
0
0.0
0
2.2.85.2
I
0
0.0
0
2.2.85.20
I
0
0.0
0
2.2.87.13
O
0
0.0
0
The following screen, taken from the secondary site Session Director, shows that the two C-LAN
session agents at the secondary site are also in-service, since the ESS is in control of both sites.
The session agent to the S8500 ESS Processor Ethernet is also in-service, since the ESS responds
to SIP OPTIONS from the secondary site Session Director when it is active. In the verification
testing, the session agent for the ESS would typically come in-service slightly before the session
agents for the C-LANs newly controlled by the ESS. As can be seen in the screen below, an
inbound PSTN call via the secondary site Session Director is active, having been delivered to
Communication Manager via the ESS Processor Ethernet SIP Trunk (62).
09:32:54-36 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.1
I
1
0.0
0
2.2.185.2
I
0
0.0
0
2.2.185.20
I
0
0.0
0
2.2.185.88
I
0
0.0
0
The Communication Manager call traces for incoming calls to the secondary site when the ESS
is in control of both sites are the same as when the ESS is control of only the secondary site
(Section 5.2), so these call traces are omitted. Of course, since the system is whole in this
case, with all sites controlled by the ESS, there is no need for Dial Plan Transparency to
complete a call that arrives via one site, but is directed to a user at the other. The following
screen shows three active inbound calls from the PSTN that have been evenly distributed by the
secondary site Session Director to the two C-LANs and the Processor Ethernet of the ESS.
sbcsecsite-pri# show sipd agent
09:45:30-42 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.1
I
3
0.0
0
2.2.185.2
I
0
0.0
0
2.2.185.20
I
0
0.0
0
2.2.185.88
I
0
0.0
0
The following screen shows three active inbound calls from the PSTN to the primary site Session
Director. Since the session agent for the active S8730 Processor Ethernet is out-of-service, the
calls are distributed via the two C-LANs at the primary site. The Communication Manager call
JRR; Reviewed:
SPOC 7/21/2009
48 of 70
CM-PE-NN4500
traces for incoming calls to the primary site when the ESS is in control are the same as when the
primary site S8730 Server is in control (Section 5.1), so these call traces are omitted.
acmesbc-pri# show sipd agent
09:00:24-42 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.40
I
3
0.0
0
2.2.85.2
I
0
0.0
0
2.2.85.20
I
0
0.0
0
2.2.87.13
O
0
0.0
0
Outbound calls to the PSTN when the ESS is in control of both sites are eligible to use trunk
groups 30, 31, 60, 61, and 62 (see Section 5.7 and Section 6 if using Service Pack 1). Outbound
call traces will look the same as those previously illustrated and are therefore omitted. In the
steady state, trunk group 32 on the active ESS will be marked out-of-service by Communication
Manager maintenance (i.e., no response from primary site Session Director, which does not have
a session agent for the ESS procr). Therefore, trunk group 32 will not be chosen for outbound
calls. Until trunk group 32 is marked out-of-service by Communication Manager maintenance,
any outbound calls directed to a route-pattern containing trunk group 32 can complete to
alternate trunks in the route-pattern via Look-Ahead Routing.
5.3.1. Recovery of the S8730 Servers while the ESS Retains Control
Now assume that the problem that caused the S8730 Servers to be off-line is resolved. Although
the active S8730 Server is not controlling any cabinet, it can still respond to SIP OPTIONS from
the primary site Session Director. Since the S8730 Server is not in control of any resources, the
response to SIP OPTIONS is a 503 Service Unavailable. Recall that by default, the Session
Director will treat any SIP response to OPTIONS as an indication that the session agent is inservice. Therefore, the primary site Session Director will consider the session agent to the S8730
Processor Ethernet in-service, even though the S8500 ESS is in control of both sites. A sample
command output in this state is shown below:
acmesbc-pri# show sipd agent
09:06:17-35 (recent)
----- Inbound ----Session Agent
Active Rate ConEx
10.3.3.40
I
0
0.0
0
2.2.85.2
I
0
0.0
0
2.2.85.20
I
0
0.0
0
2.2.87.13
I
0
0.0
0
If an incoming PSTN call comes to the primary site Session Director, and the Session Director
chooses the session agent for the S8730 Processor Ethernet, the Session Director will receive a
503 Service Unavailable as a response to the inbound INVITE. The Session Director will then
automatically choose an alternate session agent in the same SAG to handle the call. This
behavior can be observed in the following Wireshark trace. In frame 38, the primary site Session
Director sends SIP OPTIONS to the S8730 Processor Ethernet. In frame 40, the S8730 responds
with 503 Service Unavailable. Absent changes to the default configuration, the 503 is a
sufficient response to mark the session agent in-service. In frame 46, the Service Provider
JRR; Reviewed:
SPOC 7/21/2009
49 of 70
CM-PE-NN4500
delivers an inbound call to the primary site Session Director. In frame 48, the INVITE is sent
from the Session Director to the S8730 Processor Ethernet. In frame 49, a 503 Service
Unavailable is returned to the Session Director. In frame 51, the Session Director delivers the
INVITE to 2.2.85.2, another session agent in the same SAG, and the call succeeds.
Since calls succeed in this state due to SAG recursion, the default behavior of the Session
Director for the session agent to the S8730 Processor Ethernet may be sufficient. If desired, the
acceptable SIP responses (e.g., 200 OK only) to SIP OPTIONS that mark a session agent inservice can be modified for the S8730 Processor Ethernet session agent, as discussed as in
Section 4.7.
JRR; Reviewed:
SPOC 7/21/2009
50 of 70
CM-PE-NN4500
The first trace below is filtered on SIP messages involving the ESS Processor Ethernet. In frame
38, the secondary site Session Director sends SIP OPTIONS to the ESS. In frame 39, the ESS
responds with 503 Service Unavailable, which absent changes to the default configuration, is a
sufficient response to keep the session agent in-service. This exchange re-occurs every 16
seconds in frames 156-157 and 1110-1111. In frame 2048, the Session Director sends an
INVITE to the ESS Processor Ethernet. In frame 2049, a 503 Service Unavailable is returned to
the Session Director. Since this trace only shows messages that involved the ESS Processor
Ethernet, the messages involving other session agents are not shown.
The screen below is from the same Wireshark trace, but with a different filter, to expose the
completion of the call. In frame 2046, the Service Provider sends the INVITE to the secondary
site Session Director. As stated above, the ESS responds with a 503, and in frame 2051, the
Session Director delivers the INVITE to another session agent in the same SAG, in this case
2.2.185.2, corresponding to a C-LAN now controlled by the active S8730 Server, which has
recovered system control. The remainder of the trace shows that the call proceeds normally.
Below, a later view into the same Wireshark trace is filtered on TCP and the ESS Processor
Ethernet, showing the ESS rejecting communications at the TCP level. As a result, the
secondary site Session Director will receive no SIP-level response from the ESS, and will mark
the session agent to the ESS out-of-service.
JRR; Reviewed:
SPOC 7/21/2009
51 of 70
CM-PE-NN4500
The condition where the ESS that had been actively controlling resources is no longer controlling
resources, but is still responding at the SIP stack level, is a transient condition. Since calls
succeed in this state due to SAG recursion, the default behavior of the Session Director for the
session agent to the ESS may be sufficient. If desired, the acceptable SIP responses (e.g., 200
OK only) to SIP OPTIONS that mark a session agent in-service can be modified, as discussed as
in Section 4.7.
JRR; Reviewed:
SPOC 7/21/2009
52 of 70
CM-PE-NN4500
In contrast, if an Avaya S8730 Server Processor Ethernet SIP signaling group is busied out, the
Session Director (with default behavior) will retain an in-service state for the session agent. The
following portion of a Wireshark trace shows such a condition. At the start of the trace,
signaling group 32 is operating normally, and the active S8730 Server at 2.2.87.13 is responding
to OPTIONS with 200 OK, as in frame 213. However, later in the trace, after signaling group 32
has been busied out, the active S8730 Server responds with a 503 Service Unavailable, as shown
in frame 292 and 927. The Session Director will mark the session agent in-service (unless the
Session Director is configured to consider only a 200 OK acceptable via ping-in-serviceresponse-codes, see Section 4.7).
New calls can still succeed to other members of the SAG, but the call will be offered to the
busied-out Processor Ethernet signaling group, as shown in the trace below. In frame 1051, the
SIP Service Provider sends the incoming call INVITE to the primary site Session Director. In
frame 1053, the Session Director sends the INVITE to the S8730 session agent, since it is still
considered to be in-service. In frame 1054, Communication Manager responds with a 503. In
frame 1056, the Session Director sends the INVITE to another member of the same SAG, and
the call can complete normally from that point forward.
A Processor Ethernet based SIP signaling group will be marked out-of-service by the Session
Director, if the change ip-interface procr command is used to disable the ip-interface.
(However, note that doing so can affect other devices and applications). An example of this
condition is shown below. When the ip-interface procr is disabled, signaling groups with nearend procr will not respond at the SIP level.
See Section 5.4 of reference [JRR] for additional failure scenarios involving session agents.
In general, if there is one failed session agent at the time when an incoming call arrives, the
behavior depends on whether the Acme Packet Net-Net 4500 has realized the session agent is no
longer available. If the Session Director has not made the determination that the session agent is
unreachable, the session agent could be tried, subject to the SAG group strategy. The session
will experience a transaction timeout, and the session agent will be marked out-of-service.
JRR; Reviewed:
SPOC 7/21/2009
53 of 70
CM-PE-NN4500
The INVITE will be directed to a working session agent in the SAG, and the call will complete,
albeit with a slight delay (i.e., the transaction timeout).
Once the failed session agent has been marked out-of-service due to the transaction timeout, new
incoming calls will immediately be directed to the working session agent in the SAG, and the
call will complete without the delay. Note that a 503 response is not a transaction timeout and
therefore the session agent is not taken out-of-service by the Session Director.
As described in Section 1.3, Communication Manager can mark a SIP Signaling Group for
bypass and the corresponding SIP trunk members Out-of-Service/Far-end (OOS/FE) due to
failure of the SIP OPTIONS exchange. If the network recovers, but a successful SIP OPTIONS
exchange has not yet occurred, the Avaya trunk members may be OOS/FE when an incoming
INVITE arrives. Communication Manager will accept the incoming call. The following screen
shows an example where an incoming call was received by the S8730 Processor Ethernet
signaling group, just after recovery of the service provider network after an extended outage.
Prior to this call, all members of trunk group 32 were OOS/FE. After this call, all members of
trunk group 32 were marked in-service.
list trace tac 132
Page
LIST TRACE
time
14:13:37
14:13:37
14:13:37
14:13:37
14:13:37
14:13:37
14:13:37
14:13:41
14:13:41
14:13:41
data
Calling party trunk-group 32 member 1 cid 0x111a
Calling Number & Name 7328522550 NO-CPName
active trunk-group 32 member 1 cid 0x111a
dial 52020
ring station
52020 cid 0x111a
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.26.4]:3488
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49196
rgn:3 [2.2.26.4]:3480
active station
52020 cid 0x111a
G711MU ss:off ps:20
rgn:3 [2.2.85.45]:49196
rgn:3 [2.2.1.109]:19036
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.85.45]:49196
If all session agents that are members of a SAG are not responding, or all trunks at a site are
busy, then the Acme Packet Net-Net 4500 will in general return a SIP 503 to the network.
Assuming the SIP Service Provider can redirect calls to the opposite site upon receiving a 503
from the initial site used for the call, then the call can complete successfully at the working site.
JRR; Reviewed:
SPOC 7/21/2009
54 of 70
CM-PE-NN4500
The following is a Wireshark trace for an incoming call when there is an all trunks busy
condition at the primary site. The trace is filtered to show only the inside communications
between the primary site Session Director and Communication Manager. At the start of the
trace, OPTIONS messages can be observed, with 503 responses, as is typical when there are no
trunks available to take a call. Using the default session agent behavior for SIP OPTIONS, the
session agents remain in-service. In frame 90, the Session Director sends an INVITE to 2.2.85.2,
the session agent corresponding to Avaya signaling group 30. In frame 94, Communication
Manager sends a 503. There are no available trunk members in trunk group 30 to handle the call.
In frame 96, the Session Director sends the INVITE to 2.2.85.20, another session agent in the
same SAG. In frame 101, Communication Manager sends a 503 because there are no available
trunk members in trunk group 31 either. In frame 103, the Session Director sends the INVITE to
2.2.87.13, the S8730 Processor Ethernet session agent in the same SAG. In frame 104,
Communication Manager sends a 503 because there are no available trunk members in trunk
group 32 either. Although not shown, the Session Director returns a 503 to the SIP Service
Provider. In this case, for calls to fail-over to an alternate site, the SIP Service Provider must
have the capability to redirect the call upon receipt of a 503 Service Unavailable from the
enterprise site.
5.5.1. Incoming Call from PSTN, Sites Acme Packet Net-Net 4500 Off-line
When the Acme Packet Net-Net 4500 is not responding at one site, it is expected that the SIP
Service Provider would redirect the call to the other site. Therefore, incoming calls can still
succeed, subject to the capabilities of the SIP Service Provider to provide fail-over. From a
Communication Manager point of view, incoming calls can arrive from either the primary site or
secondary site and reach any user. Therefore, inbound calls with one Acme Packet Net-Net 4500
offline look to Communication Manager like the call traces in Section 5.1, arriving from the
working Acme Packet Net-Net 4500.
5.5.2. Outgoing Call to PSTN, Sites Acme Packet Net-Net 4500 Off-line
The sample trace that follows was taken immediately after Ethernet was removed from the inside
interface of the Acme Packet Net-Net 4500 at the primary site. Extension 52020 dials the ARS
JRR; Reviewed:
SPOC 7/21/2009
55 of 70
CM-PE-NN4500
access code followed by 17328522550. The call is delivered to route pattern 30, which at the
time of this call, lists two trunk groups at the primary site (32, 31) followed by two trunks at the
secondary site (60, 61). Six seconds after trying trunk group 32, the denial event marked in bold
in the trace triggers LAR to the next choice in the pattern, trunk group 31. Since trunk group 31
is also terminating on the off-line primary site Session Director, the bold denial event triggers
LAR to the next choice, trunk group 60. Since trunk group 60 is operating normally using the
secondary site Session Director, the call completes using trunk group 60. Note that the six
seconds is governed by the timer named Alternate Route Timer on the Avaya signaling group.
Six seconds is the default value. Ultimately, the final connection is an inter-region ip-direct
connection between the IP Telephone (2.2.1.109) at the primary site and the Acme Packet NetNet 4500 (2.2.185.145) at the secondary site.
list trace station 52020
Page
LIST TRACE
time
14:21:22
14:21:22
14:21:25
14:21:25
14:21:34
14:21:34
14:21:34
14:21:34
14:21:34
14:21:40
14:21:40
14:21:40
14:21:40
14:21:40
14:21:40
14:21:40
14:21:40
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:46
14:21:52
14:21:52
14:21:52
data
active station
52020 cid 0x111c
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.26.4]:3512
dial 991732852 route:ARS
term trunk-group 32
cid 0x111c
dial 9917328522550 route:ARS
route-pattern 30 preference 1 cid 0x111c
seize trunk-group 32 member 2 cid 0x111c
Setup digits 7328522550
Calling Number & Name 7328522020 John Public
denial event 1191: Network failure D1=0x8c51 D2=0x26
route-pattern 30 preference 1 unavailable cid 0x111c
dial 9917328522550 route:ARS
term trunk-group 31
cid 0x111c
dial 9917328522550 route:ARS
route-pattern 30 preference 2 cid 0x111c
seize trunk-group 31 member 2 cid 0x111c
Calling Number & Name 7328522020 John Public
denial event 1191: Network failure D1=0x8c51 D2=0x26
term trunk-group 32
cid 0x111c
route-pattern 30 preference 2 unavailable cid 0x111c
dial 9917328522550 route:ARS
term trunk-group 60
cid 0x111c
dial 9917328522550 route:ARS
route-pattern 30 preference 3 cid 0x111c
seize trunk-group 60 member 2 cid 0x111c
Calling Number & Name 52020 John Public
Proceed trunk-group 60 member 2 cid 0x111c
G711MU ss:off ps:20
rgn:1 [2.2.185.145]:49152
rgn:3 [2.2.26.4]:3560
active trunk-group 60 member 2 cid 0x111c
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:1 [2.2.185.145]:49152
G711MU ss:off ps:20
rgn:1 [2.2.185.145]:49152
rgn:3 [2.2.1.109]:19036
JRR; Reviewed:
SPOC 7/21/2009
56 of 70
CM-PE-NN4500
If the failure persists, Communication Manager will mark the signaling group for bypass (and
trunk groups OOS/FE). Therefore, outbound calls like the one traced above would immediately
proceed to the trunks connecting to the working Acme Packet Net-Net 4500, without the delay
associated with the timeout of the outbound INVITEs. LAR is only required when the trunks are
chosen because they appear to be in-service, and then a timeout or down-stream failure occurs
requiring a route-advance.
If an Avaya SIP trunk group is in the Out-of-Service/Far-end state (OOS/FE), Communication
Manager will accept an incoming call (i.e., accept INVITE), but will not offer an outgoing call
(i.e., send INVITE). In the sample configuration, if the Acme Packet Net-Net 4500 at the farend of the Avaya signaling group has a failure that persists, this state will be seen. This state
will also be seen if the Acme Packet Net-Net 4500 is functioning properly, but the SIP Service
Provider that is the next hop has failed. The Acme Packet Net-Net 4500 will respond with a
503 when the next hop is out of service.
Failure of the secondary site Acme Packet Net-Net 4500 produces similar results.
JRR; Reviewed:
SPOC 7/21/2009
57 of 70
CM-PE-NN4500
The following screen shows an example call trace when a user at the primary site attempts an
outbound PSTN call right after the failure of the service provider network. That is,
Communication Manager can still communicate with the Acme Packet Net-Net 4500, but the
Acme Packet Net-Net 4500 at the primary site is unable to communicate with the public
network, and the Acme Packet Net-Net 4500 has not yet marked the session agent to the public
network out-of-service. Since Communication Manager has not yet marked the trunks OOS, the
call is offered to the first choice in the route-pattern (a primary site Processor Ethernet trunk),
then the second choice in the route-pattern (a primary site C-LAN trunk), then the third choice, a
secondary site trunk, and so on.
list trace station 52020
Page
LIST TRACE
time
15:09:34
15:09:34
data
active station
52020 cid 0x1122
G711MU ss:off ps:20
rgn:3 [2.2.1.109]:19036
rgn:3 [2.2.26.4]:3836
15:09:38
dial 991732852 route:ARS
15:09:38
term trunk-group 32
cid 0x1122
15:09:44
dial 9917328522550 route:ARS
15:09:44
route-pattern 30 preference 1 cid 0x1122
15:09:44
seize trunk-group 32 member 3 cid 0x1122
15:09:44
Setup digits 7328522550
15:09:44
Calling Number & Name 7328522020 John Public
15:09:44
Proceed trunk-group 32 member 3 cid 0x1122
15:09:50
denial event 1191: Network failure D1=0x8c51 D2=0x26
15:09:50
route-pattern 30 preference 1 unavailable cid 0x1122
15:09:50
dial 9917328522550 route:ARS
15:09:50
term trunk-group 31
cid 0x1122
15:09:50
dial 9917328522550 route:ARS
15:09:50
route-pattern 30 preference 2 cid 0x1122
15:09:50
seize trunk-group 31 member 3 cid 0x1122
15:09:50
Calling Number & Name 7328522020 John Public
15:09:50
Proceed trunk-group 31 member 3 cid 0x1122
15:09:54
dial 9917328522550 route:ARS
15:09:54
term station
52020 cid 0x1122
15:09:56
denial event 1191: Network failure D1=0x8c51 D2=0x26
15:09:56
term trunk-group 32
cid 0x1122
15:09:56
route-pattern 30 preference 2 unavailable cid 0x1122
15:09:56
dial 9917328522550 route:ARS
15:09:56
term trunk-group 60
cid 0x1122
15:09:56
dial 9917328522550 route:ARS
15:09:56
route-pattern 30 preference 3 cid 0x1122
15:09:56
seize trunk-group 60 member 3 cid 0x1122
<and so on, text removed>
In the case shown above, the Wireshark trace would show that the Acme Packet Net-Net 4500 at
the primary site responds with 100 TRYING to INVITE messages, but Communication Manager
would receive nothing after 100 TRYING. Communication Manager does a route-advance
due to LAR = next on the route-pattern six seconds later.
Now assume the network outage persists long enough for the Acme Packet Net-Net 4500 at the
primary site to mark the session agent to the public network out-of-service. However, the outage
has not persisted long enough for Communication Manager to have marked the trunks to the
Session Director out-of-service. In the sample configuration, the Session Director sources SIP
JRR; Reviewed:
SPOC 7/21/2009
58 of 70
CM-PE-NN4500
OPTIONS every 16 seconds, so the Session Director will generally discover that the session
agent to the service provider is out before Communication Manager. In this case, since
Communication Manager has not yet marked the trunks OOS, the call is offered to the first
choice in the route-pattern (a primary site trunk). Since the Session Director has already marked
the next-hop out-of-service, the Session Director responds immediately with a 503.
Communication Manager can therefore immediately route-advance (no need to wait for timeout)
to the next choice in the route-pattern. In other words, once the Session Director has detected
that the Service Provider is non-responsive, Look-ahead Routing will occur quickly. An
example trace is provided in Section 5.6 of reference [JRR].
Once Communication Manager determines via SIP OPTIONS testing that the network is out (see
Section 1.3 and Section 5.7 of reference [JRR] for details), a similar call would simply bypass
the trunks that are marked out-of-service.
The following portion of a Wireshark trace illustrates a SIP OPTIONS exchange initiated by
Communication Manager for signaling group 62, also when the enterprise network is functioning
normally. Signaling group 62 has near-end procr, which is the IP Address of the active Avaya
S8730 Server in this case. The far-end of signaling group 62 is 2.2.185.145, the inside address of
the Acme Packet Net-Net 4500 at the secondary site. In frame 117, Communication Manager
opens a TCP connection to the Session Director at the secondary site. In frame 120,
Communication Manager sends the SIP OPTIONS to the Session Director for signaling group
62. In frame 121, the Session Director responds with a TCP FIN, ACK. The active Avaya
S8730 Server will not receive a 200 OK response from the Session Director at the secondary site,
because the secondary site does not have a session agent defined for the Avaya S8730 Server at
JRR; Reviewed:
SPOC 7/21/2009
59 of 70
CM-PE-NN4500
the primary site. Communication Manager marks signaling group 62 for bypass and the
corresponding trunk group 62 Out-of-Service/Far-end.
Communication Manager will periodically try to establish the connectivity for signaling group
62, each time with a similar exchange (using a new source port) as shown below. Signaling
group 62 will always be out-of-service from the point of view of Communication Manager
running on the Avaya S8730 Server.
JRR; Reviewed:
SPOC 7/21/2009
60 of 70
CM-PE-NN4500
When the ESS is active, Communication Manager running on the ESS will also attempt to bring
up signaling group 32. However, signaling group 32 will always remain out-of-service from the
point of view of the ESS for the same reason that signaling group 62 will always remain out-ofservice from the point of view of the Avaya S8730. In frame 3406, the ESS opens a TCP
connection to the primary site Session Director. (At the time of this trace, the WAN failure
causing the ESS to becoming active had been resolved). In frame 3409, the ESS sends
OPTIONS to the Session Director. Communication Manager on the ESS may receive responses
as shown below at the TCP level, but will not receive a 200 OK from the primary site Session
Director, since the primary site Session Director does not have a configured session agent for the
ESS. The ESS continues to try (new TCP source port) beginning in frame 3566.
The trace below shows that the active ESS is also trying to maintain signaling group 32 to the
primary site Session Director with ICMP ping. Again, since the Session Director was configured
not to respond to ping on any interface other than the management interface, there is no response.
Signaling group 32 is therefore marked for bypass like signaling group 62. This trace is
included to emphasize that if the work-around to enable ping responses is implemented on the
JRR; Reviewed:
SPOC 7/21/2009
61 of 70
CM-PE-NN4500
Session Director, it should be implemented on the secondary site Session Director only, to
prevent signaling group 32 from coming in-service on the active ESS when the primary site
Session Director has no session agent to handle SIP requests from the ESS at the secondary site.
The following Wireshark trace shows the behavior after the work-around documented in Section
4.3 is implemented for the secondary site Session Director. Frames 729-837 show the Session
Director maintaining the session agent to the active ESS via SIP OPTIONS. In frame 852, the
ESS Processor Ethernet sources an ICMP ping request to the Session Director. Since the workaround that allows the inside interface of the secondary site Session Director to respond to ping
has been implemented, frame 853 shows the ping reply. Several other request / reply pairs are
also evident. Signaling group 62 remains in-service.
The following portion of a Wireshark trace shows the Session Director at the secondary site
(2.2.185.145) attempting to bring up the session agent to the ESS at 2.2.185.88, under normal
conditions, when the ESS is not active. In frame 328, the Session Director at the secondary site
JRR; Reviewed:
SPOC 7/21/2009
62 of 70
CM-PE-NN4500
opens a TCP connection to the ESS. In frame 331, the Session Director sends the SIP
OPTIONS. In frame 334, the ESS responds with a TCP FIN, ACK. The ESS will not respond at
the SIP level when the ESS is not active.
The Session Director will continue to try to establish the connectivity for the session agent
corresponding to the ESS procr, but this session agent will remain out-of-service until the ESS
is activated (e.g., by a network or other failure). The following portion of a Wireshark trace
illustrates another attempt (source TCP port will count up by 2 for each attempt)
The following portion of a Wireshark trace shows the Session Director at the secondary site
successfully maintaining the session agent to the ESS in-service, when the ESS is active (in this
case, controlling cabinet 1). Frame 76 shows Communication Manager running on the ESS
responding with a 200 OK. Recall that the Session Director was configured to send SIP
OPTIONS every 16 seconds in the absence of other traffic. The 16 second interval between SIP
OPTIONS is evident in the trace below (second column timestamp).
JRR; Reviewed:
SPOC 7/21/2009
63 of 70
CM-PE-NN4500
The following portion of a Wireshark trace, filtered for TCP, shows the TCP connections in-use
prior to an interchange. In this case, when the Session Director sends SIP OPTIONS to the
S8730 Server session agent at 2.2.87.13, it uses TCP source port 8196 and destination port 5060,
as can be seen in frames 508-571 below. When Communication Manager sends SIP OPTIONS
to maintain signaling group 32 using the S8730 Processor Ethernet, it opens a TCP connection
from source port 30166 to destination port 5060, sends the SIP OPTIONS, and receives a 200
OK, as can be seen in frames 603-610. (These source ports will vary).
Subsequent communications will use these TCP connections. For example, the following
portion of the same trace shows an incoming call from the PSTN to an Avaya IP Telephone. In
frame 2171, the Session Director delivers the INVITE. The ACKs in frames 2176, 2187, and
3611 show that port 8196 is used for the call activity, the same port used for Session Director
sourced OPTIONS in the prior trace. After the call is answered, Communication Manager
begins the process of shuffling the call to ip-direct media paths, with the INVITE in frame
3613. This communication used source port 30166 (see frame 3622), and this is also the same
port used for Communication Manager outbound OPTIONS in the prior trace.
JRR; Reviewed:
SPOC 7/21/2009
64 of 70
CM-PE-NN4500
With this call up, an S8730 Server interchange was requested via the Communication Manager
maintenance Web page. The following portion of the same trace shows the activity before,
during, and after the interchange. In frames 29500 through 32193, the normal Acme Packet
OPTIONS messaging can be seen, still using source port 8196. In frames 35228 and 35229,
Communication Manager sends a TCP FIN, ACK for the two connections that were established.
In frame 36133, Communication Manager (running on the newly active S8730 Server) begins the
process of establishing a new TCP connection to the Session Director, from source port 30383 to
destination port 5060. In frame 36136, this new connection is used to send SIP OPTIONS from
Communication Manager to the Session Director. In frame 36267, the Session Director begins
the process of opening a new TCP connection from source port 8198 to 2.2.87.13 at port 5060
(i.e., to the newly active S8730 Server). In frame 36270, the Session Director sends SIP
OPTIONS using the new connection.
At this point, subsequent SIP signaling will use the two new TCP connections. For example, the
following portion of the same trace shows a successful Hold / Resume sequence for the call that
was established prior to the server interchange. The INVITE in frame 42418 initiates the Hold
messaging, using source port 30383, the same port Communication Manager used to send
OPTIONS immediately after the interchange. The INVITE in frame 43015 initiates the Resume
(un-hold) messaging. When the Session Director sends OPTIONS (frame 43447), it continues to
use port 8198.
JRR; Reviewed:
SPOC 7/21/2009
65 of 70
CM-PE-NN4500
The next screen shows a portion of the same Wireshark trace during the interchange, but using a
different filter, to show TCP communications between a C-LAN session agent (2.2.85.2) and the
Session Director. As seen previously, the interchange took place around frame 35228 and time
stamp 374. The trace below includes messages before and after the interchange. Observe that all
SIP OPTIONS sourced by the Session Director to the C-LAN use source port 8192, which
Wireshark has decoded to spytechphone. This screen is included to contrast the C-LAN based
session agent, for which no new TCP connection was needed as a result of the S8730
interchange, with the S8730 Server session agent, which requires a new TCP connection to be
established to the newly active S8730 Server after the interchange.
The next portion of a new Wireshark trace shows a normal call hang-up by the originating PSTN
user for the call highlighted in this section. Like the OPTIONS messages after the interchange,
the BYE in frame 6481 uses source port 8198. The trace concludes with SIP OPTIONS from
Communication Manager, continuing to use source port 30383.
66 of 70
CM-PE-NN4500
product changes associated with the Avaya modification request were included in Service Pack 1
for Release 5.2. During the testing associated with these Application Notes, it was confirmed
that with Service Pack 1, Communication Manager no longer reveals the private side IP Address
in the ICID of the P-Charging-Vector. That is, using Service Pack 1, it is not necessary for the
Session Director to be configured to delete the P-Charging-Vector.
Section 5.2.4 covers outbound calls made by users at the ESS site, when the system is
fragmented, such that the ESS controls the secondary site, and the active S8730 Server controls
the primary site. In the sample configuration, PSTN calls from secondary site users are directed
to a route pattern that contains local secondary site SIP trunks before primary site SIP trunks.
Therefore, outbound calls from users at the secondary site will succeed, using the SIP trunks at
the secondary site. In an alternate configuration, where calls from secondary site users
controlled by the ESS could be directed to route patterns that contain SIP trunks at the primary
site before SIP trunks at the secondary site, outbound calls can potentially fail. A modification
request was entered, and a fix was delivered to Service Pack 1 for Release 5.2. During the
testing associated with these Application Notes, it was confirmed that with Service Pack 1, this
problem is resolved.
With the generally available Acme Packet Session Director release used for the testing, the
Session Director could respond with a SIP 503 to Communication Manager sourced OPTIONS
messages after certain types of failures. For example, if the Ethernet connectivity to a C-LAN
were removed for a minute, and then re-inserted, Communication Manager would send
OPTIONS to the Acme Packet Net-Net 4500 as part of restoring the SIP signaling group. These
initial SIP OPTIONS from Communication Manager resulted in a 503 response. Despite the
503, the Session Director did mark the session agent in-service, and could deliver calls to
Communication Manager using the restored C-LAN session agent. However, in the absence of
incoming call activity, Communication Manager would consider the corresponding trunks Outof-service/Far-end until an OPTIONS exchange sourced by Communication Manager succeeds.
This generally occurred in approximately 5-7 minutes. An Acme Packet ticket, 18281, was
entered to document the problem. A workspace with a fix was also delivered to Avaya for
testing, which was tested and did resolve the problem. Although not verified, Acme Packet later
informed Avaya that the fix was delivered to generally available release SCX6.1.0 MR-1 Patch 2
(nnSCX610m1p2) for the Net-Net 4500 Session Director.
As described in Section 5.7, Communication Manager SP1 changed the behavior of maintenance
associated with SIP signaling groups, when the ESS is activated. Prior to SP1, SIP signaling
groups controlled by an ESS followed the configuration of the Enable Layer 3 Test field on the
signaling group. That is, if y, OPTIONS messages were used rather than ICMP pings to check
the availability of the far-end of the signaling group. Using SP1, signaling groups controlled by
an ESS use the ICMP ping approach, regardless of the configuration of the Enable Layer 3
Test parameter on the signaling group. A modification request was entered. At time of writing,
reversion to the prior behavior, where the Enable Layer 3 Test configuration is honored by the
active ESS, is targeted for Communication Manager 5.2 SP3 (and Communication Manager
5.2.1). Until that time, a work-around is documented in Section 4.3. Recall that inbound calls
are accepted on a trunk in the OOS/FE state (signaling group in bypass), and an inbound call
JRR; Reviewed:
SPOC 7/21/2009
67 of 70
CM-PE-NN4500
will cause all trunk members to move to an in-service state. A deployment with inbound calls
would keep the trunks controlled by the ESS in-service, even without the work-around.
7. Conclusion
As illustrated in these Application Notes, Communication Manager 5.2 can use the Processor
Ethernet of both an S8730 Server and an ESS as the signaling interface for SIP signaling groups
and trunk groups. Like the C-LAN based SIP trunks documented in reference [JRR], the
Processor Ethernet based SIP trunks can interoperate with Acme Packet Net-Net 4500 as part of
a survivable SIP Trunking solution.
8. Additional References
This section references the documentation relevant to these Application Notes. Avaya product
documentation is available at http://support.avaya.com. Acme Packet product documentation is
available at http://www.acmepacket.com. A support account may be required to access the
Acme Packet documentation.
Reference [JRR] describes the base configuration and verification results for the network used as
the starting point for the configuration illustrated in these Application Notes.
[JRR] Sample Configuration Illustrating Avaya Aura Communication Manager SIP Trunk
Survivability with Enterprise Survivable Server and Acme Packet Net-Net 4500 Session
Director, Issue 1.0
<Paste link here once the Avaya web site posts it>
[JSR] Application Notes for Configuring Direct SIP Trunking from Communication Manager
using an Acme Packet Net-Net Session Director and a SIP PSTN Gateway
http://www.avaya.com/master-usa/en-us/resource/assets/applicationnotes/cm4acmesippstn.pdf
The following Application Notes show two independent sites running Communication Manager
networked via SIP Trunks to a pair of Acme Packet Net-Net 4500 configured in a High
Availability Configuration:
[AC-HA] Application Notes for Configuring Acme Packet Net-Net 4500 Session Director with
Direct SIP Trunking to Avaya Communication Manager, Issue 1.0
http://www.avaya.com/master-usa/enus/resource/assets/applicationnotes/Acme4500CM5DTrk.pdf
[LAR] Sample Configuration for SIP Private Networking and SIP Look-Ahead Routing Using
Avaya Communication Manager, Issue 1.0
http://www.avaya.com/master-usa/en-us/resource/assets/applicationnotes/sip-pvt-lar.pdf
[DPT] Configuring Avaya Communication Manager for Dial-Plan Transparency and InterGateway Alternate Routing, Issue 1.1
http://www.avaya.com/master-usa/en-us/resource/assets/applicationnotes/dpt-igar.pdf
JRR; Reviewed:
SPOC 7/21/2009
68 of 70
CM-PE-NN4500
JRR; Reviewed:
SPOC 7/21/2009
69 of 70
CM-PE-NN4500
Avaya and the Avaya Logo are trademarks of Avaya Inc. All trademarks identified by and
are registered trademarks or trademarks, respectively, of Avaya Inc. All other trademarks are the
property of their respective owners. The information provided in these Application Notes is
subject to change without notice. The configurations, technical data, and recommendations
provided in these Application Notes are believed to be accurate and dependable, but are
presented without express or implied warranty. Users are responsible for their application of any
products specified in these Application Notes.
Please e-mail any questions or comments pertaining to these Application Notes along with the
full title name and filename, located in the lower right corner, directly to the Avaya Solution &
Interoperability Test Lab at interoplabnotes@list.avaya.com.
JRR; Reviewed:
SPOC 7/21/2009
70 of 70
CM-PE-NN4500