009-2003-078 Alarm and Trouble Clearing PDF

ONLINE 7000/9000/11000
TRANSPORT PLATFORM
ALARM AND TROUBLE CLEARING MANUAL

Software Release 6.0
CIENA Part Number: 009-2003-078 Revision A April 30, 2003
CIENA CONFIDENTIAL AND PROPRIETARY
LEGAL NOTICES THIS DOCUMENT CONTAINS CONFIDENTIAL AND TRADE SECRET INFORMATION OF CIENA CORPORATION AND ITS RECEIPT OR POSSESSION DOES NOT CONVEY ANY RIGHTS TO REPRODUCE OR DISCLOSE ITS CONTENTS, OR TO MANUFACTURE, USE, OR SELL ANYTHING THAT IT MAY DESCRIBE. REPRODUCTION, DISCLOSURE, OR USE IN WHOLE OR IN PART WITHOUT THE SPECIFIC WRITTEN AUTHORIZATION OF CIENA CORPORATION IS STRICTLY FORBIDDEN. EVERY EFFORT HAS BEEN MADE TO ENSURE THAT THE INFORMATION IN THIS DOCUMENT IS COMPLETE AND ACCURATE AT THE TIME OF PRINTING; HOWEVER, THE INFORMATION CONTAINED IN THIS DOCUMENT IS SUBJECT TO CHANGE. Copyright 2003 CIENA Corporation Unpublished All Rights Reserved The material contained in this document is also protected by copyright laws of the United States of America and other countries. It may not be reproduced or distributed in any form by any means, altered in any fashion, or stored in a data base or retrieval system, without express written permission of the CIENA Corporation. Required Customer Information Part 15 of the Federal Communications Commission (FCC): Interference CIENA NOTE: Every effort has been made to ensure that this equipment is designed to comply with the limits for a Class A digital device, as described in the FCC Rules. Equipment limitations are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment, if not installed and used properly, and in accordance with guidelines established by CIENA Corporation may cause interference with other communications equipment. Operation of this equipment in a residential environment may cause interference and is the responsibility of the user to correct the interference at his own expense. Security CIENA cannot be responsible for unauthorized use of equipment and will not make allowance or credit for unauthorized use or access. Contacting CIENA Corporate Headquarters Customer Technical Support/Warranty In North America In Europe In Asia Sales and General Information In North America In Europe In Asia Training and Documentation Training Documentation 877-CIENA-TD (243-6283) or 410-694-8120 877-CIENA-TD (243-6283) or 410-694-8125 E-mail: techtng@ciena.com E-mail: techpubs@ciena.com 1-800-CIENA24 (243-6224) 00800 843 52 322 or +44 181 843 52 322 0120-884-766 410-694-5700 410-694-5700 44 207 389 7100 +81-3-3248-4680 E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: north.america.support@ciena.com E-mail: europe.support@ciena.com 410-694-5700 www.ciena.com
ONLINETM7000/9000/11000
PREFACE
PREFACE
The ONLINE 7000/9000/11000 Transport Platform Alarm and Trouble Clearing Manual describes the ONLINE alarm tools that are available from the various ONLINE control applicationsat the graphical craft interface terminal (GCIT), command line interface (CLI), Transaction Language 1 (TL1) messages, and SNMP. This manual is also a resource that explains the basic ONLINE system fault management principles, describes each ONLINE system alarm, and identifies the actions needed to correct the alarm condition. This preface defines the purpose, readership, and organization of the ONLINE Alarm and Trouble Clearing Manual in the following sections:
! ! ! ! ! !
Objectives Audience Content Organization Related Documentation Contacting CIENA System Technical Field Return Information Lab Evaluation and Field Trials
OBJECTIVES
This manual provides overviews of the alarm tools available from all of the ONLINE software application platforms. You can use this manual as a quick resource to decipher the meanings of alarms, and to locate recommended actions to take in response to alarms. This manual supplements the information found in other ONLINE manuals, as listed in the Related Documentationsection of this preface.
AUDIENCE
This manual is intended for network technicians who perform routine maintenance and deal with alarm conditions that arise after the network element (NE) has been installed successfully according to the ONLINE Install, Turn-Up, & Test Manual and has been in operation for some time.
DISCLAIMER
Portions of this document are intended solely as an outline of methodologies to be followed during the maintenance and upgrade of an ONLINE Transport Platform. It is not intended as a step-by-step guide or a complete set of all procedures necessary and sufficient to complete an upgrade. While every effort has been made to ensure that this document is complete and accurate at the time of printing, the information that it contains is subject to change. CIENA is not responsible for any additions to or alterations of the original document. Networks vary widely in their configurations, topologies, and traffic conditions. This document is intended as a general guide only. It has not been tested for all possible applications, and it may not be complete or accurate for some situations. Users of this document are urged to heed warnings interspersed throughout the document, such as traffic disruption warnings.
Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
PREFACE CONTENT ORGANIZATION

This manual contains the following sections:
! ! ! !
ONLINETM7000/9000/11000
CHAPTER 1, FAULT MANAGEMENT CHAPTER 2, USER ALARMS CHAPTER 3, ALARM CLEARING PROCEDURES APPENDIX A, ALARM MESSAGE LIST
RELATED DOCUMENTATION
This manual assumes that the reader is already familiar with the following ONLINE manuals:
!
ONLINE Install, Turn-Up, & Test Manual: Includes instructions for installing and turning up an NE. If your NE has not yet been successfully installed, or has not operated successfully, refer to these guides. Circuit Pack Reference Guide: Contains specific information about each circuit pack (CP) in the NE, including block diagrams and part numbers. OPTX Management Suite Graphical CIT User Guide: Provides the information to provision a node and perform any required maintenance and troubleshooting tasks. ONLINE CLI Reference: Provides details for all currently supported ONLINE system CLI instructions and responses. ONLINE TL1 Reference: Provides details for all currently supported ONLINE system Transaction Language 1 (TL1) instructions and messages. ONLINE SNMP Reference: Provides details about all SNMP MIBs and the SNMP master agent.
COMPLIANCE INFORMATION
Food and Drug Administration (FDA) Laser Safety Warning
This product contains a laser diode. CIENA Corporation strongly recommends that users, maintenance, and service personnel comply with the following standards and regulations in the design, modification, operation, maintenance, an service of lasers and fiber-optic devices:
Jurisdiction Federal, US Federal, US International International International
Type Regulation Guidelines Standard Standard Standard
Title FDA 21 CFR 1040.10/.11 OSHA ANSI Z136 series IEC-825 series EN-60825
It is further recommended that the owner of this equipment determine and ensure conformance with any specific and applicable local regulations.
ii
ONLINETM7000/9000/11000
Class I Laser Product Notice
PREFACE
The CIENA Corporation ONLINE Metro Transport Platform product is a Class 1 Laser product as identified by US FDA/CDRH 21CFR1040.10/.11; Class 1 Laser product as defined by IEC825/EN-60825; and OFCS SG1 as defined by ANSI Z136.1/.2/
Part 15 of the Federal Communications Commission (FCC): Interference

Every effort has been made to ensure that this equipment is designed to comply with the limits for a Class A digital device, as described in the FCC Rules. Equipment limitations are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment, if not installed and used properly, and in accordance with guidelines established by CIENA Corporation may cause interference with other communications equipment. Operations of this equipment in a residential environment may cause interference and is the responsibility of the user to correct the interference at the users own expense.
Environmental Impact Statement

CIENA equipment contains no hazardous materials as defined by the United States Environmental Protection Agency (USEPA). CIENA recommends that all failed product be returned to CIENA for failure analysis and proper disposal.
Toxic Emissions
CIENA equipment releases no toxic emissions.
Telcordia Document Standards

The format and structure of this document is derived from the Telcordia Generic Requirements for SupplierProvided Documentation, GR-454-CORE.
TRADEMARK ACKNOWLEDGEMENTS
! ! !
CIENA is a registered trademark of CIENA Corporation. ONLINE 7000/9000/11000 Transport Platform is a trademark of CIENA Corporation. Windows 95/98/2000 and Windows NT are registered trademarks of the Microsoft Corporation. UNIX is a registered trademark licensed exclusively through X/Open Company, Ltd. Pentium is a registered trademark of Intel Corporation. Sun, Sun Microsystems, JAVA, Java Secure Socket Extension, Solaris, and JAVAX are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. or other countries. This product includes code licensed from RSA Data Security.
! ! !
RELEASE NOTES AND DOCUMENT UPDATES

The hard copy and Compact Disc Read Only Memory (CD-ROM) versions of this document are revised only at major releases and, therefore, may not always contain the latest product information. As needed, Software Release Documents (SRDs), Hardware Release Documents (HRDs), Application Notes, Field Service Bulletins (FSBs), and/or Document Maintenance Bulletins (DMBs) are provided between major releases to describe any new information or document changes.
iii
PREFACE
ONLINETM7000/9000/11000
CONTACTING CIENA SYSTEM TECHNICAL FIELD RETURN INFORMATION
Corporate Headquarters Customer Technical Support/ Warranty In North America In Europe In Asia Sales and General Information In North America In Europe In Asia Training and Documentation Training Documentation
410-694-5700
www.ciena.com
1-800-CIENA24 (2436224) 00800 843 52 322 or +44 181 843 52 322 0120-884-766 410-694-5700 410-694-5700 44 207 389 7100 +81-3-3248-4680
E-mail: north.america.support@ciena.com E-mail: europe.support@ciena.com
E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com
THIS PAGE INTENTIONALLY LEFT BLANK 877-CIENA-TD (243-6283) E-mail: techtng@ciena.com or 410-694-8120 877-CIENA-TD (243-6283) or 410-694-8125 E-mail: techpubs@ciena.com
NOTE:
CIENA retains the sole right to determine if a problem is an emergency or a nonemergency.
Validate Requirements with Customer Support: Customer needs to contact CIENA Worldwide Customer Services and Support to ensure that a replacement product is in fact required. CIENA encourages all Customers to work with its technicians for a reasonable period to determine whether a solution or workaround exists that does not require immediate component replacement. CIENA will not accept any returns for warranty replacement without prior approval and adequate proof of purchase. Warranty Replacement: Customer must furnish a receipt, purchase order, or other standard sales document, or have the specific component serial number on file with CIENA Worldwide Customer Services and Support to determine if a product is under warranty. Warranty Claims: In the event of any warranty claim, Customer must (a) Request a Return Material Authorization (RMA) number from CIENA by calling the appropriate number listed above and (a) Comply with the terms and procedures described in the governing Purchase and License Agreement(s).
iv
ONLINETM7000/9000/11000
Returning CIENA Product: Customer will receive an RMA number after contacting an CIENA Worldwide Customer Services and Support representative. To Prepare Product for Return to CIENA Corporation STEP 1: STEP 2: STEP 3: STEP 4: STEP 5:
PREFACE
Package the product, using the original container, and return it to CIENA Corporation. Write the RMA number on the outside of the box where it can be easily identified, and include any additional information useful in determining the root cause of the failure. Always remember to include Customers name and return address, with a completed return address label always appreciated. Ensure that the product you are shipping complies with all applicable Export Laws for and within the country you are shipping from and to. By shipping the product the customer agrees to comply with all such laws and regulations. Ship the product using a reputable and insured carrier.
LAB EVALUATION AND FIELD TRIALS

In accordance with trial-agreement escalation procedures, any problem encountered during laboratory evaluations and field trials should be referred to the CIENA Corporation field trial coordinator.
PREFACE
ONLINETM7000/9000/11000
THIS PAGE INTENTIONALLY LEFT BLANK
vi
TOC
ONLINETM7000/9000/11000
TABLE OF CONTENTS
TABLE OF CONTENTS
PREFACE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . i LIST OF FIGURES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv LIST OF TABLES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii CHAPTER 1 FAULT MANAGEMENT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Common Alarm Sources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Alarm Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Alarm Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Alarm Detail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2 Alarm Severity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3 Alarm Audio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-4 Alarm Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4 CIT Alarm Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4 CLI Alarm Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-7 TL1 Alarm Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-8 To view alarm severities using TL1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-8 To View All Alarms Using TL1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-9 Autonomous Alarm Messages in TL1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-9 To view user alarms using TL1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-9 CHAPTER 2 USER ALARMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1 User Alarms Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1 User Alarm Dialog Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1 User Alarm Outputs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2 CHAPTER 3 ALARM CLEARING PROCEDURES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 AIS (Alarm Indication Signal) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 Alarm Card Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 BER Test Running . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 Card Provisioning Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2 Communications Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2 Configuration Error . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3 Cooling Fan Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3 Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
vii
TOC
TABLE OF CONTENTS ONLINETM7000/9000/11000
DCC Link Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4 Diagnostics Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4 Diagnostics Failure Component Mgr_Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4 Diagnostics Failure FPGA Program Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 Diagnostics Failure Slot Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 Drive Mount Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 Duplicate SIDs in Subnet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 East Audit Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 East Default K Byte . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 East ENUT Table Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 East Improper APS Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 East Inconsistent APS Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 East Interface Side Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 East Node ID Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7 East Protection Switch Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7 East Ring Map Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7 East Ring Map ID Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7 East Squelch Table Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7 EEPROM Data Error . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8 EEPROM Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8 Ethernet Link A Failure Ethernet Link B Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8 Ethernet Switch Error . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8 Ethernet Switch Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-9 Excessive Data Rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-9 Excessive Input Power (Preamplifiers, Postamplifiers, PMM, or OLM) Excessive Input Power Line (WCI CP) Excessive Input Power Trib (WCI CP) . . . . . . . . . . . . . . . . . . 3-9 For Excessive Input Power Trib: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9 For Excessive Input Power Line: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10 For Excessive Input Power (Pre-amp, Post-amp, VGA): . . . . . . . . . . . . . . . . . . . . . . . 3-10 External Reference Failed SYNC (A/B) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-11 External Reference Locked Out (SYNC A) External Reference Locked Out (SYNC B) . . . 3-11 Fast Start . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-11
viii
TOC
ONLINETM7000/9000/11000 TABLE OF CONTENTS
FPGA Failure, Line FPGA Failure, Trib FPGA Power Failure, Line FPGA Power Failure, Trib . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-11 Forced Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-12 Forced Switch On Line Port Forced Switch On Trib Port . . . . . . . . . . . . . . . . . . . . . . . . . . 3-12 Forced Sync Switch Active . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-12 Free Run . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-12 High Order Path AIS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-12 High Order Path Remote Failure Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-13 High Order Path Trace Identifier Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-13 High Order Path Unequipped . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-13 High Peak Voltage Violation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-13 High Temperature . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-14 Holdover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-14 HUB OSC Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-14 Invalid Data Rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-15 Laser Bias Current Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-15 Laser Bias Current Failure, Line Laser Bias Current Failure, Trib . . . . . . . . . . . . . . . . . . . . 3-15 Laser Wavelength Lock Failure, Line Laser Wavelength Lock Failure, Trib . . . . . . . . . . . . 3-16 Line AIS (ADM, ESCON Mux, or STMX CP), 10GSMX Line AIS Line (WCI CP) Line AIS Trib (WCI CP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16 Line Remote Failure Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-16 Lockout of Protection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-17 Lockout of Protection On Line Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-17 Lockout of Protection On Trib Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-17 Lockout of Working . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-17 Lockout of Working On Line Port Lockout of Working On Trib Port . . . . . . . . . . . . . . . . . . 3-17 Loopback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-18 Loss of Clock (ADM, or STMX CP) Loss of Clock Line (WCI CP) Loss of Clock Trib (WCI CP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-18 Loss of Frame (ADM, ESCON Mux, GRDM, or STMX CP), 10GSMX Loss of Frame Line (WCI CP) Loss of Frame Trib (WCI CP) . . . . . . . . . . . . . . . . . . . . . . . 3-18 Loss of Pointer (ADM, ESCON MUX, Data MUX, STMX) . . . . . . . . . . . . . . . . . . . . . . . . . . 3-19 Loss of Signal (ADM I & II, ESCON MUX I & II, GRDM I & II, STMX, 10G SMX) . . . . . . . . 3-19 Loss of Signal (OSC/OSH) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-19 Loss of Signal on Line Port (WCI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-20
ix
TOC
Loss of Signal on Trib Port (WCI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-20 Loss of Signal (Line Circuit Pack) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-21 Loss of Signal Mux (CWDM-U) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-21 Loss of Signal Demux (CWDM-U) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-22 Loss of Signal OLM Line . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-22 Loss of Signal OSM Line . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-22 Loss of Signal OLM Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-23 Loss of SIgnal OSM Node . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-23 Loss of Signal PMM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-23 Loss of Signal Preamp (Preamp) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-24 Loss of Signal Postamp (Postamp) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-24 Loss of Signal PreVGA (VGA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-25 Loss of Signal PostVGA (VGA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-25 Loss of Signal (SYNC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-26 Loss of Signal WPS - (WPS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-26 Loss Values Out of Range . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-26 Low Peak Voltage Violation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-27 Low System Resource Disk Space . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-27 Low System Resource Handle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-27 Low System Resource Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-27 Manual Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-28 Manual Switch On Line Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-28 Manual Switch On Trib Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-28 Memory Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-28 PSM Database is Down . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-28 Multiplex Section AIS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-28 Multiplex Section Remote Failure Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-29 Node in Hitless State . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-29 Node in Partially Turned Up State . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-29 Node in Selective Restore . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-29 NVRAM Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-30 OCH AIS On Line Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-30 ODPR Protection Unavailable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-30 OOS Diagnostics Performed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-30 Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
TOC
Optical Switch Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-31 OSC4080 Device Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-31 OSPR Protection Unavailable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-31 Out of Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-32 Path AIS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-32 Path Remote Failure Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-33 Path Trace Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-33 Path Unequipped . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-33 Payload Mapping Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-33 Peer Communications Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-34 PMA Is Locked . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-34 Power ACO Card Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-35 Power Entry Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-35 Power Management Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-35 Power Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-36 Processor Busy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-36 Program Memory Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-37 Program Memory Missing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-37 Protection Path Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-37 Provisioning Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-38 Receiver Failure Line Receiver Failure Trib . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-38 Reference Failed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-38 Reference Locked Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-39 Reference Out of Range . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-39 Regenerator Section Trace Identifier Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-39 Replaceable Unit Missing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-39 Replaceable Unit Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-40 Replaceable Unit Type Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-40 Section Trace Mismatch Section Trace Mismatch Line Section Trace Mismatch Trib . . . . 3-40 Shelf ID Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-41 Shelf Interconnect Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-41 Shelf Type Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-41 Signal Degrade BER (ADM, OSC, or STMX CP), 10GSMX Signal Degrade BER Line (WCI CP) Signal Degrade BER Trib (WCI CP) . . . . . . . . . . . . . 3-42
xi
TOC
Signal Fail BER (ADM, OSC, or STMX CP), 10GSMX Signal Fail BER Line (WCI CP) Signal Fail BER Trib (WCI CP) . . . . . . . . . . . . . . . . . . . . . 3-42 Signal Frequency Invalid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-42 Signal Squelched Line Signal Squelched Trib . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-42 Signaling Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-43 Software Download Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-43 Software Environment Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-43 Wrong software loads on the current drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-43 Wrong software loads on the alternate drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-43 Activated on the wrong drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-44 Manual cold reboot required to upgrade FPGA version to most recent . . . . . . . . . . . . 3-44 Load repository corrupt on current drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-44 Load repository corrupt on alternate drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-44 Unable to set software version in EEPROM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-44 Wrong software loads on the alternate flash region . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-44 Synchronization Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-45 Temperature Sensor Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-45 Temperature Out Of Range . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-46 Threshold Crossed LBC Line Threshold Crossed LBC Trib . . . . . . . . . . . . . . . . . . . . . . . . 3-46 Threshold Crossed OPR (Extended OSC, Preamp, Postamp) Threshold Crossed OPR Line, OPR Trib (WCI CP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-46 Threshold NM Crossed Alarms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-47 Topology Discovering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-48 Topology Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-48 Trail Trace Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-50 Transmit Fail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-50 Transmitter Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-50 Transmitter Failure Post VGA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-51 Transmitter Failure Pre VGA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-51 Transmitter Failure Trib Transmitter Failure Line . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-51 Trib Optical Monitoring Not Supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-51 Underlying Resource Unavailable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-52 User Alarms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-52 VOA Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-52 VOA Motor Missing Steps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-52 Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
xii
TOC
VOA Motor Not Stepping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-52 VOA POT Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-53 Wavelength Management Unavailable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-53 West Audit Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-54 West Default K Byte . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-54 West ENUT Table Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-54 West Improper APS Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-55 West Inconsistent APS Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-55 West Interface Side Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-55 West Node ID Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-55 West Protection Switch Failure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-55 West Ring Map Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-56 West Ring Map ID Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-56 West Squelch Table Mismatch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-56 APPENDIX A ALARM MESSAGE LIST . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1 INDEX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I-1
xiii
TOC
xiv
LOF
ONLINE 7000/9000/11000
TM
LIST OF FIGURES
PAGE #
FIGURE #
LIST OF FIGURES
FIGURE NAME
Figure 1-1. Figure 2-1. Figure 2-2.
Viewing Alarm Type Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2 User Alarms Dialog Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2 Enable/Disable User Alarm Outputs Dialog Box . . . . . . . . . . . . . . . . . . . . . . . 2-3
xv
LOF
LIST OF FIGURES ONLINETM7000/9000/11000
xvi
LOT
ONLINETM7000/9000/11000
TABLE #
LIST OF TABLES
LIST OF TABLES
PAGE #
TABLE NAME
Table 1-1. Table 1-2. Table 1-3. Table 3-1. Table 3-2. Table A-1.
Interpreting Alarm Detail Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2 Alarm Severities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3 CIT Alarm Information Categories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5 Corrective Actions for the OSPR Protection Unavailable Alarm . . . . . . . . . . . 3-32 Corrective actions for Wavelength Management Unavailable alarm . . . . . . . . 3-53 List of Alarms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1
xvii
LOT
LIST OF TABLES ONLINETM7000/9000/11000
xviii
ONLINE 7000/9000/11000
TM
FAULT MANAGEMENT
CHAPTER 1 FAULT MANAGEMENT

This chapter includes procedures and guidelines for using the various ONLINE 7000/9000/11000 Transport Platform command tools to prioritize alarm indications, filter alarms, and determine the cause(s) of alarm(s) in the following sections:
! ! !
Common Alarm Sources on page 1-1 Alarm Characteristics on page 1-1 Alarm Tools on page 1-4
COMMON ALARM SOURCES

Alarms typically occur as a result of the following conditions:
! ! ! !
Fiber breaks Equipment failure Software failure Operator error
When isolating the source of an alarm, start by examining if the cause of the alarm may be due to one of the common errors prior to escalating your troubleshooting efforts. You can use the descriptions provided in the alarm logs and reports to assist in isolating the source of alarms.
ALARM CHARACTERISTICS
This section explains the ONLINE system alarm components in the following sections:
! ! !
Alarm Conditions on page 1-1 Alarm Detail on page 1-2 Alarm Severity on page 1-3
ALARM CONDITIONS
Each alarm is categorized in a displayat the graphical craft interface terminal (CIT), command line interface (CLI), Transaction Language 1 (TL1), or SNMP interfacesin accordance with the equipment source from which the alarm is triggered. Although the fundamental range of alarm types is identical regardless of the display platform, the manner in which the alarm types are identified differs in accordance with the application you are using. The CIT presents graphical alarm indicators, which are displayed for all equipment objects, in both the hierarchical tree pane and the graphical pane. You can access information about a selected topology object by using the View -> Alarms and Failures menu from the CIT main menu bar, to display an Alarm and Failure List (Figure 1-1), in which to view the alarm type associated with the selected network object. The illustration also demonstrates a typical display of the alarm type in a CLI message.
1-1
1
FAULT MANAGEMENT ONLINETM7000/9000/11000
CIT Alarm Type View
CLI Alarm Type View
Figure 1-1. Viewing Alarm Type Information
ALARM DETAIL
At the CIT Alarm and Failure List window, you can view a wide range of information about specified alarms in a graphical presentation. The same information is also available in the CLI and TL1 formats.
Table 1-1. Interpreting Alarm Detail Messages Alarm Detail New Affected Object Time Severity Probable Cause Acknowledged Operator Description A black circle indicates a new alarm. If a new alarm is selected, the black changes to white. The alarm location; for example "node57: Facilities: Trib: 3-2-E" Day, date, and time the alarm was raised by the network element (NE). Time stamp will be in GMT. Critical, major, minor, warning, or indeterminate Most likely cause of the alarm, for example, "Loss of Signal." If a checkbox in this column is filled in, the alarm has been acknowledged. The user ID of the operator who acknowledged the alarm.
1-2
ONLINE 7000/9000/11000
TM
FAULT MANAGEMENT
Table 1-1. Interpreting Alarm Detail Messages (Continued) Alarm Detail Type Notes Additional Text Description Equipment alarm, Processing error alarm, Environmental alarm, or Communications alarm. Operator-entered supplemental information (usually, why an alarm was acknowledged). Descriptive text, if any.
ALARM SEVERITY
Alarms are typically corrected in accordance with severity, type, and probable cause. Alarms have the following severities:
! ! ! ! !
Critical (reported as CR in CLI, and *C in TL1) Major (reported as MJ in CLI, and ** in TL1) Minor (reported as MN in CLI, and *^ in TL1) Warning (reported as WN in CLI) Indeterminate
The alarm severity meanings are as described in Table 1-2.
Table 1-2. Alarm Severities Alarm Severity Critical Definition Critical alarms indicate that a severe, service-affecting condition has occurred and that immediate corrective action is imperative, regardless of the time of day or day of the week. Major alarms indicate hardware or software conditions causing a serious disruption of service or the malfunctioning or failure of important circuits. These troubles require the immediate attention and response of a craftsperson to restore or maintain system capability. The urgency is less than in critical situations because of a lesser immediate or impending effect on service or system performance. Minor alarms are used for troubles that do not have a serious effect on service to customers or for troubles in circuits that are not essential to NE operation. For example, a carrier line problem where transmission was switched to a protection line is a minor alarm because it is non-service affecting. Warnings are alarm conditions that do not affect the functioning of the NE. An indeterminate alarm indicates a problem of unknown severity (possibly a multiple failure case) has been detected.
Major
Minor
Warning Indeterminate
The CIT provides color indicators throughout the interface to keep you apprised of current alarm conditions. When enabled, the colors of the topology objects indicate the following conditions: Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
1-3
1
FAULT MANAGEMENT
! ! ! !
ONLINETM7000/9000/11000
GREEN = normal RED = critical alarm ORANGE = major alarm YELLOW = minor, warning, or indeterminate alarm
Alarm Audio
Alarm audio (also known as alarm enunciation), can be configured at the CIT to provide a sound indicator as alarms are detected at the ONLINE NE. For more information, refer to To Use the Audible and Visible alarm alert Tool at the CIT on page 1-6, and the OPTX Management Suite Graphical CIT User Guide (OPN 310).
ALARM TOOLS
The alarm LEDs on the NE shelves and circuit packs (CPs) provide a first glance indication about problems on the ONLINE system. To further examine details about the alarms, you can use the ONLINE command interfaces to gather information to assist in identifying the source of the alarm situation. This section describes the ONLINE system command applications that provide various methods for viewing, modifying, and filtering alarms, in the following sections:
! ! !
CIT Alarm Tools on page 1-4 CLI Alarm Tools on page 1-7 TL1 Alarm Tools on page 1-8
NOTE:
Do not begin removing CPs or connections until you have examined the alarm detail at the CIT, or other ONLINE interface.
CIT Alarm Tools

The CIT provides a graphical user interface (GUI) with which to view, delete, and monitor both ONLINE system alarms and user alarms. System alarms are associated with various severities of malfunctioning equipment, service, transmission paths, or software. User alarms are associated with possibly unacceptable conditions that arise in the site environment in which the system is located.
NOTE:
The description in this section does not contain screen captures of the CIT GUI alarm management tools. To see the GUI components, please refer to the OPTX Graphical CIT User Guide (OPN 310)
The CIT GUI tools that are used for troubleshooting faults within the ONLINE network are accessed from the alarm menus (either from the CIT main menu bar or as popup menus derived from selected network topology objects). The alarm menus provide options to generate alarm reports, acknowledge and unacknowledge alarms, delete alarm(s), and view alarm details.
1-4
ONLINE 7000/9000/11000
TM
FAULT MANAGEMENT
TO VIEW ALL ALARMS AT THE CIT Use the Fault-View Alarms and Failures menu to present the Subnetwork Alarm and Failure List window. The information in this window describes alarm associations to NEs, time, severity, causes, and actions performed in response to the alarm indications (Table 1-3).
Table 1-3. CIT Alarm Information Categories Column Label Affected Time Severity Description Identifier of the ONLINE NE affected by the alarm. Hour, minute, and second of the alarm occurrence. Level of severity as either critical (red), major (orange), minor (yellow), warning (yellow), or indeterminate (yellow). Condition detected by the ONLINE system that triggered the alarm. Checkbox that indicates whether or not the alarm has been acknowledged. If checked, the alarm has been acknowledged. If not checked, the alarm has not been acknowledged. User ID of the operator who acknowledged the alarm. Alarm type, as either equipment, processing error, environmental, or communications. Supplemental information provided by the operator, which may include information about why the alarm was acknowledged, or contain plan detail for rectifying the alarm condition. Additional text area in which to provide information about the alarm. Checkbox that indicates that the alarm has been fixed and/or is no longer considered an alarm condition. When checked, the alarm is cleared. When not checked, the alarm is not yet cleared. Cleared alarms are not removed from the alarm list until deleted.
Probable Cause Acknowledge
Operator Type Notes
Addition Cleared
TO VIEW SEVERITY-SPECIFIC ALARMS AT THE CIT The columns and column entries in the Alarm and Failure List window can be sorted to customize the arrangement of the columns. You can use the single-sorting mechanism to organize alarms by criticality (as well as by other criteria). You can also show, hide, and reorder the alarm columns to customize the view in accordance with your filtering preferences. To find out how to use the Select Sort Columns and Column Options menu at the CIT, see the OPTX Graphical CIT User Guide (OPN 310).
1-5
1
FAULT MANAGEMENT
TO DELETE ALARMS AT THE CIT At the CIT, use the tools provided in the Alarm Retirement Setup dialog box, or the Fault-Delete Cleared Alarms menu, or the Alarm and Failure Report view to remove specified alarms.
!
ONLINETM7000/9000/11000
The Alarm Retirement Setup dialog box allows you to instruct the ONLINE system to automatically delete alarms that are cleared and acknowledged. Using the Fault-Delete menu enables you to select and confirm removal of specified alarms. Right-clicking on a selected row in the Alarm and Failure Report view presents a popup menu from which you can delete selected alarms.
! !
To view the CIT GUI elements associated with these tasks, please refer to the OPTX Graphical CIT User Guide (OPN 310). TO VIEW THE ALARM HISTORY LOG AT THE CIT Use the alarm report functions in the CIT to view alarm history logs. The various report types are accessed by clicking anywhere on the heading row of the Subnetwork Alarm and Failure List, or by using the Fault menu from the CIT main menu. Alarm reports are categorized as follows:
!
Custom Alarm Report (HTML)
Use the Custom Alarm Report (HTML) option if you want to view filtered and/or sorted alarm detail in a web browser window. The view presented in this custom report is based on your customization of the alarm list details (as described in To view severity-specific alarms at the CIT on page 1-5).
!
Custom Alarm Report (CSV)
Use the Custom Alarm Report (CSV) option if you want to write the filtered and/or sorted alarm report as an Excel file to a specified location.
!
Complete Alarm Report (HTML)
Use the Complete Alarm Report (HTML) option if you want to view all, unfiltered alarm detail in a web browser window. The view presented in this custom report is based on your customization of the alarm list details.
!
Complete Alarm Report (CSV)
Use the Complete Alarm Report (CSV) option if you want to write all alarm detail reported to the CIT as an Excel file to a specified location. TO USE THE AUDIBLE AND VISIBLE ALARM ALERT TOOL AT THE CIT At the CIT, present the Audible and Visible Alerts dialog box; available from Fault-Alerts option from the CIT main menu. This dialog box enables activation and deactivation of the audible and visible alerts at the local workstation. You can filter the alerts by specifying the severity level to be associated with the alerts, and whether or not you want to view alerts only, hear sound only, or use both alert mechanisms. Activating visible result in display of a message box that contains information associated with the alarm. To view the CIT GUI elements associated with these tasks, please refer to the OPTX Graphical CIT User Guide (OPN 310).
1-6
ONLINE 7000/9000/11000
TM
FAULT MANAGEMENT
CLI Alarm Tools

The CLI commands that are used for troubleshooting faults within the ONLINE network are show alarm and show log.
NOTE:
The CLI also includes the unlock alarm command, which is used only to take the alarm card out of the administrative service state.
TO VIEW ALL ALARMS USING THE CLI Use the show alarm command to view active alarms on the NE. This command is resource level sensitive; meaning the alarm information displayed is limited in scope to the level set by the resource command. Example: View unfiltered list of all current alarms MyNode> show alarm Alarms for node: MyNode Identifier Status Type Date Time-UTC Probable Cause ---------------------------------------------------------------------OT-E WN comm 08/09/00 17:47:36 thresholdCrossedOPR OT-W WN comm 08/09/00 17:47:13 thresholdCrossedOPR OCH-6-1-W CR comm 08/09/00 17:48:33 lossOfFrameTrib OCH-6-1-W CR comm 08/09/00 17:49:24 lossOfFrameLine OCH-6-1-W WN comm 08/09/00 17:47:05 thresholdCrossedOPRLine OCH-8-3-W WN comm 08/09/00 17:47:21 thresholdCrossedOPRTrib OCH-3-2-E CR comm 08/09/00 17:48:45 lossOfFrameLine OCH-3-2-E CR comm 08/09/00 17:48:45 aISTrib TO VIEW SEVERITY-SPECIFIC ALARMS USING THE CLI Example: An instruction to the NE to issue a list of all critical alarms. MyNode> show alarm critical Alarms for node: MyNode Identifier Status Type Date Time-UTC Probable Cause ------------------------------------------------------------------OCH-6-1-W CR comm 08/09/00 17:48:33 lossOfFrameTrib OCH-6-1-W CR comm 08/09/00 17:49:24 lossOfFrameLine OCH-3-2-E CR comm 08/09/00 17:48:45 lossOfFrameLine OCH-3-2-E CR comm 08/09/00 17:48:45 aISTrib MyNode>
1-7
1
FAULT MANAGEMENT
TO VIEW THE ALARM HISTORY LOG USING THE CLI Use the show log command to view alarm log entries for a specified NE. This command is resource level sensitive; meaning the alarm information displayed is limited in scope to the level set by the resource command. Example: Viewing an alarm log filtered to show alarm severity as well as time period. MyNode> show log critical 2000/8/9/17/45 2000/8/9/17/50 Alarm Log for node: MyNode No. Date Time-UTC Identifier Status Type Probable Cause ---------------------------------------------------------------------1 08/09/00 17:46:11 rtp_node2 CR proccess powerManagementProblem 2 08/09/00 17:47:33 OCH-8-3-W CR comm lossOfSignalLine 3 08/09/00 17:47:32 OCH-3-2-E CR comm lossOfSignalLine 4 08/09/00 17:47:32 OCH-3-2-E CR comm lossOfSignalTrib 5 08/09/00 17:48:28 rtp_node2 CR proccess powerManagementProblem 6 08/09/00 17:48:37 OT-E CR comm lossOfSignalPostamp 7 08/09/00 17:48:42 OCH-3-2-E CR comm lossOfFrameTrib 8 08/09/00 17:48:41 OCH-8-3-W CR comm lossOfFrameLine 9 08/09/00 17:47:04 OCH-6-1-W CR comm lossOfSignalTrib 10 08/09/00 17:47:04 OCH-6-1-W CR comm lossOfSignalLine 11 08/09/00 17:48:33 OCH-6-1-W CR comm lossOfFrameTrib 12 08/09/00 17:48:38 OCH-8-3-W CR comm lossOfFrameTrib 13 08/09/00 17:48:52 OCH-6-1-W CR comm lossOfFrameLine 14 08/09/00 17:49:24 OCH-6-1-W CR comm lossOfFrameLine 15 08/09/00 17:48:45 OCH-3-2-E CR comm lossOfFrameLine 16 08/09/00 17:48:45 OCH-3-2-E CR comm aISTrib 17 08/09/00 17:49:11 OCH-6-1-W CR comm signalFailBER 18 08/09/00 17:47:20 OCH-8-3-W CR comm lossOfSignalTrib MyNode>
ONLINETM7000/9000/11000
TL1 ALARM TOOLS

To view alarm severities using TL1
! ! ! !
*C = Critical ** = Major *^ = Minor A^ = Clear
The almcde in TL1 indicates the severity of the autonomous messages. Where multiple alarms are reported in the same message, the displayed alarm code is the most severe.
1-8
ONLINE 7000/9000/11000
TM
FAULT MANAGEMENT
To View All Alarms Using TL1

Use the RTRV-ALM command to instruct the NE to retrieve and send the current status of its alarm conditions associated with one or more equipment units, facilities, subscriber lines, trunks, links, packet links, signaling links, or test access within the NE. The command may be used to retrieve NE information, which in turn may be used to update an OS database when it is suspected that autonomous alarm messages issued by the NE using REPORT ALARM were not received or properly processed. It may also be used to evaluate the system before or after NE maintenance operations. The alarm conditions to be retrieved can be specified by using the input parameters as the filter. Existing conditions satisfying all the specified input parameters will be reported in the message response. Environmental alarms are not received with the RTRV-ALM-ALL command, rather the RTRV-ALM-ENV command is used.
Autonomous Alarm Messages in TL1

The REPT ALM TL1 message function reports the occurrence of alarmed events. Trouble events occurring in the NE are classified as alarmed or non-alarmed events. In general, an alarmed event causes a standing condition and has immediate or potential impact on the operation or performance of the entity. Some form of maintenance effort is required to restore normal operation or performance of the entity after the event has occurred.
To view user alarms using TL1

RTRV-ALM-ENV requests that an NE or office environment monitor retrieve specified, outstanding environmental alarms. The command can be used to retrieve NE information, which in turn may be used to update an OS environmental alarm database, if it is suspected that autonomous alarm messages issued using REPORT ALARM ENVIRONMENT were not received or properly processed.
NOTE:
For more information on TL1 refer to the ONLINE TL1 Reference (OPN 303).
1-9
1
FAULT MANAGEMENT ONLINETM7000/9000/11000
1 - 10
ONLINE 7000/9000/11000
TM
USER ALARMS
CHAPTER 2 USER ALARMS

This chapter describes the User Alarms feature, in the following sections:
! ! !
User Alarms Description on page 2-1 User Alarm Dialog Box on page 2-1 User Alarm Outputs on page 2-2
USER ALARMS DESCRIPTION

The Alarm I/O card has detectors to receive inputs from customer equipment that raise user alarms. Besides the systems pre-defined probable causes, there are eight user alarm probable causes (User Alarm 1 through User Alarm 8) in systems with a Vertical 19" (19V) or Vertical 23" (23V) main shelf, and 12 User Alarm Probable Causes (User Alarm 1 through User Alarm 12) in systems with a 23" (23) main shelf. The user alarms represent alarms raised outside of the network element (NE), for example a fire alarm, power surge, flooding, air conditioning or fan failure, or similar condition. Since these user alarms may severely affect the proper working condition of the system, the detected failure is passed to the NE, and can be raised as a system failure alarm. Users can decide whether to raise a user alarm against the NE or not by assigning the alarm severity value as follows:
!
If the severity value is notReported, the NEs alarm LEDs will not be lit, the user alarm is not counted, and the user alarm event will be not sent to CIT/EMS. However, the user alarm will be added to the NEs current problem list. If the severity value is warning, the NEs alarm LEDs will be not lit, the user alarm is not counted; but the user alarm event will be sent to CIT/EMS, and it will be added to the NEs current problem list. If the severity value is minor or higher, the NEs alarm LEDs will be lit, the user alarm is counted, the user alarm event will be sent to CIT/NM, and it will be added to the NEs current problem list.
USER ALARM DIALOG BOX

The User Alarm dialog box is used for defining the additional text associated with each user alarm. A meaningful description should be entered for each of the user alarms. STEP 1: In the CIT select an NE object from the tree and select FaultUser Alarms. The User Alarms Dialog box appears, as shown in Figure 2-1. This dialog box shows the list of User Alarms and the corresponding Additional Text. STEP 2: STEP 3: To edit a user alarm, click in the Additional Text field and enter the description. When you are have completed your entries, click OK.
2-1
2
USER ALARMS ONLINETM7000/9000/11000
Figure 2-1. User Alarms Dialog Box
USER ALARM OUTPUTS

This dialog box is used to operate the remote control (contact closures) for the audible and visible outputs. Select FaultUser Alarm Outputs. The Enable/Disable User Alarm Outputs dialog box appears, as shown in Figure 2-2. A check in the Enabled column indicates that a particular alarms outputs are enabled. If there is no check, the alarms outputs are disabled. To enable or disable a User Alarms outputs, check or uncheck the checkbox in the Enabled field for that alarm. When you are done enabling or disabling the User Alarms outputs, click OK.
2-2
ONLINE 7000/9000/11000
TM
USER ALARMS
Figure 2-2. Enable/Disable User Alarm Outputs Dialog Box
2-3
2
USER ALARMS ONLINETM7000/9000/11000
2-4
ONLINE 7000/9000/11000
TM
ALARM CLEARING PROCEDURES
CHAPTER 3 ALARM CLEARING PROCEDURES

These procedures identify the actions needed to correct the alarm conditions. Before replacing any circuit pack (CP), be sure to check the connections and label them clearly, so that they can be reconnected in the proper positions easily. Communications alarms caused by equipment failure within the node should be accompanied by related equipment alarms. If so, correcting the equipment problem should resolve both the equipment and the communications alarms. Therefore, deal with equipment alarms first. Communications alarms without equipment alarms can indicate a problem elsewhere in the network (outside the node), or a problem with one or more of the fibers in the node.
NOTE:
Alarms are listed alphabetically in this section by Probable Cause.
AIS (ALARM INDICATION SIGNAL)

Explanation The Sync CP receives a clock source input directly from BITS or indirectly through a daisy chain configuration. This alarm indicates that there is a fault condition upstream for the clock source of the Sync CP. Affected Object Alarm Type Default Severity Recommended Action External Sync reference object Communications Major A possible fault condition could be an LOS or OOF alarm in the BITS source itself, or one of the Sync CPs in the middle.
ALARM CARD FAILURE

Explanation Indicates that the alarm card is either missing or has suffered a hardware failure. Affected Object Alarm Type Default Severity Recommended Action Shelf Environmental Minor If the Alarm Card is missing, install it. If the Alarm Card is present, reset it by removing and reinserting it. If this does not clear the alarm, replace the alarm card.
BER TEST RUNNING

Explanation This alarm is raised when the BER test starts and cleared when the BER test ends. Affected Object Alarm Type Default Severity Recommended Action GRDM Circuit Pack Equipment Alarm Warning None.
3-1
3
ALARM CLEARING PROCEDURES CARD PROVISIONING MISMATCH
Explanation Provisioning in the circuit pack does not match the information stored in the PEM. Affected Object Alarm Type Default Severity Recommended Action Circuit Pack Equipment Alarm Minor Reboot the circuit pack using the Warm Reboot With Provisioning Re sync option. If the alarm is raised again once the circuit pack recovers from the warm reboot, then contact CIENA Worldwide Customer Services and Support.
ONLINETM7000/9000/11000
COMMUNICATIONS FAILURE
Explanation This alarm will be raised by OPTX Management Suite GCIT or OPTX NM when a node is not reachable. The additional text is: Primary/GNE/ww.xx.yy.zz unreachable Affected Object Alarm Type Default Severity Recommended Action GNE Communication Major Verify if the OPTX NM Client or OPTX GCIT has valid data communications connectivity to the subnetwork by pinging the GNE or establishing a connection via an alternate interface such as the Command Line Interface (CLI) or TL1. If connectivity is valid, the PEM at the GNE may have rebooted, so allow up to 5 minutes for the GNE to recover and for communications to restore. If this alarm persists, contact CIENA Worldwide Customer Services and Support.
Explanation This alarm will be raised by OPTX Management Suite GCIT or OPTX NM when a node is not reachable The additional text is: Network element (id=x) is unreachable Affected Object Alarm Type Default Severity Recommended Action NE Communication Critical If the GNE is affected, then see the recommended actions above. If a remote NE is affected, there may be various reasons for the communications loss, including a PEM reboot, line fiber break, or other connectivity issues which may be denoted by additional alarms. If this alarm persists for more than 5 minutes, then contact CIENA Worldwide Customer Services and Support.
3-2
ONLINE 7000/9000/11000
TM
Explanation The PEM cannot communicate to the affected circuit pack over either Ethernet link. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Minor This alarm may denote that the affected circuit pack is rebooting and will clear when the circuit pack recovers. If the alarm persists, then there may be a failure on the the circuit pack requiring it to be replaced. Typically, the affected circuit pack should not be reseated as it may still be functioning properly but will fail to recover to an operational state if the communications failure condition persists. If the CP LED is solid red, replace the circuit pack. Otherwise, contact CIENA Worldwide Customer Services and Support. If this alarm is raised against multiple circuit packs, it is often due to some other condition that will typically be denoted by one or more additional alarms such as Ethernet Switch Failure, Shelf Interconnect Failure, or Node in Hitless State. Investigate the other alarms and contact CIENA Worldwide Customer Services and Support as needed.
CONFIGURATION ERROR
Explanation This alarm is raised when the NE restarts with a new database (i.e. after restoring an NE from a backup file or performing hitless database recovery) and there is a provisioned circuit with unprovisioned supporting equipment. The additional text is: Equipment not available to support circuit Affected Object Alarm Type Default Severity Recommended Action Network element Environmental Critical Provision the equipment that supports the existing circuit.
COOLING FAN FAILURE

Explanation This alarm indicates that the cooling fan is not functioning. The lack of a functioning cooling fan can cause a High Temperature alarm in the CPs, which has a default priority of Critical. For the 23" shelf (23") the default severity is major if fans A and B both fail. Affected Object Alarm Type Default Severity Recommended Action Shelf Environmental Minor/Major Check the cooling fan. If it is not working, remove the unit and replace it.
3-3
3
ALARM CLEARING PROCEDURES DCC LINK FAILURE
Explanation This alarm will be raised if DCC is configured but there is a problem with the communication. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Verify DCC is configured on the remote circuit pack and the circuit pack is up. If the remote circuit pack is provisioned correctly with DCC, then verify the fibers are physically connected properly. Also, ensure the fibers are fully seated in their respective bulkhead connectors and have proper signal.
ONLINETM7000/9000/11000
DIAGNOSTICS FAILURE
Explanation Diagnostics are run in the background by the system software once a circuit pack recovers from a restart. It then runs periodically every 15 minutes. Diagnostics can also be manually invoked by the user. A failure of a diagnostic test results in Diagnostics Failure alarm and will clear if the failing diagnostic subsequently passes. Affected Object Alarm Type Default Severity Circuit pack Equipment Warning
diagnosticsFailureEEPromTest diagnosticsFailureSpiBusTest diagnosticsFailureHDLCTests diagnosticsFailureEthernetCpm0 diagnosticsFailureEthernetCpm1 diagnosticsFailure48VbusA diagnosticsFailure48VbusB diagnosticsFailureDevice3270_3110 diagnosticsFailureDeviceParallel diagnosticsFailureDeviceDio diagnosticsFailureOscMRV diagnosticsFailureDeviceSigFpga diagnosticsFailureDeviceGrdmEpld diagnosticsFailureDevicePM5347
diagnosticsFailureDeviceEEProm diagnosticsFailureDeviceSwitch diagnosticsFailureDeviceEDFA diagnosticsFailureDeviceGrdmPhy diagnosticsFailureDeviceLM81 diagnosticsFailureDeviceLED diagnosticsFailureDevice4080 diagnosticsFailureDeviceI2c diagnosticsFailureDeviceCommonLed diagnosticsFailureADCLoopbackTest diagnosticsFailureDeviceGrdmYukon diagnosticsFailureDeviceDACad8412 diagnosticsFailureDeviceADClm12458
DIAGNOSTICS FAILURE COMPONENT MGR_TEST

Explanation This alarm is raised when the microboot file version in the circuit pack is incorrect. Affected Object Alarm Type Default Severity Recommended Action Circuit pack Equipment Warning Warm reboot the circuit pack. If the alarm does not clear, then call CIENA Worldwide Customer Services and Support.
3-4
ONLINE 7000/9000/11000
TM
DIAGNOSTICS FAILURE FPGA PROGRAM FAILURE

Explanation This alarm is raised when there has been a failure to program the FPGA. Affected Object Alarm Type Default Severity Recommended Action Circuit pack Equipment Major Cold reboot the circuit pack to make a second attempt to program the FPGA. If the alarm persists after the cold reboot, then call CIENA Worldwide Customer Services and Support to obtain a Return Material Authorization (RMA) for the circuit pack.
DIAGNOSTICS FAILURE SLOT MISMATCH

Explanation This alarm is raised when the slot ID obtained from the backplane does not match the provisioned slot of the circuit pack. Affected Object Alarm Type Default Severity Recommended Action Circuit pack/Chassis Backplane Equipment Critical Call CIENA Worldwide Customer Services and Support.
DRIVE MOUNT FAILURE

Explanation This alarm indicates that the PEM is not able to mount the C: drive or D: drive of the PSM. Affected Object Alarm Type Default Severity Recommended Action PSM circuit pack Equipment Minor Reboot or replace the PSM circuit pack.
DUPLICATE SIDS IN SUBNET

Explanation The user set the SID table entry, and entered duplicate SID values for two different nodes. Affected Object Alarm Type Default Severity Recommended Action Network element Processing error Major Correct the SID table entry.
EAST AUDIT FAILURE

Explanation This alarm is raised when the audit engine in the ADM circuit pack is not able to communicate with its east neighbor. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Verify continuity to the east neighbor.
3-5
3
ALARM CLEARING PROCEDURES EAST DEFAULT K BYTE
Explanation This alarm is raised when the east side of the ADM pair has received a default K byte in three consecutive frames. A default K byte is an indication of a misconfigured node. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major Verify continuity and node protection provisioning and make adjustments as necessary to clear the alarm.
ONLINETM7000/9000/11000
EAST ENUT TABLE MISMATCH

Explanation This alarm is raised when the audit engine in the ADM circuit pack detects a mismatch of the ENUT table with the east neighbor. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Compare and verify the ENUT tables on both nodes.
EAST IMPROPER APS CODE

Explanation This alarm is raised when the east side of the ADM pair has received APS code which is not consistent with the state of the receiving node. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major
EAST INCONSISTENT APS CODE

Explanation This alarm is raised when the east side of the ADM pair is observing that out of 12 frames, no three frames contain identical APS code. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major
EAST INTERFACE SIDE MISMATCH

Explanation This alarm is raised when the audit engine of the ADM circuit pack is provisioned to the same interfaceSide as the east neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major When provisioning the SONET BLSR protection, the user must identify the west and east side of the ADM pair of ports involved in the protection. Verify the west and east side is provisioned correctly on both nodes and verify fiber connections. Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
3-6
ONLINE 7000/9000/11000
TM
EAST NODE ID MISMATCH

Explanation This alarm is raised when the east side of the ADM pair has received three consecutive and identical frames that contain a source node ID that does not match any entry in the ring map. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major Verify the node ID and ring map provisioning to resolve any inconsistencies.
EAST PROTECTION SWITCH FAILURE

Explanation This alarm is raised by the BLSR switch engine when an attempt to switch had failed. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major This alarm will clear when the switching condition does not exist any longer or the switching was completed.
EAST RING MAP MISMATCH

Explanation This alarm is raised when the audit engine of the ADM circuit pack detects its ring map is different from its east neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Compare the local and east neighbors ring map to identify any inconsistencies.
EAST RING MAP ID MISMATCH

Explanation This alarm is raised when the audit engine of the ADM circuit pack detects an ID from its east neighbor which does not match the ring map. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major The additional text field for the alarm will indicated the neighbors ring map ID. Use this information to correct the ring map inconsistencies.
EAST SQUELCH TABLE MISMATCH

Explanation This alarm is raised by the audit engine of the ADM circuit pack when its squelch table id different from its east neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Verify squelch tables from the local node and east neighbor. The additional text field associated with the alarm will indicate the first timeslot where the mismatches start.
3-7
3
ALARM CLEARING PROCEDURES EEPROM DATA ERROR
Explanation Indicates an error with the EEPROM in the circuit pack. Affected Object Alarm Type Default Severity Recommended Action CWDM-U, OLM, OSM, PMM Equipment Critical Call CIENA Worldwide Customer Services and Support for assistance.
ONLINETM7000/9000/11000
EEPROM PROBLEM
Explanation Raised by an internal audit when some EEPROM fields are invalid. Additional text will indicate the invalid field. This alarm is not service affecting. Affected Object Alarm Type Default Severity Recommended Action Network Element Equipment Minor Call CIENA Worldwide Customer Services and Support for assistance.
ETHERNET LINK A FAILURE ETHERNET LINK B FAILURE

Explanation These alarms are raised when one of the OSC or COM cards (COM/OSC-East for link A, COM/OSC-West for link B) cannot communicate to a Transport Section CP. The alarm is raised against the other card (not against the OSC that detected the failure). It is most likely that the failure is on the CP against which the alarm is raised, but there is also a possibility that the failure is on the OSC/COM. A single alarm of this type would almost certainly indicate that the problem is not on the OSC/COM, while multiple alarms might indicate that the OSC/COM has failed. Affected Object Alarm Type Default Severity Recommended Action OSC CP or COM CP, or CP Equipment Minor Restart or replace the failed CP.
ETHERNET SWITCH ERROR

Explanation Indicates a problem communicating between the OSC/COM and the affected slots specified via the additional text field. The ethernet backplane is redundant, so unless both OSC/COMs have problems communicating with the same slot, functionality should not be affected - however, the efficiency of message delivery is not optimal. The alarm is raised if the problem persists for 2.5 minutes, and is cleared if the problem does not exist for the same amount of time. Affected Object Alarm Type Default Severity Recommended Action OSC CP or COM CP Equipment Minor This alarm is the result of a hardware problem. If the alarm condition persists, either the circuit pack in the affected slot or the indicated OSC/COM circuit pack is faulty and should be replaced. Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
3-8
ONLINE 7000/9000/11000
TM
ETHERNET SWITCH FAILURE

Explanation Indicates an Ethernet switch hardware failure on the OSC or COM CPs due to Ethernet switch errors on two or more ports. Affected Object Alarm Type Default Severity Recommended Action OSC CP or COM CP Equipment Major Restart or replace the failed circuit pack.
EXCESSIVE DATA RATE

Explanation This alarm is raised when the payload is autolock or autolockrate, and the signal data rate on the facility supported by the WCI CP exceeds the provisioned, allowed ceiling rate. The additional text is: Current Bit Data Rate: Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Trib Communications Critical All-Rate WCI CPs Ensure that the signal data rate on the facility does not exceed the provisioned maximum.
EXCESSIVE INPUT POWER (PREAMPLIFIERS, POSTAMPLIFIERS, PMM, OR OLM) EXCESSIVE INPUT POWER LINE (WCI CP) EXCESSIVE INPUT POWER TRIB (WCI CP)
Affected Object Alarm Type Default Severity Associated Equipment Explanation Facilities: Line or Trib, CP Communications (for WCI); Equipment (for Preamp, Postamp) Critical (for WCI); Major (for Preamp, Postamp) WCI, Pre-Amp, Post-Amp, VGA
For Excessive Input Power Trib:

Indicates the optical tributary receive power for the WCI port has exceeded the specified receiver overload power level. Consult the System Description Manual for the appropriate optical specification for tributary overload. For a WCI tributary port, the cause of this alarm is insufficient padding of the optical receive signal into the affected tributary port. In rare cases, it can be due to a circuit pack defect causing the optical receive power to be incorrectly measured. Recommended Action Measure the optical tributary receive power within an Optical Power Meter (OPM) to confirm the power level and then pad the receive signal appropriately per the optical specification. Replace the circuit pack if the measured value significantly mismatches the value reported in the alarms additional text.
3-9
3
For Excessive Input Power Line:
Indicates the optical line receive power for the WCI port has exceeded the receiver overload power level. WCI line receivers are normally padded during subnetwork turn-up using values recommended by OPTX Network Designer. These pad values are sufficient assuming there have not been any decreases to the physical span losses within the sub-network. If span losses have changed, then the sub-network may need to be re-optimized by using OPTX Network Designer to validate the latest span loss values, potentially requiring changes to line receiver and other pads within the sub-network. In rare cases, this alarm can occur in response to transient changes in optical power levels or can be due to a circuit pack defect causing the optical receive power to be incorrectly measured. Recommended Action Measure the optical line receive power with an Optical Power Meter (OPM) and replace the circuit pack if the measurements significantly mismatches the value given in the alarm additional text. Contact CIENA Worldwide Customer Services and Support for further assistance.
ONLINETM7000/9000/11000
For Excessive Input Power (Pre-amp, Post-amp, VGA):

Indicates the optical receive power for the NODE input of the amplifier is exceeding the specified maximum value. This may saturate the amplifier and begin to impact the gain provided, potentially leading to a gain failure (see Transmitter Failure alarm). This alarm is typically not the result of a physical problem with the amplifier circuit pack, but is due to excessive optical input power at some point within the subnetwork upstream from the amplifier's input. In some cases, this alarm can result if the subnetwork is improperly fibered or provisioned versus the intended design. For example, if an NE is provisioned as PMA optimized but is not designed/padded appropriately, this alarm may result. In other cases, the alarm can be raised when the optical input power nominally exceeds the alarm threshold and has no true optical impact. Often, this alarm may occur when a circuit is initially unlocked and the alarm threshold is nominally exceeded while the related VOAs along the optical path are still adjusting. In this scenario, the alarm may not clear on it's own as the alarm threshold has hysteresis. It can be cleared by warm rebooting the affected amplifier if the input power level is no longer in excess of the alarm raise threshold but has not decreased below the alarm clearing threshold. There is no immediate damage occurring to the amplifier when this alarm is present. A gain failure as denoted by a Transmitter Failure alarm would have to persist for many months before any degradation to the device's expected lifetime begins to occur. Recommended Action Warm reboot the affected amplifier to see if the alarm clears. If it does not, investigate further for the cause of the excessive optical power. Contact CIENA Worldwide Customer Services and Support if further assistance is required. Facilities Communications Major (PMM), Critical (OLM facility) PMM, OLM CPs
Affected Object Alarm Type Default Severity Associated Equipment
Explanation This alarm is raised if the VOA was stepped to its max attenuation but the output power read at the pin is still higher than the target power while the VOA is in closed loop mode. Recommended Action Correct the input power level.
3 - 10
ONLINE 7000/9000/11000
TM
EXTERNAL REFERENCE FAILED SYNC (A/B)

Explanation This alarm is raised when the internal SYNC circuit pack clock has failed. Affected Object Alarm Type Default Severity Recommended Action Synchonization Source Information Object Communication Major Replace the SYNC circuit pack.
EXTERNAL REFERENCE LOCKED OUT (SYNC A) EXTERNAL REFERENCE LOCKED OUT (SYNC B)
Explanation This alarm indicates that external reference A or B has been locked out. Locking out a synchronization reference prevents it from being selected as the active synchronization source. This alarm is not service affecting. Affected Object Alarm Type Default Severity Recommended Action Synchronization Source Information Object Communication Warning The alarm will clear when the lockout is cleared.
FAST START
Explanation The clock is in Fast Start mode. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action CP Equipment Warning Sonet Thin Mux (STMX) CP or Sonet Add/Drop Mux (SADM) CP Not applicable.
FPGA FAILURE, LINE FPGA FAILURE, TRIB FPGA POWER FAILURE, LINE FPGA POWER FAILURE, TRIB
Explanation FPGA failure on the WCI CP. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action CP Equipment Critical WCI CP. Replace the WCI CP.
3 - 11
3
ALARM CLEARING PROCEDURES FORCED SWITCH
Explanation Indicates that an administrative switch request is in effect. This alarm is not service affecting. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line (OSPR protection); Facilities: Trib (ODPR protection) Processing Error Warning None.
ONLINETM7000/9000/11000
FORCED SWITCH ON LINE PORT FORCED SWITCH ON TRIB PORT

Explanation This alarm is raised whenever a SwitchRequest is received on the ADM circuit pack. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Warning None
FORCED SYNC SWITCH ACTIVE

Explanation This alarm is raised when a SYNC source is in a forced switched state. This alarm is not service affecting. Affected Object Alarm Type Default Severity Recommended Action Synchronization Source Information Object Communication Warning The alarm will clear when the forced switch is removed from the synchronization source.
FREE RUN
Explanation The clock is in Free Run mode. Because no timing reference has been provisioned, the on-board stratum-3 quality clock is being used. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action CP Equipment Warning Sonet Thin Mux (STMX) or Sonet ADM CP. Provide a clock source to clear the alarm.
HIGH ORDER PATH AIS

Explanation This alarm is raised when the ADM circuit pack detects the AIS-P defect on the incoming STS-1 signal stream. Upon receiving the AIS-P, the ADM circuit pack will pass an AIS-P through an outgoing tributary port if it receives an incoming AIS-P on the corresponding STS-1 from the line port, or vice-versa. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Warning
3 - 12
ONLINE 7000/9000/11000
TM
HIGH ORDER PATH REMOTE FAILURE INDICATION

Explanation This alarm is raised when a Remote Defect Indication (RDI-P) is detected on the incoming tributary interface of the ADM circuit pack. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Warning
HIGH ORDER PATH TRACE IDENTIFIER MISMATCH

Explanation This alarm is raised if the incoming J1 byte, or byte values generating a message, at the demultiplexing ADM circuit pack do not match the previously provisioned values. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Critical
HIGH ORDER PATH UNEQUIPPED

Explanation This alarm is raised when an unequipped signal is detected. An unequipped signal is detected when the C2 byte in the STS path overhead is 0x00. Affected Object Alarm Type Default Severity Recommended Action ESCON and GRDM CP Line Facility Communication Critical for an active path, Minor for an idle protect path Alarm will clear after the unequipped condition is cleared.
HIGH PEAK VOLTAGE VIOLATION

Explanation This alarm is raised when the SYNC circuit pack detects voltage which exceeds the high threshold. Affected Object Alarm Type Default Severity Recommended Action SYNC Circuit Pack Communication Major
3 - 13
3
ALARM CLEARING PROCEDURES HIGH TEMPERATURE
Explanation If the NE is overheating, this alarm should appear from multiple CPs, and is most likely accompanied by a fan failure or loss of environmental cooling at the location of the NE. Affected Object Alarm Type Default Severity Recommended Action Pre-Amp, Post-Amp, or WCI CPs Equipment Minor For alarms on multiple circuit packs, verify the fan units are properly working and replace any units that may not be functioning. If a fan unit is faulty, all the alarms should clear once the temperature returns to normal. If this alarm comes from a single CP, it is likely a sensor failure within the CP, and the CP needs to be replaced. However, for an amplifier, this alarm can be the symptom of excessive input power saturating the amplifier, resulting in increased heat as the amplifier attempts to meet its gain target. In this scenario, Excessive Input Power, Transmitter Failure, and Laser Bias Pump Failure alarms may also be present. Please review the information for the Excessive Input Power alarm for further recommended actions. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
ONLINETM7000/9000/11000
HOLDOVER
Explanation The clock is in holdover mode because all provisioned timing references have failed or are unavailable. When the reference clock fails or drifts out of adjustable range, the clock automatically goes into holdover. In this mode the most recent data acquired about the reference source is used to control the clock output signal. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action CP Equipment Warning SONET Thin Mux (STMX) or SONET ADM CP. Examine why all provisioned timing references are unavailable or failed and fix the timing references, or use different (available) timing references, or unprovision the timing references and use the internal clock (free run mode).
HUB OSC MISMATCH

Explanation This alarm will be raised in the event that a combination of OSC/COM and OSCH/COMH circuit packs are both being used in the same node. A node must use either OSC/COM or OSCH/COMH compliment versions within the same node. Mixed configurations are not supported in a node. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action OSC, COM Equipment Minor OSCH, COMH Upgrade the older OSC/COM circuit pack to an OSCH/COMH or replace the OSCH/COMH circuit pack with a compatible OSC/COM circuit pack.
3 - 14
ONLINE 7000/9000/11000
TM
INVALID DATA RATE

Explanation In a circuit that has payload type provisioned as an userSpecifiedRate, when FEC is turned on, there are some data rates that cannot be carried correctly by the circuit. When the A/Z node detects that the input data rate is in the range of invalid data rate, line side laser will be shut off, and alarm will be raised. When the data rate gets out of the range, the alarm gets cleared. The following is the range of the invalid data rate: { 0.01, 123.75 }, { 187.65, 492.54 }, { 750.59, 985.09 }, { 1501.19, 1970.18 }, { 2513.70, 9999.99 }, Additional text: the actual data rate detected by the All-Rate or Regional WCI card. Affected Object Alarm Type Default Severity Recommended Action The Tributary Facility on the end node of a circuit Communications Critical Provide the correct input data rate.
LASER BIAS CURRENT FAILURE

Explanation The laser bias current has been driven to 95% or more of its end-of-life value. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action OSC or Line side Facilities Equipment Major OSC, Post Amp, Pre Amp, VGA For an OSC, replace the circuit pack. For an amplifier, this is alarm is typically the result of excessive input power, where the input of the amplifier is saturated to the point that the amplifier cannot meet it's gain target as it has reached it's maximum output power. Excessive Input Power, Transmitter Failure, and High Temperature alarms may also be present in this scenario. Please review the information for the Excessive Input Power alarm for further recommended actions. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LASER BIAS CURRENT FAILURE, LINE LASER BIAS CURRENT FAILURE, TRIB
Explanation The laser bias current has been driven to 95% or more of its end-of-life value. The output power of the laser may be starting to degrade. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line, Facilities:Trib Equipment Major WCI CP Replace the CP.
3 - 15
3
ALARM CLEARING PROCEDURES ONLINETM7000/9000/11000 LASER WAVELENGTH LOCK FAILURE, LINE LASER WAVELENGTH LOCK FAILURE, TRIB
Explanation The WCI circuit packs line laser transmit frequency has drifted of its nominal value for a defined time period. To avoid potential crosstalk interference with adjacent wavelengths, the line laser has been disabled by software and this alarm is raised. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line, Facilities: Trib Equipment Critical WCI CP Replace the CP.
LINE AIS (ADM, ESCON MUX, OR STMX CP), 10GSMX LINE AIS LINE (WCI CP) LINE AIS TRIB (WCI CP)
Explanation Alarm Indication Signal (AIS) is being received in the line overhead of the affected facility due to SONET fault propagation of an upstream fault. This alarm will clear when the upstream problem is resolved. Affected Object Alarm Type Default Severity Affected Object Recommended Action Facilities: All Communications Warning ADM, ESCON, STMX CPs (Line AIS) WCI CP (Line AIS Line, Line AIS Trib) Not applicable.
LINE REMOTE FAILURE INDICATION

Explanation A downstream ESCON Multiplexer circuit pack sends a Remote Defect Indication (RDI) to indicate a defect in the data sent by the upstream ESCON Multiplexer circuit pack. For example, when an ESCON MUX sees a Loss Of Signal, it inserts RDI into the overhead in the frame towards the ESCON MUX that sources the signal. When the upstream ESCON MUX sees the RDI signal for more than 2.5 seconds, it raises the RFI (Remote Failure Indication) alarm. RDI can be signaled at the Sonet line level (RDI-L) or at the Sonet path level (RDI-P). The ESCON MUX generating the RDI signal will raise an alarm for the root cause failure. Affected Object Alarm Type Default Severity Recommended Action ESCON MUX Circuit Pack Communications Warning None.
3 - 16
ONLINE 7000/9000/11000
TM
LOCKOUT OF PROTECTION
LOCKOUT OF PROTECTION ON LINE PORT LOCKOUT OF PROTECTION ON TRIB PORT

Explanation This alarm is raised when a SwitchRequest has been made for the lockout of the default protection side. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Warning
LOCKOUT OF WORKING
LOCKOUT OF WORKING ON LINE PORT LOCKOUT OF WORKING ON TRIB PORT

Explanation This alarm is raised when a SwitchRequest has been made for the lockout of the default working side. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Warning
3 - 17
3
ALARM CLEARING PROCEDURES LOOPBACK
Explanation Indicates that the facility is in loopback stage, as the user requested. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line, Facilities:Trib Communications Warning GRDM, ADM, STMX, or STEM CP. WCI CP (Facilities: Line and Tributary) Not applicable.
ONLINETM7000/9000/11000
LOSS OF CLOCK (ADM, OR STMX CP) LOSS OF CLOCK LINE (WCI CP) LOSS OF CLOCK TRIB (WCI CP)
Explanation Loss of the clock signal when operating in a SONET 3R mode. Affected Object Alarm Type Default Severity Recommended Action Facilities: All Communications Critical Verify that the payload type/clock rate is properly provisioned for the affected circuit. This alarm may also be the result of a faulty circuit pack, though it may be the circuit pack at the far end transmitting bad clock rather than the alarmed circuit pack on the receive side. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS OF FRAME (ADM, ESCON MUX, GRDM, OR STMX CP), 10GSMX LOSS OF FRAME LINE (WCI CP) LOSS OF FRAME TRIB (WCI CP)
Explanation Loss of valid framing within the SONET payload. A sufficient optical power level is present, however the digital signal for the frame is not readable. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line, Facilities: Trib Communications Critical Check for dirty or bent fiber on the affected facility's optical path as this alarm may be due to low optical input power below the sensitivity threshold but above the LOS threshold. This alarm may also be the result of a faulty circuit pack, though it may be the circuit pack at the far end transmitting bad clock rather than the alarmed circuit pack on the receive side. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 18
ONLINE 7000/9000/11000
TM
LOSS OF POINTER (ADM, ESCON MUX, DATA MUX, STMX)

Explanation This alarm is raised when the respective circuit pack has detected an LOP defect on the incoming signal on the line and each tributary port. Affected Object Alarm Type Default Severity Recommended Action ADM, ESCON MUX, Data MUX, STMX Circuit Packs Communications Critical
LOSS OF SIGNAL (ADM I & II, ESCON MUX I & II, GRDM I & II, STMX, 10G SMX)
Explanation This alarm is raised against the line-side or trib-side facility of an ONWAVE Mux circuit pack when insufficient optical power and modulated signal is detected. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action The affected object entry may include either a specific circuit pack (e.g. SRMX-LN, STMX-TR) or also the ONWAVE Node name along with a specific circuit pack. Communications Critical Investigate and resolve potential optical issues. If an ONWAVE Mux circuit pack is connected to the WCI TRIB port, ensure the related bulk circuit is and WCI trib-side facility is properly unlocked. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS OF SIGNAL (OSC/OSH)

Explanation This alarm is raised when insufficient optical power is detected at the OSC input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, or fiber break upstream from the affected input port. It may also be due to a far-end OSC/ OSCH transmitter failure hardware failure, but in many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Trib: OSC-W/OSC-E Communications Critical OSC circuit packs Investigate and resolve potential optical issues. Verify that the associated trib-side OSC facility is properly unlocked at the adjacent node. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 19
3
ALARM CLEARING PROCEDURES LOSS OF SIGNAL ON LINE PORT (WCI)
Explanation This alarm is raised when insufficient optical power and modulated signal is detected at the BxCx input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. In many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. For WCIs with non-SONET/SDH payloads, this alarm conditional may be the result of LOS propagation being performed by the far-end WCI in response to an "Loss Of Signal On Trib Port" alarm. This scenario will be denoted by a "Signal Squelched Line" alarm on the far-end WCI. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line Communications Critical WCI circuit packs Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For an amplified subnetwork, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
ONLINETM7000/9000/11000
LOSS OF SIGNAL ON TRIB PORT (WCI)

Explanation This alarm is raised when insufficient optical power and modulated signal is detected at the TRIB input port. The TRIB port is typically connected to the customer premise equipment (CPE) or an ONWAVE Mux circuit pack, so this alarm may be the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure is the associated CPE or ONWAVE Mux transmitter. Affected Object Alarm Type Default Severity Recommended Action Recommended Action Facilities: Trib Communications Critical WCI circuit packs Investigate and resolve potential optical issues. If an ONWAVE Mux circuit pack is connected to the WCI TRIB port, ensure the line facility of the ONWAVE Mux is properly unlocked. Note that many WCIs support a provisionable LOS threshold, so the LOS raise and clear thresholds may be adjusted over a nominal range. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 20
ONLINE 7000/9000/11000
TM
LOSS OF SIGNAL (LINE CIRCUIT PACK)

Explanation This alarm is raised when insufficient optical power is detected at the NODE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. If there is only passthrough traffic enabled on the node, this alarm can be the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Line Circuit Pack Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For the case of the LINE circuit pack receiving only passthrough traffic, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS OF SIGNAL MUX (CWDM-U)

Explanation This alarm is raised when insufficient optical power is detected at the output of the CWDMU's MUX VOA. Typically, this alarm is due to insufficient optical power on all BxCx input ports. The CWDMU's BxCx ports are usually connected to WCIs. Therefore, the alarm condition can result from excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure affecting all enabled inputs. If the only enabled optical paths are channel passthroughs (CPTs), this alarm can be the result of excessive span loss or a fiber break in the external line-side fiber facility. Affected Object Alarm Type Default Severity Recommended Action Band Section Communications Critical Investigate and resolve potential optical issues. For the CPT only case on an amplified subnetwork, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. Also in this case, additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 21
3
ALARM CLEARING PROCEDURES LOSS OF SIGNAL DEMUX (CWDM-U)
Explanation This alarm is raised when insufficient optical power is detected at the output of the CWDMU's DEMUX VOA. Typically, this alarm is due to insufficient optical power on the CWDMU's Bx input port which is usually the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, excessive span loss or fiber break, or optical hardware failure upstream from the affected input port. Alternately, the circuit pack may be failing to properly detect valid optical power at its affected input. Affected Object Alarm Type Default Severity Recommended Action Band Section Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. Verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
ONLINETM7000/9000/11000
LOSS OF SIGNAL OLM LINE LOSS OF SIGNAL OSM LINE

Explanation This alarm is raised when insufficient optical power is detected at the LINE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. In many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. Verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 22
ONLINE 7000/9000/11000
TM
LOSS OF SIGNAL OLM NODE LOSS OF SIGNAL OSM NODE

Explanation This alarm is raised when insufficient optical power is detected at the NODE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. If there is only passthrough traffic enabled on the node, this alarm can be the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For the case of the OLM/OSM receiving only passthrough traffic, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS OF SIGNAL PMM

Explanation This alarm is raised when insufficient optical power is detected at the output of VOA1 or VOA2 on the PMM. Typically, this alarm is due to insufficient optical power on the PMM's VOA1 or VOA2 input port which is usually the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, excessive span loss or fiber break, or optical hardware failure upstream from the affected input port. Alternately, the circuit pack may be failing to properly detect valid optical power at its affected input. Affected Object Alarm Type Default Severity Recommended Action PMM-MPT, PMM-CPT Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For amplified subnetworks, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. If no optical issues are found upstream, replace the circuit pack if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 23
3
ALARM CLEARING PROCEDURES LOSS OF SIGNAL PREAMP (PREAMP)
Explanation This alarm is raised when insufficient optical power is detected at the NODE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. In many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. Verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
ONLINETM7000/9000/11000
LOSS OF SIGNAL POSTAMP (POSTAMP)

Explanation This alarm is raised when insufficient optical power is detected at the NODE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. If there is only passthrough traffic enabled on the node, this alarm can be the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For the case of the Postamp receiving only passthrough traffic, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 24
ONLINE 7000/9000/11000
TM
LOSS OF SIGNAL PREVGA (VGA)

Explanation This alarm is raised when insufficient optical power is detected at the AMP input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. In many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. Verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS OF SIGNAL POSTVGA (VGA)

Explanation This alarm is raised when insufficient optical power is detected at the AMP input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. If there is only passthrough traffic enabled on the node, this alarm can be the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. For the case of the VGA receiving only passthrough traffic, verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 25
3
ALARM CLEARING PROCEDURES LOSS OF SIGNAL (SYNC)
Explanation This alarm is raised when the SYNC circuit pack cannot detect a valid external sync signal on it's REF input. This alarm will typically either be due to a physical connectivity issue to the external sync reference, improperly provisioned input timing frame and line coding values, or invalid signal from the external sync reference itself. Alternately, the circuit pack may be failing to properly detect a valid external reference at its input. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action External SYNC Reference Communications Major SYNC circuit packs Verify the physical connectivity between the SYNC circuit pack and external sync reference. Verify that the associated synchronization facility is properly provisioned to match the external sync reference's input timing frame and line coding. If no issues are found, replace the circuit pack. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
ONLINETM7000/9000/11000
LOSS OF SIGNAL WPS - (WPS)

Explanation This alarm is raised when insufficient optical power is detected at the NODE input port. Typically, this alarm is the result of excessive attenuation due to a dirty or bent fiber, loose fiber connection, fiber break, or optical hardware failure upstream from the affected input port. In many cases, it is the result of excessive span loss or a fiber break in the external line-side fiber facility. Alternately, the circuit pack may be failing to properly detect valid optical power at its input. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line Communications Critical WPS circuit pack Investigate and resolve potential optical issues. Additional "Loss Of Signal" or "Transmitter Failure" alarms may help to further isolate the source of the optical issue. Verify that the upstream line-side facilities are properly unlocked as a locked line-side facility will disable the associated amplifiers. It may be possible that the circuit pack is failing to properly detect valid optical power at its input, requiring circuit pack replacement if the optical input is verified to be valid with an optical power meter. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOSS VALUES OUT OF RANGE

Explanation Raised when internally calibrated loss values required by the Power Management Algorithm (PMA) are out of range. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Minor Replace the affected circuit pack.
3 - 26
ONLINE 7000/9000/11000
TM
LOW PEAK VOLTAGE VIOLATION

Explanation This alarm is raised when the SYNC circuit pack detects voltage which falls below the lower threshold. Affected Object Alarm Type Default Severity Recommended Action SYNC Circuit Pack Communications Major
LOW SYSTEM RESOURCE DISK SPACE

Explanation This alarm is raised when the available disk space on the PEM is less than 10MB. Affected Object Alarm Type Default Severity Recommended Action PEM/PSM Equipment Minor Remove unneeded files from the internal PEM or PSM drive. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
LOW SYSTEM RESOURCE HANDLE

Explanation This alarm is raised when the main application (ACPEM) is using more than 8000 handles. PEM or PSM will reboot if the number of handles exceeds 12000. Affected Object Alarm Type Default Severity Recommended Action PEM/PSM Equipment Minor The alarm will clear itself when the number of handles in use drops below the 8000 handle threshold or when software automatically reboots the affected PEM or PSM to clear the condition. The affected PEM or PSM may also be manually warm rebooted to clear the alarm condition.
LOW SYSTEM RESOURCE MEMORY

Explanation This alarm will be raised if the available physical memory in PEM or PSM is below 50MB. If available memory is less than 35MB, the affected PEM or PSM will reboot to clear the condition. Affected Object Alarm Type Default Severity Recommended Action PEM/PSM CP Equipment Minor The alarm will clear itself when the available physical memory increases above the 50MB threshold or when software automatically reboots the affected PEM or PSM to clear the condition. The affected PEM or PSM may also be manually warm rebooted to clear the alarm condition.
3 - 27
3
ALARM CLEARING PROCEDURES MANUAL SWITCH
ONLINETM7000/9000/11000
MANUAL SWITCH ON LINE PORT MANUAL SWITCH ON TRIB PORT

Explanation This alarm is raised when a SwitchRequest has been made to manually switch the traffic. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Warning
MEMORY MISMATCH
Explanation This alarm will be raised when the database in the PSM is down. The additional text may include:
PSM Database is Down

Affected Object Alarm Type Default Severity Recommended Action Network element Processing Error Minor Verify if there is a communications failure to the PSM. If there is a communications failure present, then address that condition as this alarm is the result of the communications failure. Contact CIENA Worldwide Customer Services and Support if further assistance is needed.
MULTIPLEX SECTION AIS

Explanation This alarm is raised when the ADM pair detects and AIS-L defect on the incoming signal when bits 6, 7 and 8 of the K2 byte contain the 111 pattern in five consecutive frames. This indicates an errored condition upstream. The ADM pair will then generate and send an AIS-P downstream for the affected STS paths within 125 microseconds of detecting an AIS-L defect. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communications Warning
3 - 28
ONLINE 7000/9000/11000
TM
MULTIPLEX SECTION REMOTE FAILURE INDICATION

Explanation This alarm is raised when the ADM circuit pack detects a Remote Defect Indication (RDIP) on the incoming line. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communications Warning
NODE IN HITLESS STATE

Explanation This alarm is raised when the node is manually placed in Hitless mode. Affected Object Alarm Type Default Severity Recommended Action NE Processing Critical Once all re-provisioning has been completed, the user should perform the End Hitless Mode from OPTX GCIT. From the Configuration menu, select Network Element > End Hitless Mode.
NODE IN PARTIALLY TURNED UP STATE

Explanation This alarm is raised when the node is in a partially turned up state. It is normal to encounter this alarm during node turn-up. Affected Object Alarm Type Default Severity Recommended Action Network Element Processing Error Minor This alarm will clear once the node is fully provisioned with its turn-up information.
NODE IN SELECTIVE RESTORE

Explanation When the user performs selective restore from the backup database file, the PEM will restart first. Once the PEM recovers from the restart, this alarm will be raised to denote that the restore operation is not complete because the network GDD (Global Data Distribution) objects are being populated from the neighboring nodes in the ring. After the GDD operation is complete, this alarm will clear and a Node in Hitless State alarm will raise as the node will properly go into Hitless mode. Explanation The additional text is: Node in progress of selective restore Affected Object Alarm Type Default Severity Recommended Action Network element Processing Error Critical Not applicable.
3 - 29
3
ALARM CLEARING PROCEDURES NVRAM PROBLEM
Explanation Raised by an internal audit when some NVRAM fields are invalid. Additional text will indicate the invalid field. This alarm is not service affecting. Affected Object Alarm Type Default Severity Recommended Action PEM or PSM CP Equipment Minor Call CIENA Worldwide Customer Services and Support for assistance.
ONLINETM7000/9000/11000
OCH AIS ON LINE PORT

Explanation Optical Channel AIS is an alarm indication signal contained in the digital wrapper header. This digital wrapper header is present on line side frames of the OC-192 w/FEC and 10G LAN w/FEC WCI circuit packs only. When raised, it will suppress all SONET alarms except for LOS. It will not suppress the Trail Trace Mismatch alarm. The OCH AIS On Line Port alarm is used instead of the SONET AIS-L alarm to indicate an error condition to downstream equipment if one of the following faults is detected at the incoming, tributary side, signal:
! ! !
SONET LOS SONET LOF J0 Mismatch (If both monitoring and AIS generation are enabled) WCI Circuit Pack Communications Critical, Minor (Severity depends on whether the circuit pack is providing service.) None.
Affected Object Alarm Type Default Severity Recommended Action
ODPR PROTECTION UNAVAILABLE

Explanation Indicates that protection switching is not available. Any traffic affecting operations (such as removing a PostAmp CP, removing OSC, line breaks) could cause a loss of live traffic if there is a ODPR Protection Unavailable alarm. Affected Object Alarm Type Default Severity Recommended Action WCI Circuit Pack Processing Error Major Contact CIENA Worldwide Customer Services and Support.
OOS DIAGNOSTICS PERFORMED

Explanation This alarm is raised when out of service diagnostics are performed on a circuit pack.
The additional text is: OOS Diagnostics performed. CP needs to be cold rebooted. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Minor Cold reboot the circuit pack as it is design intent that a cold reboot must be performed after an OOS diagnostic. The alarm is cleared when the CP reboots. Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
3 - 30
ONLINE 7000/9000/11000
TM
OPTICAL SWITCH FAILURE

Explanation An optical switch failure on an RSM or WPS CP. RSM, WPS, or CWDM CP Equipment Critical Warm reboot the circuit pack. If the alarm returns, replace the affected circuit pack. Affected Object Alarm Type Default Severity Recommended Action
OSC4080 DEVICE FAILURE

Explanation The 4080 hardware device on the OSC CP has failed. Affected Object Alarm Type Default Severity Recommended Action OSC CP Equipment Major Replace the OSC CP.
OSPR PROTECTION UNAVAILABLE

Explanation Refer to the additional text for the specific cause. Affected Object Alarm Type Default Severity Recommended Action Network element Processing Error Major Any traffic affecting operations (such as removing a PostAmp CP, removing OSC, line breaks) could cause a loss of live traffic if there is an OSPR Protection Unavailable alarm. The additional text field describes the specific cause of the OSPR Protection Unavailable alarm. The alarm is cleared when the cause no longer exists. Additional text may include any of the following:
! ! ! ! ! ! !
Power not converged Ring map unknown Channel table unknown Power control not ready (for example, a CP containing a VOA is not up and running). Switch control not ready (RSM control not ready) The RSM CP is needed, but it is not up. WCI control not ready
Table 3-1 lists corrective actions based on the additional text field.
3 - 31
3
ALARM CLEARING PROCEDURES ONLINETM7000/9000/11000
Table 3-1. Corrective Actions for the OSPR Protection Unavailable Alarm Additional Text Power not converged Corrective Actions Check for reasons for the Power not converged alarm. Check that the subnetwork map is provisioned. Check that signaling converged (review TC logs) Check if subnetwork map is provisioned. Check if the subnetwork map has been sent to the OSC. Check AC logs for subnetwork map update messages sent to the TC. Check the local node type. Check if any circuits are provisioned. Check if circuits are unlocked. Check if AC sent the channel table to TC. Check if all CPs containing VOA are up and running. Check if there are working side regens in the node and the node is isolated. Check if the RSM is up and running. Check is signaling has converged.
Ring Map Unknown
Channel Table Unknown
Power Control Not Ready WCI Control Not Ready RSM Not Ready
OUT OF FRAME
Explanation This alarm is raised when the Sync CP detects out of frame on the incoming signal. CP Communications Major Correct the out of frame condition of the incoming signal. Affected Object Alarm Type Default Severity Recommended Action
PATH AIS
Explanation Alarm Indication Signal (AIS) is being received in the path overhead of the affected facility due to SONET fault propagation of an upstream fault. This alarm will clear when the upstream problem is resolved. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Warning None.
3 - 32
ONLINE 7000/9000/11000
TM
PATH REMOTE FAILURE INDICATION

Explanation This alarm is raised if the ESCON MUX circuit pack detects a Remote Defect Indication (RDI-P) on the incoming tributary port. Affected Object Alarm Type Default Severity Recommended Action ESCON MUX Circuit pack Communications Warning
PATH TRACE MISMATCH

Explanation Indicates that the incoming J1 byte (or byte values generating a message) at the demultiplexing ESCON Mux CP and GRDM CP does not match the previously provisioned value. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line Communications Critical Check and correct the configuration via the NM or GCIT. Select the Circuit in the GCIT tree menu, then select the Provisioning>Overhead Provisioning menu item, and set the bytes for that WCI.
PATH UNEQUIPPED
Explanation This alarm is raised when an unequipped signal is detected. An unequipped signal is detected when the C2 byte in the STS path overhead is 0x00. Affected Object Alarm Type Default Severity Recommended Action ESCON and GRDM CP Line Facility Communication Critical for an active path, Minor for an idle protect path Alarm will clear after the unequipped condition is cleared.
PAYLOAD MAPPING FAILURE

Explanation Loss of Frame (loss of proprietary frame) error on the GRDM CP and ESCON CP, when mapping the Gigabit Ethernet into a Sonet frame. Loss of proprietary frame should be interpreted along with these higher-level alarms
! ! ! !
LOS LOF (Sonet) LOP (Sonet) B1/B2/B3 errors (Sonet)
1.
If LOS, LOF(Sonet), or LOP (Sonet) are active, it is normal to have LOF (prop frame).
2. If there is a very high bit error rate (reported via B1/B2/B3), it is also possible that LOF (prop frame) would get activated. 3. If there are no errors other than LOF (prop frame) being reported, then:
!
the Rx GRDM has a problem (the received proprietary frame is OK but the GRDM is not able to get in-frame), or the Tx GRDM has a problem (the received proprietary frame is not valid)
3 - 33
3
Affected Object Alarm Type Default Severity Associated Equipment Recommended Action
ONLINETM7000/9000/11000
Facilities: Line Communications Critical Gigabit Rate Data Mux (GRDM) CPs. Not applicable.
PEER COMMUNICATIONS FAILURE

Explanation Indicates a communications failure between OSC-W and OSC-E on the same node. Affected Object Alarm Type Default Severity Recommended Action OSC Facilities Processing Error Minor Warm reboot the affected OSC circuit pack. If the alarm return, an OSC circuit pack may be faulty, though it could be a fault with either the transmit or receive path. Replace either of the OSCs. If the alarm returns, then the previously replaced OSC is likely good and the non-replaced OSC is actually faulty and should be replaced.
Explanation Indicates a communications failure between STMX or ADM CP pairs. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Major Not applicable.
Explanation Indicates a Datawire communications failure between OSC-W and OSC-E on the same node. Affected Object Alarm Type Default Severity Recommended Action Datawire Facilities Communications Minor Not applicable.
PMA IS LOCKED
Explanation This alarm is raised to denote that the Lock PMA action has been performed on a node. Affected Object Alarm Type Default Severity Recommended Action NE Processing Critical This alarm will clear when the Unlock PMA action is performed on the node.
3 - 34
ONLINE 7000/9000/11000
TM
POWER ACO CARD FAILURE

Explanation If the alarm occurs, the Power ACO Card (shelf EEPROM card) must be replaced. When the card is replaced, the first time the EEPROM is accessed, it is automatically recovered from the previous image that was saved in the registry. When the problem has been fixed, the alarm will be cleared in the next audit loop. The audit loop runs every hour. Affected Object Alarm Type Default Severity Recommended Action Network element Equipment Minor Replace the Power ACO Card (shelf EEPROM card).
POWER ENTRY FAILURE

Explanation Indicates that the Power Entry card has been removed from its provisioned slot, or has suffered a hardware failure, or that there is a problem in the power feed. Affected Object Alarm Type Default Severity Recommended Action Shelf Environmental Major If the card has been removed, replace it. If the card is present, reseat it. If this does not clear the error, replace the Power Entry card.
POWER MANAGEMENT PROBLEM

Explanation The Power Management alarm indicates that the power management algorithm did not converge. Additional text may include any of the following:
!
No reason The Power Management Algorithm (PMA) is in the process of converging. Wait about 30 more seconds for the alarm to clear or the additional text to be updated. OSC East circuit pack not in running state The East OSC CP has not reached the running state. This can be visually verified by checking that the green equipment LED is not solid. Missing or incomplete fiber connection information The Power Management algorithm is waiting for some type of provisioning. Typically seen when the node has not been turned up or when the provisioning information is still being constructed. Node Turnup Parameters missing The Power Management algorithm is waiting for provisioning information. Typically seen when the node has not been turned up. After node turn-up, the alarm should clear or be updated. Span losses uninitialized The East and/or West Span losses have not been initialized. 0 is an invalid value. Provision the span losses with the design values used in OPTX Network Designer via the Span loss provisioning dialog. Pads not calculated The Power Management Algorithm is still in the process of converging. Wait 2 minutes after the node has been completely provisioned for the alarm to be cleared or updated.
3 - 35
3
!
ONLINETM7000/9000/11000
Incomplete loss data The Power Management Algorithm (PMA) is waiting for one or more provisioned CPs to report their insertion losses. Once all provisioned CPs are in the running state (equipment LED is solid green), the alarm should clear or be updated. Power signaling problem east/west span The PMA is unable to communicate with the PMA running on the east/west neighbor. Check for Signaling Not Converged alarms on any node and clear these alarms. This additional text can also be observed when there is a Power Management Alarm on the east/west neighbor. Calculated power levels are too low: check span losses Span loss mismatch PMA mismatch Network element Processing Error Critical Refer to the additional text.
! ! !
POWER PROBLEM
Explanation When this alarm is raised against a Power Entry card, the card is not receiving the correct power from the power supply. A Power Entry Failure alarm is also raised at the same time. Affected Object Alarm Type Default Severity Recommended Action Power Entry cards Equipment Major Provide the correct power supply to the Power Entry card.
PROCESSOR BUSY
Explanation This alarm will be raised when the event queue in a circuit pack reaches a specific threshold and the PEM is not able to process the events fast enough. Once this occurs, the circuit pack will map a Processor Busy alarm to the PEM. Other circuit packs sending events to the PEM continue to send events and the PEM continues to process them. Once the circuit pack detects the conclusion of the event storm at the PEM, the circuit pack will refresh the status and clear the alarm automatically. The PEM does not drop processing of any tasks. Instead, during the time of the alarm, the PEM will not receive any new events to process from the circuit pack. Affected Object Alarm Type Default Severity Recommended Action CP, PEM Processing Error Minor None. The alarm will clear automatically after the PEM processing catches up. No events will be dropped.
3 - 36
ONLINE 7000/9000/11000
TM
PROGRAM MEMORY FAILURE

Explanation Indicates that the PEM or PSM disk check has failed, either on the alternate drive, the current drive, or both the alternate drive and the current drive. Additional text may include any of the following:
! ! !
Alternate drive Current drive Alternate drive and current drive
Affected Object Alarm Type Default Severity
Network element Equipment Minor, if alternate drive Major, if current drive Critical, if alternate drive and current drive Associated Equipment PEM or PSM CP Recommended Action Perform an in service card diagnostic on the affected PEM or PSM. This will clear the alarm and rerun the disk check. If the alarm is not subsequently raised, the disk check has passed and the fault has been cleared by a disk write subsequent to the initial alarm event. If the disk check fails again and the alarm is raised contact CIENA Worldwide Customer Services and Support.
PROGRAM MEMORY MISSING

Explanation The D: drive on the PEM/PSM is defective. Additional text may include the following information:
!
Alternate drive PEM CP, PSM CP Equipment Major Contact CIENA Worldwide Customer Services and Support.
PROTECTION PATH FAILURE

Affected Object Alarm Type Default Severity Associated Equipment Facilities: Trib Communications Minor ADM, STMX, or WCI CP, 10GSMX
Explanation In a UPSR configuration, this alarm indicates that a facility on the Protection side has failed. This alarm is raised against the terminating point of the network path. This alarm is also raised when the switchRequest is autoSwitch with autoSwitchReason as signalFail for the standby side of 1+1 linear protection, or O-UPSR tributary protection. The alarm is cleared when the standby sides switchRequest changes from autoSwitch or autoSwitchReason changes from signalFail.
3 - 37
3
ALARM CLEARING PROCEDURES ONLINETM7000/9000/11000
LOS and LOF alarms will also be raised against any failed CP. Affected Object Alarm Type Default Severity NE Communications Minor
Explanation The BLSR protection side regens are locked, but the protection regens are still supporting an active light path circuit.
PROVISIONING MISMATCH
Affected Object Alarm Type Default Severity NE Processing Error Minor
Explanation This alarm indicates a provisioning inconsistency in the node/ring. The problem is indicated in the additional text: Additional Text: Regen Table Mismatch This is raised to indicate stale or inconsistent entries in the regen table. Though this is not service affecting, please contact CIENA Worldwide Customer Services and Support before making any further provisioning changes. Recommended Action Contact CIENA Worldwide Customer Services and Support.
RECEIVER FAILURE LINE RECEIVER FAILURE TRIB

Explanation Indicates that the receiver in the WCI CP has failed. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line, Facilities: Trib, CP. Equipment Critical WCI CP Replace the WCI CP.
REFERENCE FAILED
Explanation The internal CP clock reference has failed. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities (STMX, ADM CPs), CP (Sync CP) Communications Major STMX CP, Sync CP, ADM CP Replace the CP.
3 - 38
ONLINE 7000/9000/11000
TM
REFERENCE LOCKED OUT

Explanation This alarm is raised when a provisioned line or tributary synchronization reference has been locked out. Locking out a synchronization reference prevents it from being selected as the active synchronization source. Affected Object Alarm Type Default Severity Recommended Action SONET or SDH Facility Communication Warning The alarm will clear once the lockout is cleared.
REFERENCE OUT OF RANGE

Explanation The port associated with the TTP has clock reference out of range. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities (STMX, ADM CPs), CP (Sync CP) Communications Major STMX CP, Sync CP, ADM CP This alarm can be the result of an unstable timing source. If the timing source is stable, replace the affected circuit pack.
REGENERATOR SECTION TRACE IDENTIFIER MISMATCH

Explanation This alarm is raised if the incoming J0 byte, or byte values generating a message, at the demultiplexing ADM do not match the previously provisioned values. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communications Critical
REPLACEABLE UNIT MISSING

Explanation This alarm indicates that a provisioned CP is not in the slot. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Critical Check the slot for the appropriate CP. If the slot is empty, insert the necessary CP. If the CP appears to be in the slot, reset it by removing and reinserting it. If the error condition persists, replace the CP.
3 - 39
3
ALARM CLEARING PROCEDURES REPLACEABLE UNIT PROBLEM
Explanation A problem with a CP that cannot be isolated to a single cause. There is a discrepancy between the status of the CP as seen by the east and west OSC. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Minor Try resetting or replacing the CP. It is also possible that there could be a problem with either OSC. Contact CIENAWorldwide Customer Service and Support.
ONLINETM7000/9000/11000
REPLACEABLE UNIT TYPE MISMATCH

Explanation This alarm indicates that the CP installed in a particular slot does not match the provisioning information in the database. The additional text is: CP PCODE: ... Provisioned as: ... Affected Object Alarm Type Default Severity Recommended Action CP Equipment Critical (Major if RSM CP) First check the provisioning information to make sure the circuit pack is provisioned correctly. If the provisioned value of the circuit pack is correct, check the indicated slot, replace the incorrect circuit pack with the correct one. If the provisioned value of the circuit pack is incorrect and the actual circuit pack in the slot is correct, then reprovision the slot as appropriate.
SECTION TRACE MISMATCH SECTION TRACE MISMATCH LINE SECTION TRACE MISMATCH TRIB
Explanation Indicates that the signal being received does not conform to configurations settings. The section trace label assigned on the input port of a certain signal is not the same as the section trace being read at the output port that signal is being taken out. This shows miswiring of the signal somewhere down the line between the two ends. Affected Object Alarm Type Default Severity Affected Object Recommended Action Facilities: All Communications Critical STMX or ADM CP (Section Trace Mismatch) WCI CP (Section Trace Mismatch Line, Section Trace Mismatch Trib) Disable AIS insertion (through OPTX GCIT) before making any changes in configuring the section trace parameters. To ensure that the AIS insertion alarm is synchronized, enable that alarm only after the entire ring configuration is completed. Check and correct the configuration via the NM or GCIT. Select the Circuit in the GCIT tree menu, then select the Provisioning>Overhead Provisioning menu item, and set the C1, J0 (SONET) or J0 (SDH) bytes for that WCI. Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
3 - 40
ONLINE 7000/9000/11000
TM
SHELF ID MISMATCH
Explanation This alarm occurs when a shelf eeprom card from another node is inserted in the primary shelf of a node. This is detected by the shelf ID field of the eeprom not matching the copy stored in the registry on the PEM CP. While this condition is in place, the eeprom can be updated only by using the -im option of the eeprom command line tool on a PEM CP. The additional text is: Primary shelf EEPROM shelf id mismatch. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Critical If an eeprom card fails and has to be replaced, the procedure is to insert a new working card and use the eeprom command from a PEM console window to set the shelf ID to match the registry value. This will cause the eeprom card to be automatically reprogrammed with the backup copy of the registry image stored in the registry. If an incorrect eeprom card is left in for a period of time, then the alarm will be raised at the next audit cycle. When the correct card is reinserted, the alarm will be cleared at the next audit cycle.
SHELF INTERCONNECT FAILURE

Explanation Indicates an Ethernet connectivity problem between the shelves of a node. This alarm will be raised by the last good shelf in the chain. Affected Object Alarm Type Default Severity Recommended Action COM CP, OSC CP Equipment Minor Inspect the cable between the shelf raising the alarm and the one after it in the cabling scheme (usually the shelf below) and ensure the link LED is solid green. If the cable is suspect or one or both link LEDs are not solid green, replace the cable. Otherwise, repace the COM circuit pack in the lower shelf. If the alarm condition does not clear, the replace the OSC/COM circuit pack in the shelf raising the alarm.
SHELF TYPE MISMATCH

Explanation The provisioned shelf type does not match the actual shelf type. The additional text field lists the provisioned and actual shelf types. The additional text is: Provisioned Shelf Type = ... Real Shelf Type = ... Affected Object Alarm Type Default Severity Recommended Action Shelf Equipment Major If the shelf type is provisioned incorrectly, then delete and reprovision the shelf with the appropriate shelf type. Otherwise, utilize the Set Shelf Number tool to properly set the shelf type in the shelf EEPROM.
3 - 41
3
ALARM CLEARING PROCEDURES ONLINETM7000/9000/11000 SIGNAL DEGRADE BER (ADM, OSC, OR STMX CP), 10GSMX SIGNAL DEGRADE BER LINE (WCI CP) SIGNAL DEGRADE BER TRIB (WCI CP)
Explanation The BER has exceeded the Signal Degrade threshold. The default Signal Degrade threshold is 10-6. Affected Object Alarm Type Default Severity Recommended Action OSC, WCI, STMX, or ADM CP. Communications Major Not applicable.
SIGNAL FAIL BER (ADM, OSC, OR STMX CP), 10GSMX SIGNAL FAIL BER LINE (WCI CP) SIGNAL FAIL BER TRIB (WCI CP)
Explanation The BER has exceeded the Signal Fail threshold. The default Signal Fail threshold is 103. Affected Object Alarm Type Default Severity Recommended Action OSC, WCI, STMX, or ADM CP. Communications Critical Not applicable.
SIGNAL FREQUENCY INVALID

Explanation This alarm is raised when the pulse width detected on the SYNC circuit pack is invalid. Affected Object Alarm Type Default Severity Recommended Action SYNC Circuit Pack Communications Major
SIGNAL SQUELCHED LINE SIGNAL SQUELCHED TRIB

Explanation The line-side laser has been squelched due to optical LOS on the WCIs tributary port or the trib-side laser has been squelched due to optical LOS on the WCIs line-side port. This action is performed to provide fault propagation of the LOS from line to trib or trib to line fro non-SONET payloads and will clear when he upstream LOS clears. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action CP (WCI CP) Communications Critical WCI Not applicable.
3 - 42
ONLINE 7000/9000/11000
TM
SIGNALING FAILURE
Explanation The Signaling Failure alarm is raised when a node cannot talk to an expected neighbor. For instance, in a ring, any given node has two neighbors it can talk to. If the node is unable to communicate with both neighbors, it will raise this alarm. This is normal if the neighbor nodes have not been turned up or connected yet. The alarm will clear itself once the neighbor communication is achieved. This is an automatic process that occurs when the neighbor nodes have been turned up. The additional text may include:
! ! ! !
East Neighbor Missing West Neighbor Missing Neighbor Information Missing Unknown Reason Facilities: Line Processing Error Major If a node continues to report Signaling Failure after all attached nodes have been turned up, and connected in the network, then a warm boot should be applied to the CP reporting the failure. If the condition persists even after a warm reboot, contact CIENA Worldwide Customer Services and Support.
SOFTWARE DOWNLOAD FAILURE

Explanation Indicates that a software download to the node failed. Affected Object Alarm Type Default Severity Recommended Action Network element or CPs Processing error Major Reinitiate the software download, if it still fails, contact CIENA Worldwide Customer Services and Support.
SOFTWARE ENVIRONMENT PROBLEM

Explanation Indicates a problem with the software environment. Additional text may include:
Wrong software loads on the current drive

Affected Object Recommended Action PSM If the alarm persists for more than 20 minutes, contact CIENA Worldwide Customer Services and Support.
Wrong software loads on the alternate drive

Affected Object Recommended Action PEM and PSM Contact CIENA Worldwide Customer Services and Support.
3 - 43
3
Activated on the wrong drive
Affected Object Recommended Action PSM The alarm should be cleared when the PSM is up and running with the correct loads. Make sure the PSM is up and running correctly. If the alarm remains, contact CIENA Worldwide Customer Services and Support.
ONLINETM7000/9000/11000
Manual cold reboot required to upgrade FPGA version to most recent

Affected Object Recommended Action CP An updated FPGA version is available to provide enhanced functionality. In order to utilize the enhanced functionality, a service affecting cold reboot must be performed on the circuit pack to upgrade the FPGA load to the new version.
Load repository corrupt on current drive

Load repository corrupt on alternate drive

Unable to set software version in EEPROM

Affected Object Recommended Action PEM Contact CIENA Worldwide Customer Services and Support.
Wrong software loads on the alternate flash region

Affected Object Recommended Action All active transport CP If the alarm persists for more than 10 minutes, perform a warm reboot. After the recovery from the reboot, if the alarm returns and persists for another 10 minutes, then contact CIENA Worldwide Customer Services and Support.
3 - 44
ONLINE 7000/9000/11000
TM
SYNCHRONIZATION FAILURE
Explanation This alarm is raised on paired ADM CPs that fail to operate frame-synchronous. Affected Object Alarm Type Default Severity Recommended Action STEP 1: ADM CP Equipment Critical Perform the following troubleshooting:
Verify a clock source is provisioned for the ONWAVE Service Blade node. Begin by highlighting the ONWAVE node in the tree pane of OPTX GCIT. Next, right-click on the ONWAVE node generating the alarm and select Clock Synchronization... from the pulldown menu. Verify a clock source is present and is configured correctly. Possible clock sources include Line interface, Tributary interface, External Reference A, and External Reference B. Refer to the OPTX GCIT User Guide for specific information on configuring a clock source.
STEP 2:
For nodes using the SYNC circuit packs or external sources connected to the SYNC circuit packs, verify the SYNC circuit pack is provisioned correctly. Begin by expanding the shelf where the SYNC circuit pack should be located. If no SYNC circuit packs are visible in the tree pane for any of the shelves in the node, then a SYNC circuit pack has not been provisioned. Provisioning of the SYNC circuit pack is needed. After a SYNC circuit pack is provisioned and installed, repeat Step 1 to verify a clock source is provisioned for the ONWAVE node. If SYNC circuit packs are visible, then right-click on the SYNC A circuit pack and select Information from the pull-down menu. Verify the Holder Status listed is Installed. If the Holder Status is notInstalled then the SYNC circuit pack is not physically in the shelf. Repeat this step for the SYNC B circuit pack, if available.
STEP 3: STEP 4:
For nodes receiving synchronization from either the line or tributary interfaces of the ADM, verify the timing source is provisioned, valid, and operational. This may involve troubleshooting a third-party timing source or another ONWAVE node. If the timing sources are present, valid, and provisioned correctly but the alarm persists, then please call CIENA Worldwide Customer Services and Support.
TEMPERATURE SENSOR FAILURE

Explanation Indicates an I2C controller failure on a circuit pack. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Major Replace the circuit pack.
3 - 45
3
ALARM CLEARING PROCEDURES TEMPERATURE OUT OF RANGE
Explanation This alarm is raised when sensors on either a single circuit pack or multiple circuit packs detect an abnormally high shelf temperature. Affected Object Alarm Type Default Severity Recommended Action Pre-AMP, Post-AMP Circuit Packs Equipment Minor If this alarm is raised on multiple circuit packs simultaneously, then it is most likely a fan failure. Replacing the fans should clear the alarms once the temperature returns to normal. If this alarm is raised by only a single circuit pack within the node, then it is likely a temperature sensor on the circuit pack has failed. In this case the circuit pack will need to be replaced.
ONLINETM7000/9000/11000
THRESHOLD CROSSED LBC LINE THRESHOLD CROSSED LBC TRIB

Explanation The LBC (Laser Bias Current) Line and LBC Trib alarms indicate the LBC value has exceeded the provisioned threshold value. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action Facilities: Line, Facilities: Trib Communications Warning WCI CP Verify that the provisioned LBC threshold value is reasonable. Typically, circuit pack replacement is warranted with an Laser Bias Current Failure alarm is raised, though this threshold alarm may be used as an early warning.
THRESHOLD CROSSED OPR (EXTENDED OSC, PREAMP, POSTAMP) THRESHOLD CROSSED OPR LINE, OPR TRIB (WCI CP)
Explanation Threshold Crossed OPT (Extended OSC, Preamp, Postamp) Threshold Crossed OPT Line, OPT Trib (WCI CP) Explanation These alarms indicate that the provisioned Optical Power Received or Optical Power Transmitted level has been exceeded. Affected Object Alarm Type Default Severity Recommended Action Facilities: All Communications Warning Verify that the provisioned OPR or OPT threshold value is reasonable. For line facilities, this value can be compared to the expect and actual transmit and receive power values in the Amp/Line Measurements optical diagnostic. Often this alarm is due to the OPR or OPT value being set based on existing power levels and the alarm is raised when circuits are subsequently locked or unlocked. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 46
ONLINE 7000/9000/11000
TM
THRESHOLD NM CROSSED ALARMS

Explanation These alarms are raised if the value of a parameter crosses a threshold value during N out of M previous 15-minute PM intervals, as soon as the Nth Threshold Crossing Alert is generated within M periods:
! ! !
Threshold NM Crossed CRC Threshold NM Crossed CV_L, CV_LLine, CV_LTrib, CV_P (Code Violations) Threshold NM Crossed CVs, CV_S Line, CV_S Trib, CVs, CVs_ch1, CVs_ch2 (Code Violations) Threshold NM Crossed ES_L, ES_LLine, ES_LTrib, ES_P (Errored Seconds) Threshold NM Crossed ES_S, ES_S Line, ES_S Trib (Errored Seconds) Threshold NM Crossed FC_L, FC_LLine, FC_LTrib, FC_P Threshold NM Crossed FCS, FE_FCS (Frame Check Sequence) Threshold NM Crossed FE Threshold NM CrossedGbE_CRC_IN, GbE_CRC_OUT, GbE_DE, GbE_FRAGS_OUT, GbE_JABBER_IN, GbE_JABBER_OUT, GbE_LOCS GbE_FRAGS_IN,
! !
! ! ! !
! ! ! ! ! !
Threshold NM Crossed SEFS_S, SEFS_Line, SEFS_Trib (Severely Errored Frame Seconds) Threshold NM Crossed SES_L, SES_LLine, SES_LTrib, SES_P (Severely Errored Seconds) Threshold NM Crossed SES_S, SES_S Line, SES_S Trib (Severely Errored Seconds) Threshold NM Crossed TCBE_OnLinePort, TCBE_OnTribPort (Total Corrected Bit Errors) Threshold NM Crossed UAS_L, UAS_LLine, UAS_LTrib, UAS_P (Unavailable Seconds) Threshold NM Crossed UCBEOnLinePort, UCBEOnTribPort (Uncorrectable Block Errors)
The default values are N=3, and M=8. The user should set realistic values for these thresholds in the CIT, so that these threshold alarms will be raised when appropriate. The Threshold NM Crossed CVs alarm refers to the tributary port of the Gigabit Rate Data Mux CP, while the Threshold NM Crossed CVs_ch1, Threshold NM Crossed CVs_ch2, and Threshold NM Crossed FCS alarms refer to the line ports of the GRDM CP. The following alarms refer to the ADM, STMX, GRDM CP:
! ! ! ! ! ! ! !
Threshold NM Crossed CV_L, CV_LLine, CV_LTrib, CV_P Threshold NM Crossed ES_L, ES_LLine, ES_LTrib, ES_P Threshold NM Crossed FC_L, FC_LLine, FC_LTrib, FC_P Threshold NM Crossed GbE_LOCSOnLine, GbE_LOCSOnTribP Threshold NM Crossed MS_BBE, MS_EB, MS_ES, MS_FC, MS_SES, MS_UAS Threshold NM Crossed RS_BBE, RS_EB, RS_ES, RS_SEFS, RS_SES Threshold NM Crossed SES_L, SES_LLine, SES_LTrib, SES_P Threshold NM Crossed UAS_L, UAS_LLine, UAS_LTrib, UAS_P
The ThresholdNM Crossed GbE_DE, ThresholdNM Crossed GbE_LOCS, and ThresholdNM Crossed TCBE alarms refer to the FEC-At-All-Rates WCI. The ThresholdNM Crossed TCBE alarm refers to the FEC channel on that CP. The following alarms refer to the Line side of the GRDM and ESCON circuit packs, as well as the Monitor Point of the ADMII: Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
3 - 47
3
! ! ! ! ! !
ONLINETM7000/9000/11000
Threshold NM Crossed Path_BBE (Bit Block Error) Threshold NM Crossed Path_ES (Errored Seconds) Threshold NM Crossed Path_SES (Severely Errored Seconds) Threshold NM Crossed Path_EB (Error Blocks) Threshold NM Crossed Path_UAS (Unavailable Seconds) Threshold NM Crossed Path_FC (Failure Count) Facilities: All Communications Warning Contact CIENA Worldwide Customer Services and Support if further assistance is required.
TOPOLOGY DISCOVERING
Explanation This alarm is raised when automatic node discovery is in progress, and cleared when discovery is complete. Additional text may include:
! ! ! !
Ring Discovery in Progress Topology Unknown East Neighbor Unknown West Neighbor Unknown Network element Processing Error Major Wait until automatic node discovery is complete. This alarm may also occur when communications are impaired between nodes. This will be denoted by additional alarms which should be investigated and resolved.
TOPOLOGY MISMATCH
Explanation This alarm is raised when there is a mismatch in the discovered topology and the provisioned topology. Additional text may include:
! ! ! ! ! ! !
East Neighbor Mismatch West Neighbor Mismatch Ring Info (Ring Map) Mismatch Fiber Type Mismatch PMA Mismatch Switch Trigger (Protection Switch Trigger) Mismatch Span Loss Mismatch
3 - 48
ONLINE 7000/9000/11000
TM

!
Network element Processing Error Major
East Neighbor, West Neighbor, and Ring Info Mismatches: The alarm is cleared when the discrepancy between the provisioned topology and the discovered topology falls within the specified criteria For UPSR (ODPR) and BLSR (OSPR) topologies, ensure the topologies are correct for the application (all of the topologies must match). For Ring Map mismatch, ensure all of the node IDs and topologies are correct. Fiber Type Mismatch: Check the fiber type configuration on each span. PMA Mismatch: Check the PMA type configuration at each node in the ring. Switch Trigger (Protection Switch Trigger) Mismatch: Verify the ring protection switching trigger values are set as desired. Typically, they should be set identically for all network elements in the subnetwork. Span Loss Mismatch: The alarm is cleared when the discrepancy between the provisioned span loss and the actual span loss falls within the provisioned span loss discrepancy value (default 2 dB). This can be accomplished in one of three ways: Identify the cause of the span loss discrepancy in the line fiber facility and resolve to restore the actual span loss to its provisioned value. Re-optimize the sub-network: If the span losses have changed to the point that they are in excess of the span loss discrepancy value, the subnetwork needs to be reoptimized by using OPTX Network to validate the latest span loss values, potentially requiring changes to line receiver and other pads within the subnetwork Alter the provisionable span loss discrepancy value through OPTX GCIT to accommodate the span loss difference.
! !
NOTE:
Provisioned span loss values should only be updated with values validated by OPTX Network Designer's Optical Link Analysis. These values should only be changed in conjunction with any OPTX Network Designer specified design changes (e.g. pad changes). Failure to observe this requirement can result in altered optical characteristics of the subnetwork and may result in optical degradations and impact to service. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 49
3
ALARM CLEARING PROCEDURES TRAIL TRACE MISMATCH
Explanation This alarm is analogous to Section Trace Mismatch, but pertains to the digital wrapper overhead instead of the section overhead of the SONET frame. This alarm indicated a mismatch between the expected trail trace value and the received trail trace value. It is supported on the line side of the OC-192 w/FEC and 10G LAN w/FEC WCI circuit packs only. When raised, it does not suppress any other alarm on the facility. Affected Object Alarm Type Default Severity Recommended Action WCI Circuit Pack Communications Critical, Minor (Depending on whether the WCI is providing service) None.
ONLINETM7000/9000/11000
TRANSMIT FAIL
Explanation This alarm is raised if there is a Loss of Signal condition. Facility: Line Communications Critical OLM, OSM, PMM CPs Correct the input power level. Affected Object Alarm Type Default Severity Affected Object Recommended Action
TRANSMITTER FAILURE
Explanation For an OSC, this alarm indicates a failure in the transmitter hardware has been detected. For an amplifier, this alarm indicates that the amplifier is unable to come within 2dB of its expected gain. Affected Object Alarm Type Default Severity Associated Equipment CP Equipment Critical Postamp, Preamp, OSC
NOTE:
When raised for an OSC, this should cause a Loss of Signal affecting the OSC facility in the downstream node.
Recommended Action
When this alarm is raised against an OSC, replace the circuit pack. When This alarm is raised against an amplifier, it indicates that the amplifier is unable to come within 2 dB of its expected gain. Typically, this is the result of the result of excessive input power, where the input of the amplifier is saturated to the point that the amplifier cannot meet it's gain target as it has reached it's maximum output power. Excessive Input Power, Laser Bias Current Failure, and High Temperature alarms may also be present in this scenario. Please review the information for the Excessive Input Power alarm for further recommended actions. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
3 - 50
ONLINE 7000/9000/11000
TM
TRANSMITTER FAILURE POST VGA

Explanation This alarm indicates that the amplifier is unable to come within 2 dB of its expected gain. Affected Object Alarm Type Default Severity Recommended Action Post VGA Circuit Pack Equipment Critical Typically, this alarm is the result of the result of excessive input power, where the input of the amplifier is saturated to the point that the amplifier cannot meet it's gain target as it has reached it's maximum output power. Excessive Input Power, Laser Bias Current Failure, and High Temperature alarms may also be present in this scenario. Please review the information for the Excessive Input Power alarm for further recommended actions. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
TRANSMITTER FAILURE PRE VGA

Explanation This alarm indicates that the amplifier is unable to come within 2 dB of its expected gain. Affected Object Alarm Type Default Severity Recommended Action Pre VGA Circuit Pack Equipment Critical Typically, this alarm is the result of the result of excessive input power, where the input of the amplifier is saturated to the point that the amplifier cannot meet it's gain target as it has reached it's maximum output power. Excessive Input Power, Laser Bias Current Failure, and High Temperature alarms may also be present in this scenario. Please review the information for the Excessive Input Power alarm for further recommended actions. Contact CIENA Worldwide Customer Services and Support if further assistance is required.
TRANSMITTER FAILURE TRIB TRANSMITTER FAILURE LINE

Explanation A failure in the transmitter hardware has been detected. CP Equipment Critical WCI CP Replace the affected circuit pack. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action
TRIB OPTICAL MONITORING NOT SUPPORTED

Explanation Raised when a new threshold is set on the All-Rate WCI transceiver. Facilities: Trib Communications Minor All-rate WCI CP Not applicable. Affected Object Alarm Type Default Severity Associated Equipment Recommended Action
3 - 51
3
ALARM CLEARING PROCEDURES UNDERLYING RESOURCE UNAVAILABLE
Explanation This alarm indicates that for the affected facility, a provisioned circuit pack is missing. This alarm will be accompanied by a Replaceable Unit Missing alarm. Affected Object Alarm Type Default Severity Recommended Action Facilities: Line, Facilities: Trib Communications Minor Investigate and resolve the Replaceable Unit Missing alarm
ONLINETM7000/9000/11000
USER ALARMS
Explanation The 12 User Alarms represent the 12 different alarms (eight alarms in an ONLINE 7000 Transport Platform) raised outside of the network element, for example a fire alarm, power surge, flooding, air conditioning or fan failure, etc. The Alarm I/O card has 12 different detectors to receive inputs from customer equipment that raise User Alarms. The additional text field must be used to specify a meaningful description of the alarm. For more information, refer to the chapter USER ALARMS. Affected Object Alarm Type Default Severity Recommended Action Network Element Environmental Minor Not applicable.
VOA FAILURE
Explanation This alarm is raised if the power read at the output PIN diode did not change by more than .2 dB after 50 steps while the affected VOA is operating in closed loop mode. Affected Object Alarm Type Default Severity Recommended Action PMM, CWDM-U, or OLM CP Equipment Major Replace the CP.
VOA MOTOR MISSING STEPS

Explanation This alarm is raised if more than twenty percent of the last 200 steps have failed. Affected Object Alarm Type Default Severity Recommended Action PMM, CWDM-U, or OLM CP Equipment Minor Replace the CP.
VOA MOTOR NOT STEPPING

Explanation This alarm is raised if twenty consecutive steps fail. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Minor Replace the CP.
3 - 52
ONLINE 7000/9000/11000
TM
VOA POT FAILURE

Explanation This alarm is raised if the POT (potentiometer used to monitor the VOA setup position) voltage read is greater than 10 mV from its upper or lower limit. Affected Object Alarm Type Default Severity Recommended Action CP Equipment Major Replace the CP.
WAVELENGTH MANAGEMENT UNAVAILABLE

Explanation Due to an issue with a prerequisite condition (described below), the ability to manage wavelengths and unlock WCI line-side lasers has been disabled. The additional text field describes the specific cause of the alarm. The alarm is cleared when the cause no longer exists. Additional text may include the following messages:
! ! ! ! !
Power not converged Ring map unknown Channel table unknown Power control not ready (for example, a CP containing a VOA is not up and running). WCI control not ready
Table 3-2 lists corrective actions based on the additional text field.
Table 3-2. Corrective actions for Wavelength Management Unavailable alarm Additional Text Power not converged
! ! !
Corrective Actions Check for reasons for the Power not converged alarm. Check that the subnetwork map is provisioned. Check that signaling converged Check if subnetwork map is provisioned. Check the local node type. Check if any circuits are provisioned. Check if circuits are unlocked. Remotely warm reboot the OSC CP Check if all CPs containing VOA are up and running. Check if there are working side regens in the node and the node is isolated. Check if the RSM is up and running. Check is signaling has converged.
Ring Map Unknown Channel Table Unknown Power Control Not Ready WCI Control Not Ready RSM Not Ready
! ! ! ! ! ! !
! !
3 - 53
3
Affected Object Alarm Type Default Severity Recommended Action Network element Communications Major Refer to the additional text.
ONLINETM7000/9000/11000
WEST AUDIT FAILURE

Explanation This alarm is raised when the audit engine in the ADM circuit pack is not able to communicate with its west neighbor. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Verify continuity to the west neighbor.
WEST DEFAULT K BYTE

Explanation This alarm is raised when the west side of the ADM pair has received a default K byte in three consecutive frames. A default K byte is an indication of a misconfigured node. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communications Major Verify continuity and node protection provisioning and make adjustments as necessary to clear the alarm.
WEST ENUT TABLE MISMATCH

Explanation This alarm is raised when the audit engine in the ADM circuit pack detects a mismatch of the ENUT table with the west neighbor. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major
3 - 54
ONLINE 7000/9000/11000
TM
WEST IMPROPER APS CODE

Explanation This alarm is raised when the west side of the ADM pair has received APS code which is not consistent with the state of the receiving node. Affected Object Alarm Type Default Severity ADM Circuit Pack Communication Major
WEST INCONSISTENT APS CODE

Explanation This alarm is raised when the west side of the ADM pair is observing that out of 12 frames, no three frames contain identical APS code. Affected Object Alarm Type Default Severity ADM Circuit Pack Communication Major
WEST INTERFACE SIDE MISMATCH

Explanation This alarm is raised when the audit engine of the ADM circuit pack is provisioned to the same interfaceSide as the west neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major When provisioning the SONET BLSR protection, the user must identify the west and east side of the ADM pair of ports involved in the protection. Verify the west and east side is provisioned correctly on both nodes and verify fiber connections.
WEST NODE ID MISMATCH

Explanation This alarm is raised when the west side of the ADM pair has received three consecutive and identical frames that contain a source node ID that does not match any entry in the ring map. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major Verify the node ID and ring map provisioning to resolve any inconsistencies.
WEST PROTECTION SWITCH FAILURE

Explanation This alarm is raised by the BLSR switch engine when an attempt to switch had failed. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Communication Major This alarm will clear when the switching condition does not exist any longer or the switching was completed.
3 - 55
3
ALARM CLEARING PROCEDURES WEST RING MAP MISMATCH
Explanation This alarm is raised when the audit engine of the ADM circuit pack detects its ring map is different from its west neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Compare the local and west neighbors ring map to identify any inconsistencies.
ONLINETM7000/9000/11000
WEST RING MAP ID MISMATCH

Explanation This alarm is raised when the audit engine of the ADM circuit pack detects an ID from its west neighbor which does not match the ring map. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major The additional text field for the alarm will indicated the neighbors ring map ID. Use this information to correct the ring map inconsistencies.
WEST SQUELCH TABLE MISMATCH

Explanation This alarm is raised by the audit engine of the ADM circuit pack when its squelch table id different from its west neighbors. Affected Object Alarm Type Default Severity Recommended Action ADM Circuit Pack Processing Major Verify squelch tables from the local node and west neighbor. The additional text field associated with the alarm will indicate the first timeslot where the mismatches start.
3 - 56
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
APPENDIX A ALARM MESSAGE LIST

Table A-1. List of Alarms Affected Object Alarm Card Alarm Card Power Entry Card External Sync reference object Circuit Pack/ Network Element Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Default Severity Minor Warning Major Major Type Environmental Environmental Equipment Communications Probable Cause Alarm Card Failure BER Test Running Power Problem AIS (Alarm Indication Signal) Clearing Procedure page 3-1 page 3-1 page 3-36 page 3-1
Warning
Equipment
Diagnostics Failures
page 3-4
Major Minor Minor Major Minor Major Major Major Major Major Major Major Major Major Major Major
Equipment Equipment Equipment Processing Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment
Diagnostics Failure FPGA Program Failure Card Provisioning Mismatch Communications Failure DCC Link Failure Drive Mount Failure East Audit Failure East Default K Byte East ENUT Table Mismatch East Improper APS Code East Inconsistent APS Code East Interface Side Mismatch East Node ID Mismatch East Protection Switch Failure East Ring Map Mismatch East Ring Map ID Mismatch East Squelch Table Mismatch
page 3-4 page 3-2 page 3-2 page 3-4 page 3-5 page 3-5 page 3-6 page 3-6 page 3-6 page 3-6 page 3-6 page 3-7 page 3-7 page 3-7 page 3-7 page 3-7
A-1
A
ALARM MESSAGE LIST ONLINETM7000/9000/11000
Table A-1. List of Alarms (Continued) Affected Object Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Default Severity Major Critical Minor Minor Major Critical or Major Major Warning Warning Warning Critical Type Equipment Equipment Equipment Equipment Equipment Communications or Equipment Equipment Equipment Processing Processing Equipment Probable Cause EDFA Failure EEPROM Data Error Ethernet Link A Failure Ethernet Link B Failure Ethernet Switch Error Ethernet Switch Failure Excessive Input Power Excessive Input Power Line Excessive Input Power Trib External Reference Failed SYNC (A/B) Fast Start Forced Switch Forced Switch On Line Port Forced Switch On Trib Port FPGA Failure Line FPGA Failure Trib FPGA Power Failure Line FPGA Power Failure Trib Free Run High Order Path AIS High Order Path Remote Failure Indication High Order Path Trace Identifier Mismatch High Peak Voltage Violation High Temperature Holdover HUB OSC Mismatch Indeterminate Lockout of Protection On Line Port Lockout of Protection On Trib Port page 3-17 page 3-8 page 3-8 page 3-8 page 3-9 page 3-9 Clearing Procedure
Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack
page 3-11 page 3-11 page 3-12 page 3-12 page 3-11
Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack
Warning Warning Warning Critical Major Minor Warning Minor Minor Warning
Equipment Communications Communications Communications Communications Equipment Equipment Equipment Processing error Processing error
page 3-12 page 3-12 page 3-13 page 3-13 page 3-13 page 3-14 page 3-14 Page 3-13
A-2
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
Table A-1. List of Alarms (Continued) Affected Object Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Default Severity Warning Minor Major Minor Minor Minor Warning Warning Warning Critical Critical/ Minor Minor Critical Major Major Warning Major Major Major Critical (Note 1) Minor (Note 1) Critical Minor Type Processing error Equipment Communications Equipment Equipment Equipment Processing error Communications Communications Processing error Communications Equipment Equipment Equipment Equipment Communications Equipment Communications Communications Communications Equipment Equipment Equipment Equipment Equipment Probable Cause Lockout of Working On Line Port Lockout of Working On Trib Port Low Memory Resource Low Peak Voltage Violation Low System Resource Disk Space Low System Resource Handle Loss Values Out Of Range Manual Switch On Line Port Manual Switch On Trib Port Multiplex Section AIS Multiplex Section Remote Failure Indication Node in Hitless State OCH AIS On Line Port OOS Diagnostics Performed Optical Switch Failure OSC4080 Device Failure Out of Frame Path Remote Failure Indication Peer Communications Failure Reference Failed Reference Out of Range Regenerator Section Trace Identifier Mismatch Replaceable Unit Missing Replaceable Unit Problem Replaceable Unit Type Mismatch Shelf ID Mismatch Shelf Interconnect Failure Clearing Procedure page 3-17 page 3-27 page 3-27 page 3-27 page 3-27 page 3-26 page 3-28 page 3-28 page 3-29 page 3-29 page 3-30 page 3-30 page 3-31 page 3-31 page 3-32 page 3-33 page 3-34 page 3-38 page 3-39 page 3-39 page 3-39 page 3-40 page 3-40 page 3-41 page 3-41
A-3
A
Table A-1. List of Alarms (Continued) Affected Object Circuit Pack Circuit Pack Circuit Pack Default Severity Major Major Critical/ Major/ Minor Critical Minor Major Critical/ Minor Critical Critical Critical Critical Major Minor Minor Major Major Major Major Major Major Major Major Major Major Major Major Type Communications Processing Error Processing Error Probable Cause Signal Frequency Invalid Software Download Failure Software Environment Problem Clearing Procedure page 3-42 page 3-43 page 3-43
Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack Circuit Pack
Equipment Equipment Equipment Communications Equipment Equipment Equipment Equipment Equipment Equipment Equipment Equipment Processing error Communications Processing error Communications Communications Processing Communications Communications Processing error Processing error Processing error
Synchronization Failure Temperature Out Of Range Temperature Sensor Failure Trail Trace Mismatch Transmitter Failure Transmitter Failure Post VGA Transmitter Failure Pre VGA Transmitter Failure Trib, Line VOA Failure VOA Motor Missing Steps VOA Motor Not Stepping VOA POT Failure West Audit Failure West Default K Byte West ENUT Table Mismatch West Improper APS Code West Inconsistent APS Code West Interface Side Mismatch West Node ID Mismatch West Protection Switch Failure West Ring Map Mismatch West Ring Map ID Mismatch West Squelch Table Mismatch
page 3-45 page 3-46 page 3-45 page 3-50 page 3-50 page 3-51 page 3-51 page 3-51 page 3-52 page 3-52 page 3-52 page 3-53 page 3-54 page 3-54 page 3-54 page 3-55 page 3-55 page 3-55 page 3-55 page 3-55 page 3-56 page 3-56 page 3-56
A-4
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
Table A-1. List of Alarms (Continued) Affected Object Shelf Default Severity Minor/ Major (Note 2) Major Major Critical or Minor Major Minor Critical Critical Major Major Critical Minor Critical Minor/ Major/ Critical (Note 3) Major Major Major Type Environmental Probable Cause Cooling Fan Failure Clearing Procedure page 3-3
Shelf Shelf Network Element Network Element Network Element Network Element Network Element Network Element Network Element Network Element Network Element Network Element Network Element
Environmental Equipment Communications or Processing error Processing error Processing error Processing error Processing error Communications Processing error Processing error Equipment Processing error Equipment
Power Entry Failure Shelf Type Mismatch Configuration Error
page 3-35 page 3-41 page 3-3
Duplicate SIDs in Subnet Memory Mismatch Node in Recovery State Node in Selective Restore ODPR Protection Unavailable OSPR Protection Unavailable PMA Is Locked Power ACO Card Failure Power Management Problem Program Memory Failure
page 3-5 page 3-28
page 3-29 page 3-30 page 3-31 page 3-34 page 3-35 page 3-35 page 3-37
Network Element Network Element Network Element
Equipment Processing Error Processing Error
Program Memory Missing Software Download Failure Software Environment Problem
page 3-37 page 3-43 page 3-43
A-5
A
Table A-1. List of Alarms (Continued) Affected Object Network Element Network Element Network Element Network Element Network Element Default Severity Minor Major Major Minor Major Type Processing Error Processing Processing Environmental Communications Probable Cause Storage Capacity Problem Topology Discovering Topology Mismatch User Alarms 1-12 Wavelength Management Unavailable page 3-48 page 3-48 page 3-52 page 3-53 Clearing Procedure
A-6
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
Table A-1. List of Alarms (Continued) Affected Object Facilities: Trib Default Severity Critical Warning Critical Critical Critical Major Critical Warning Critical Critical Warning Warning Critical Warning Minor Critical Major Major Critical Major Critical Critical Minor Minor Type Communications Processing error Communications Communications Communications Equipment Communications Communications Communications Communications Processing error Processing error Communications Processing error Communications Equipment Communications Communications Communications Communications Communications Communications Communications Communications Probable Cause Excessive Data Rate Forced Switch Excessive Data Rate Excessive Input Power Invalid Data Rate Laser Bias Current Failure Trib Line AIS Trib Loopback Loss of Clock Trib Loss of Frame Trib Lockout of Protection Lockout of Working Loss of Signal Trib Manual Switch Protection Path Failure Receiver Failure Trib Reference Failed Reference Out of Range Section Trace Mismatch Trib Signal Degrade BER Trib Signal Fail BER Signal Squelched Trib Trib Optical Monitoring Not Supported Underlying Resource Unavailable Clearing Procedure page 3-9 page 3-12 page 3-9 page 3-9 page 3-15 page 3-15 page 3-16 page 3-18 page 3-18 page 3-18 page 3-17 page 3-17 page 3-20 page 3-28 page 3-37 page 3-38 page 3-38 page 3-39 page 3-40 page 3-42 page 3-42 page 3-42 page 3-51 page 3-52
A-7
A
Table A-1. List of Alarms (Continued) Affected Object OSC Facilities Default Severity Major Critical Critical Critical Critical Major Critical Major Critical Critical Type Equipment Communications Communications Communications Communications Processing error Equipment Communications Communications Communications Probable Cause Laser Bias Current Failure Line AIS Loss of Clock Loss of Frame Loss of Signal Peer Communications Failure Receiver Failure Signal Degrade BER Signal Fail BER Underlying Resource Unavailable Clearing Procedure page 3-15 page 3-16 page 3-18 page 3-18 page 3-19 page 3-34 page 3-38 page 3-42 page 3-42 page 3-52
A-8
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
Table A-1. List of Alarms (Continued) Affected Object Facilities: Line Default Severity Critical Warning Major Warning Warning Warning Warning Warning Critical Critical Critical Critical Critical Critical Warning Warning Warning Critical Critical Critical Critical Major Critical Major Critical Critical Minor Type Communications Processing error Equipment Communications Communications Processing error Processing error Communications Communications Communications Communications Communications Communications Communications Processing error Communications Communications Communications Communications Equipment Communications Processing Error Communications Communications Communications Communications Communications Probable Cause Excessive Input Power Forced Switch Laser Bias Current Failure Line Line AIS Line Line Remote Failure Indication Lockout of Protection Lockout of Working Loopback Loss of Clock Line Loss of Frame Line Loss of Signal Line Loss of Signal Preamp Loss of Signal Postamp Loss of Signal WPS Manual Switch Path Remote Failure Indication Path AIS Path Trace Mismatch Payload Mapping Failure Receiver Failure Line Section Trace Mismatch Line Signaling Failure Signal Squelched Line Signal Degrade BER Line Signal Fail BER Transmit Fail Underlying Resource Unavailable Clearing Procedure page 3-9 page 3-12 page 3-15 page 3-16 page 3-16 page 3-17 page 3-17 page 3-18 page 3-18 page 3-18 page 3-21 page 3-24 page 3-24 page 3-26 page 3-28 page 3-33 page 3-32 page 3-33 page 3-33 page 3-38 page 3-40 page 3-43 page 3-42 page 3-42 page 3-42 page 3-50 page 3-52
A-9
A
Table A-1. List of Alarms (Continued) Affected Object Facilities: All Default Severity Warning Type Communications Probable Cause Threshold Crossed OPR, OPR Line, OPR Trib Threshold Crossed OPT, OPT Line, OPT Trib Threshold Crossed LBC Line, LBC Trib Threshold NM Crossed CRC Threshold NM Crossed CV_L, CV_L Line, CV_L Trib, CV_P Threshold NM Crossed CV_S, CV_S Line, CV_S Trib, CVs, CVs_ch1, CVs_ch2 (Code Violations) Threshold NM Crossed ES_L, ES_L Line, ES_L Trib, ES_P Threshold NM Crossed ES_S, ES_S Line, ES_S Trib (Errored Seconds) Threshold NM CrossedFC_L, FC_LLine, FC_LTrib, FC_P Threshold NM Crossed FCS (Frame Check Sequence) Threshold NM Crossed FE Threshold NM CrossedGbE_CRC_IN, GbE_CRC_OUT, GbE_DE, GbE_FRAGS_IN, GbE_FRAGS_OUT, GbE_JABBER_IN, GbE_JABBER_OUT, GbE_LOCS, GbE_LOCSOnLine, GbE_LOCSOnTribP Threshold NM Crossed MS_BBE, MS_EB, MS_ES, MS_FC, MS_SES, MS_UAS Threshold NM Crossed RS_BBE, RS_EB, RS_ES, RS_SEFS, RS_SES Clearing Procedure Page 3-41
A - 10
ONLINE 7000/9000/11000
TM
ALARM MESSAGE LIST
Table A-1. List of Alarms (Continued) Affected Object Facilities: All Default Severity Warning Type Communications Probable Cause Threshold NM Crossed SES_L, SES_LLine, SES_LTrib, SES_P Threshold NM Crossed SES_S, SES_S Line, SES_S Trib (Severely Errored Seconds) Threshold NM Crossed SEFS_S, SEFS_Line, SEFS_Trib (Severely Errored Frame Seconds) Threshold NM Crossed TCBE_OnLinePort, TCBE_OnTribPort Threshold NM Crossed UAS_L, UAS_L Line, UAS_L Trib, UAS_P Threshold NM Crossed UCBEOnLinePort, UCBEOnTribPort Peer Communications Failure Clearing Procedure page 3-47
Datawire Facilities
Minor
Communications
page 3-34
NOTE:
Severity is critical if the circuit pack supports a data path (e.g., WCI, CWDM) and the condition is service affecting, major for RSM if backup equipment is present and traffic is protected, and minor for circuit packs that do not support data paths (e.g., power entry, fan). The default severity of a Cooling Fan Alarm is minor for a single alarm, or major if both fans fail on a 23" shelf. The default severity of a Program Memory Failure is minor if the alternate text is Alternate drive, major if the alternate text is Current drive, and critical if the alternate text is Alternate drive and current drive. If an alarm appears that does not appear in this table, please contact customer service at 1-877-ON ASSIST (1-877-662-7747).
NOTE:
NOTE:
NOTE:
A - 11
A
A - 12
I
ONLINETM7000/9000/11000
INDEX
INDEX
Excessive BER 3-42 Excessive Data Rate 3-9 Excessive Input Power 3-9 External Reference Failed SYNC (A/B) 3-11
A
AIS (Alarm Indication Signal) 3-1 Alarm Card Failure 3-1 Alarms clearing procedures 3-1
F
Fast Start 3-11 Forced Switch 3-12 Forced Switch On Line Port 3-12 Forced Switch On Trib Port 3-12 FPGA Failure 3-11 FPGA failure 3-42 FPGA Power Failure 3-11 FPGA power failure 3-11 Free Run 3-12
B
BER Test Running 3-1
C
Card Provisioning Mismatch 3-2 Communications Failure 3-2 Cooling fan failure 3-3
H
High Order Path AIS 3-12 High Order Path Remote Failure Indication 3-13 High Order Path Trace Identifier Mismatch 3-13 High Peak Voltage Violation 3-13 High Temperature 3-14 Holdover 3-14 HUB OSC Mismatch 3-14
D
DCC Link Failure 3-4 Diagnostics Failure 3-4 Diagnostics Failure FPGA Program Failure 3-4, 3-5 Drive Mount Failure 3-5 Duplicate SIDs in Subnet 3-5
E
East Audit Failure 3-5 East Default K Byte 3-6 East ENUT Table Mismatch 3-6 East Improper APS Code 3-6 East Inconsistent APS Code 3-6 East Interface Side Mismatch 3-6 East Node ID Mismatch 3-7 East Protection Switch Failure 3-7 East Ring Map ID Mismatch 3-7 East Ring Map Mismatch 3-7 East Squelch Table Mismatch 3-7 EEPROM Data Error 3-8 Ethernet Link Failure 3-8 Ethernet Switch Error 3-8 Ethernet Switch Failure 3-9 Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
I
Invalid Data Rate 3-15
L
Laser Bias Current Failure 3-15 Laser bias current failure 3-42 Laser disabled 3-42 Laser Wavelength Lock Failure 3-16 Line AIS 3-16 Line Remote Failure Indication 3-16 Lockout of Protection 3-17 Lockout of Protection On Line Port 3-17 Lockout of Protection On Trib Port 3-17 Lockout of Working 3-17
I-1
I
INDEX
Lockout of Working On Line Port 3-17 Lockout of Working On Trib Port 3-17 Loss of Clock 3-18 Loss of Frame 3-18 Loss of frame 3-42 Loss of frame line 3-18 Loss of Pointer 3-19 Loss of Signal 3-19 WPS 3-26 Loss Values Out of Range 3-26 Low Peak Voltage Violation 3-27 Low System Resource Disk Space 3-27 Low System Resource Handle 3-27 Low System Resource Memory 3-27
ONLINETM7000/9000/11000
Payload Mapping Failure 3-33 Peer Communications Failure 3-34 Plane A communications failure 3-36, 3-46, 352, 3-53 PMA Is Locked 3-34 Power ACO Card Failure 3-35 Power Entry Failure 3-35 Power Management Problem 3-35 Power Problem 3-36 Processor Busy 3-36 Program Memory Failure 3-37 Program Memory Missing 3-37 Protection Path Failure 3-37 Provisioning Mismatch 3-38
M
Manual Switch 3-28 Line and/or Trib 3-28 Memory Mismatch 3-28 Multiplex Section AIS 3-28 Multiplex Section Remote Failure Indication 3-29
R
Receiver Failure 3-38 Reference Failed 3-38 Reference Out of Range 3-39 Regenerator Section Trace Identifier Mismatch 339 Replaceable Unit Missing 3-39 Replaceable Unit Problem 3-40
N
Node in Hitless State 3-29 Node in Selective Restore 3-29
S
Section Trace Mismatch 3-40 Shelf ID Mismatch 3-41 Shelf Interconnect Failure 3-41 Shelf Type Mismatch 3-41 Signal Degrade BER 3-42 Signal degrade BER 3-42 Signal Fail BER 3-42 Signal Frequency Invalid 3-42 Signal Squelched 3-42 Signaling Failure 3-43 Software Download Failure 3-43 Software Environment Problem 3-43 Synchronization Failure 3-45
O
OCH AIS On Line Port 3-30 ODPR Protection Unavailable 3-30 OOS Diagnostics Performed 3-30 Optical Switch Failure 3-31 OSC4080 Device Failure 3-31 OSPR Protection Unavailable 3-31 Out of Frame 3-32
P
Path AIS 3-32 Path Remote Failure Indication 3-33 Path Trace Mismatch 3-33
T
Temperature Out Of Range 3-46 Alarm and Trouble Clearing Manual April 30, 2003 - Revision A 009-2003-078
I-2
I
ONLINETM7000/9000/11000
Temperature Sensor Failure 3-45 Threshold Crossed LBC 3-46 Threshold Crossed OPR 3-46 Threshold Crossed OPT 3-46 Threshold NM Crossed Alarms 3-47 Topology Discovering 3-48 Topology Mismatch 3-48 Trail Trace Mismatch 3-50 Transmit Fail 3-50 Transmitter Failure 3-50 Transmitter Failure Line 3-51 Transmitter Failure Post VGA 3-51 Transmitter Failure Pre VGA 3-51 Transmitter Failure Trib 3-51 Trib Optical Monitoring Not Supported 3-51
INDEX
U
Underlying Resource Unavailable 3-52 User Alarms 3-52 User alarms 2-1
V
VOA Failure 3-52 VOA Motor Missing Steps 3-52 VOA Motor Not Stepping 3-52 VOA POT Failure 3-53
W
Wavelength Management Unavailable 3-53 West Audit Failure 3-54 West Default K Byte 3-54 West ENUT Table Mismatch 3-54 West Improper APS Code 3-55 West Inconsistent APS Code 3-55 West Interface Side Mismatch 3-55 West Node ID Mismatch 3-55 West Protection Switch Failure 3-55 West Ring Map ID Mismatch 3-56 West Ring Map Mismatch 3-56 West Squelch Table Mismatch 3-56
I-3
I
INDEX ONLINETM7000/9000/11000
I-4

009-2003-078 Alarm and Trouble Clearing PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

009-2003-078 Alarm and Trouble Clearing PDF

Uploaded by

Copyright:

Available Formats

ONLINE 7000/9000/11000

ALARM AND TROUBLE CLEARING MANUAL

CIENA Part Number: 009-2003-078 Revision A April 30, 2003

CIENA CONFIDENTIAL AND PROPRIETARY

CIENA CONFIDENTIAL AND PROPRIETARY

PREFACE CONTENT ORGANIZATION

Jurisdiction Federal, US Federal, US International International International

Type Regulation Guidelines Standard Standard Standard

Part 15 of the Federal Communications Commission (FCC): Interference

Environmental Impact Statement

Telcordia Document Standards

RELEASE NOTES AND DOCUMENT UPDATES

CONTACTING CIENA SYSTEM TECHNICAL FIELD RETURN INFORMATION

E-mail: north.america.support@ciena.com E-mail: europe.support@ciena.com

E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com E-mail: sales@ciena.com

CIENA retains the sole right to determine if a problem is an emergency or a nonemergency.

LAB EVALUATION AND FIELD TRIALS

THIS PAGE INTENTIONALLY LEFT BLANK

THIS PAGE INTENTIONALLY LEFT BLANK

Figure 1-1. Figure 2-1. Figure 2-2.

THIS PAGE INTENTIONALLY LEFT BLANK

THIS PAGE INTENTIONALLY LEFT BLANK

CHAPTER 1 FAULT MANAGEMENT

COMMON ALARM SOURCES

Fiber breaks Equipment failure Software failure Operator error

CLI Alarm Type View

Figure 1-1. Viewing Alarm Type Information

The alarm severity meanings are as described in Table 1-2.

CIT Alarm Tools

Probable Cause Acknowledge

Operator Type Notes

Custom Alarm Report (HTML)

Custom Alarm Report (CSV)

Complete Alarm Report (HTML)

Complete Alarm Report (CSV)

CLI Alarm Tools

TL1 ALARM TOOLS

*C = Critical ** = Major *^ = Minor A^ = Clear

To View All Alarms Using TL1

Autonomous Alarm Messages in TL1

To view user alarms using TL1

THIS PAGE INTENTIONALLY LEFT BLANK

CHAPTER 2 USER ALARMS

USER ALARMS DESCRIPTION

USER ALARM DIALOG BOX

Figure 2-1. User Alarms Dialog Box

USER ALARM OUTPUTS

Figure 2-2. Enable/Disable User Alarm Outputs Dialog Box

THIS PAGE INTENTIONALLY LEFT BLANK

ALARM CLEARING PROCEDURES

CHAPTER 3 ALARM CLEARING PROCEDURES

Alarms are listed alphabetically in this section by Probable Cause.

AIS (ALARM INDICATION SIGNAL)

ALARM CARD FAILURE

BER TEST RUNNING

ALARM CLEARING PROCEDURES

COOLING FAN FAILURE

DIAGNOSTICS FAILURE COMPONENT MGR_TEST

ALARM CLEARING PROCEDURES

DIAGNOSTICS FAILURE FPGA PROGRAM FAILURE

DIAGNOSTICS FAILURE SLOT MISMATCH

DRIVE MOUNT FAILURE

DUPLICATE SIDS IN SUBNET