Title: Update software on all Cisco ONS nodes

Description: This NSA report dated 11 April 2014 describes the difficulties with the network switches the agency had compromised on Cisco devices in order to collect data from Cisco customers: see the book No Place To Hide, 13 May 2014.

Document: Page 150


(Report generated on:4/11/2013 3:31:05PM )

NewCrossProgram | Active ECP Count: | i~~|

CrossProgram-1-13 New ECP Lead: I name redacted"!

Title of Change: Update Software on all Cisco ONS Nodes

Submitter: I name redacted I Approval Priority: C-Routine

Sitefsb APPLE1 : CLEVERDEVICE ProiectfsL No Project(s) Entered






Svstemlsl: Comms/Network : SubSvsternlsl: No Subsystem(s) Entered

Comms/Network :

Comms/Network :

Comms/Network :

Description of Change. ydate software on all Cisco Optical Network Switches.

Reason for Change: All of our Cisco ONS SONET multiplexers are experiencing a software bug

that causes them to intermittently drop out.

Mission Impact: The mission impact is unknown. While the existing bug doesn't appear to

affect traffic, applying the new software update could. Unfortunately, there is
now way to be sure. We can't simulate the bug in our lab and so it's
impossible to predict exactly what will happen when we apply the software
update. We propose to update one of the nodes in NBP-320 first to determine
if the update goes smoothly.

Recently we tried to reset the standby manager card in the HOMEMAKER
node. When that failed, we attempted to physically reseat It. Since it was the
standby card, we did not expect that would cause any problems. However,
upon reseating the card, the entire ONS crashed and we lost all traffic through
the box. It took more than an hour to recover from this failure.

The worst case scenario is that we have to blow away the entire configuration
and start from scratch. Prior to starting our upgrade, we will save the
configuration so that If we have to configure the box from scratch, we can
simply uploade the saved configuration. We estimate that we will be down for
no more than an hour for each node In the system.

Additional Info:

Last CCB Entry:

Programs Affected:

3/26/2013 8:16:13 AM I NAME REDACTED |

We have tested the upgrade in our lab and it works well. However, we can’t
repeat the bug in our lab, so we don't know if we will encounter problems when
we attempt to upgrade a node that is affected by the bug.

04/10/13 16:08:11 | NAME REDACTED

09 Apr Blarney CCB - Blarney ECP board approved

ECP lead: name redacted

Blarney Falrvlew Oakstar Stormbrew

No Related Work Tasks


Click to send permalink to address bar, or right-click to copy permalink.

Un-highlight all Un-highlight selectionu Highlight selectionh