Ticket Details

Subject: Montreal optical network issue
Category: Outage
TicketID: 20240215-001
Start Time: 2024-02-14 21:47:34 EST (2024-02-15 02:47:34 UTC)
End Time: 2024-02-15 23:10:00 EST (2024-02-16 04:10:00 UTC)


TICKET HISTORY:

=== Updated by: Richard Klinger on 2024-02-16 10:35:11 EST (2024-02-16 15:35:11 UTC) ===

Closing ticket

=== Updated by: Richard Klinger on 2024-02-16 10:34:30 EST (2024-02-16 15:34:30 UTC) ===

Service were restored last night after fiber was repaired. Span loss has been restored to prior values indicating a good splice. No further outage expected related to this incident.

=== Updated by: Richard Klinger on 2024-02-15 19:28:31 EST (2024-02-16 00:28:31 UTC) ===

Fiber repair work has begun.  Fiber provider has approximated service restoration within the next three hours.

=== Updated by: Richard Klinger on 2024-02-15 14:56:17 EST (2024-02-15 19:56:17 UTC) ===

Fiber team forecasts electrical and fire repairs to be complete within 4 hours at which time fiber work will begin.

=== Updated by: Richard Klinger on 2024-02-15 10:04:00 EST (2024-02-15 15:04:00 UTC) ===

Fiber team is on site, in a hold-state.  Authorization to begin repairs after fire damage from electricity and fire teams.  No ETR is known. 

=== Updated by: Richard Klinger on 2024-02-15 07:45:33 EST (2024-02-15 12:45:33 UTC) ===

Requesting updates from fiber provider.  Due to vendor process changes there was a delayed in response. 

=== Created by: Richard Klinger on 2024-02-14 21:03:26 EST (2024-02-15 02:03:26 UTC) ===

We have observed a fiber outage in Montreal and are investigating.  

The following services are being affected:

Wavelength Service:

100G Montreal-NYC

BGP Peering:
GEANT (Montrel-MANLAN)
Internet2 (Montrel-MANLAN)
ESNet (Montrel-MANLAN)
Qatar (Montrel-MANLAN)
UBUNTUNET (Montrel-MANLAN)
NYSERNet (Montrel-MANLAN)
SINET (Montrel-MANLAN)
NORDUnet (Montrel-MANLAN)

L2 Circuits:

  10050CS01-CIENA_OTWA-Amsterdam_UVA-MTRL2-MTRL2  
   90120CS00-SURFNET-NYCN1-AMST1
    90120CS01-SURFNET-NYCN1-AMST1
    90222CS00-Internet2-NYCN1-AMST1
    10903CS01-KIAE-CHCG1-AMST1
    10903CS02-KIAE-MTRL2-AMST1
    10903CS03-KIAE-NYCN1-AMST1
    93330CS10-SURFNET-NYCN1-AMST1
    10359CS01-PerfSonar-MTRL2-AMST1
    91074CS00-NKN-NYCN1-AMST1
    91075CS01-NYCN1-AMST1-NOAA_ISRO_NKN
    opennsa-SCDTN-icair-1135-1793
    opennsa-icair-ANA1-1795-1156
    91250CS00-KACST-NYCN1-AMST1
    91270CS00-OMREN-NYCN1-AMST1
    opennsa-AMST1-CHCG1-1730-1730
    opennsa-AMST1-CHCG1-1769-1769
    10111CS02-KISTI-TORO1-MTRL2-KISTI_CERN
    opennsa-perfS-ANA1-1785-2000
    opennsa-icair-ANA1-1788-2007
    vrf_LHCONE NORDUNet
    92020CS00-NORDUNET-NYCN1-AMST1
    10362CS01-GLIF-CHCG1-MTRL2-DTN_Starlight_Netherlight
    10228CS03-SFU-VNCV1-MTRL2
    92137CS00-CSTNET-NYCN1-AMST1
    92801CS00-SINET-NYCN1-AMST1
    92802CS00-SINET-NYCN1-AMST1
    92803CS00-SINET-NYCN1-AMST1
    92804CS00-SINET-NYCN1-AMST1
    92805CS00-SINET-NYCN1-AMST1
    93011CS01-GEANT-CHCG1-AMST1
    opennsa-AMST1-NYCN1-3501-3501
    opennsa-AMST1-NYCN1-3502-3502
    10367CS01-Internet2-NYCN1-AMST1-ITHAKA-KB