Ticket Details

Subject: Optical network Chicgo Fiber
Category: Outage
TicketID: 20240325-001
Start Time: 2024-03-25 09:50:34 EDT (2024-03-25 13:50:34 UTC)
End Time: 2024-03-26 07:51:00 EDT (2024-03-26 11:51:00 UTC)


TICKET HISTORY:

=== Updated by: Richard Klinger on 2024-04-09 07:57:40 EDT (2024-04-09 11:57:40 UTC) ===

Closed Ticket

=== Updated by: Jun Jian on 2024-03-26 07:58:40 EDT (2024-03-26 11:58:40 UTC) ===

The fibre splicing has been completed. All the affected services are restored. 

=== Updated by: Jun Jian on 2024-03-25 21:13:25 EDT (2024-03-26 01:13:25 UTC) ===

The provider reported that a partially damaged 108-count fiber cable in Michigan City, IN will be repaired during an Urgent Maintenance Network Event on March 26, 2024, beginning 01:00 GMT. It is expected the service impacting portion of the fiber repair activity will last 6 hours. Updates will be sent out as soon as info becomes available. 

=== Updated by: Jun Jian on 2024-03-25 14:33:55 EDT (2024-03-25 18:33:55 UTC) ===

The provider Field Operations arrived at the site,  located and straightened a bent fiber, thus restoring some services. Additional investigation into the remaining impact is ongoing. 

=== Updated by: Jun Jian on 2024-03-25 13:35:15 EDT (2024-03-25 17:35:15 UTC) ===

Update from the provider: Further investigation has isolated the damage area to Michigan City. Field Operations are in route to the area to locate the damage, ETA 60 minutes. Splice and placement crews are engaged and in route to the area, approximate arrival estimate of 21:00 GMT. 

=== Updated by: Jun Jian on 2024-03-25 12:27:13 EDT (2024-03-25 16:27:13 UTC) ===

The provider is aware of a fiber cut in Chicago area, investigation is on going, ETR is not available currently.

=== Updated by: Richard Klinger on 2024-03-25 12:26:22 EDT (2024-03-25 16:26:22 UTC) ===

Fiber break identified by provider and they are working to repair.  No known ETR available yet.

=== Updated by: Jun Jian on 2024-03-25 11:32:57 EDT (2024-03-25 15:32:57 UTC) ===

An outage has been observed out side of Chicago which is affecting the optical network between Toronto and Chicago. Fibre cut is suspected and the provider has been contacted. 

The following wavelength services are being affected:

CHCG1-MTRL2-01
CHCG1-OTWA3-01
CHCG1-OTWA3-02
CHCG1-TORO1-05
WNDR1-TORO1-01

The following BGP peering are affected:

ESnet [Starlight] [AS293]
CERN [Starlight] [AS513]
Internet2 [Starlight] [AS11537]
STARTAP [Starlight] [AS10764]
MREN [Starlight] [AS22335]
ASGCNet [Starlight] [AS24167]
NASA-NISN [Starlight] [AS297]
KREONet2 [Starlight] [AS17579]
DREN [Starlight] [AS668]

the following L2 service are affected affected:

10354CS01-ICAIR_SDX_Starlight_Netherlight-TORO1-MTRL2
10111CS01-KISTI_CERN-TORO1-MTRL2
10903CS01-KIAE-CHCG1-AMST1
opennsa-AMST1-CHCG1-1730-1730
opennsa-AMST1-CHCG1-1769-1769
opennsa-icair-SCDTN-1784-1154

opennsa-icair-SCDTN-1791-1791

opennsa-icair-SCDTN-1792-1126

opennsa-icair-ANA1-1788-2007
opennsa-SCDTN-icair-1135-1793
opennsa-icair-ANA1-1795-1156
10362CS01-GLIF-CHCG1-MTRL2-DTN_Starlight_Netherlight
93011CS01-GEANT-CHCG1-AMST1

 

=== Created by: Richard Klinger on 2024-03-25 11:20:58 EDT (2024-03-25 15:20:58 UTC) ===

Suspected fiber break is affecting the circuits to Starlight Chicago.  No ETR is currently known but fiber provider has been engaged.

The following wavelength services affected:

CHCG1-MTRL2-01
CHCG1-OTWA3-01
CHCG1-OTWA3-02
CHCG1-TORO1-05
WNDR1-TORO1-01

The following BGP peering affected:

ESnet [Starlight] [AS293]
CERN [Starlight] [AS513]
Internet2 [Starlight] [AS11537]
STARTAP [Starlight] [AS10764]
MREN [Starlight] [AS22335]
ASGCNet [Starlight] [AS24167]
NASA-NISN [Starlight] [AS297]
KREONet2 [Starlight] [AS17579]
DREN [Starlight] [AS668]

the following L2 service affected:

10354CS01-ICAIR_SDX_Starlight_Netherlight-TORO1-MTRL2
11903CS01-CyberaOpenStack-EDMN1-CHCG1
10111CS01-KISTI_CERN-TORO1-MTRL2
10903CS01-KIAE-CHCG1-AMST1
91501CS01-TU_Darmstadt-AMST1-CHCG1-MAKI
opennsa-AMST1-CHCG1-1730-1730
opennsa-AMST1-CHCG1-1769-1769
opennsa-icair-ANA1-1788-2007
opennsa-SCDTN-icair-1135-1793
opennsa-icair-ANA1-1795-1156
10362CS01-GLIF-CHCG1-MTRL2-DTN_Starlight_Netherlight
92048CS00-SURFNET-CHCG1-AMST1-TNO_KISIT
92049CS00-SURFNET-CHCG1-AMST1-TNO_KISIT
93011CS01-GEANT-CHCG1-AMST1