Ticket Details

Subject: Optical network Calgary - Kamloops
Category: Scheduled Maintenance
TicketID: 20230711-001
Start Time: 2023-07-10 23:01:43 EDT (2023-07-11 03:01:43 UTC)
End Time: 2023-07-14 14:20:11 EDT (2023-07-14 18:20:11 UTC)


TICKET HISTORY:

=== Updated by: Jun Jian on 2023-07-25 10:21:57 EDT (2023-07-25 14:21:57 UTC) ===


=== Updated by: Richard Klinger on 2023-07-14 14:59:35 EDT (2023-07-14 18:59:35 UTC) ===

Golden and adjacent sites are alarm free.  We are hands off and have left site.

=== Updated by: Richard Klinger on 2023-07-14 14:19:59 EDT (2023-07-14 18:19:59 UTC) ===

Work on Golden equipment is progressing.  We have restored traffic through card reboots.  Work is ongoing and will report back when we are hands off.

=== Updated by: Richard Klinger on 2023-07-13 14:06:15 EDT (2023-07-13 18:06:15 UTC) ===

Vendor dispatch is being coordinated with site escort.  We were informed that soonest escort can be arranged is Tuesday.  Will try to escalate. 

=== Updated by: Richard Klinger on 2023-07-13 14:05:15 EDT (2023-07-13 18:05:15 UTC) ===

Added Vendor Dispatch Ticket ID

=== Updated by: Richard Klinger on 2023-07-13 12:52:52 EDT (2023-07-13 16:52:52 UTC) ===

Added Vendor Ticket ID

=== Updated by: Richard Klinger on 2023-07-13 07:13:28 EDT (2023-07-13 11:13:28 UTC) ===

HVAC team has confirmed repair.  Next step will be to organize site visit to assess equipment state and attempt to bring it back online.  Working to arrange tech and access.  Soonest possible access is next business day but will take longer to arrange because of unknown equipment damage.

=== Updated by: Richard Klinger on 2023-07-12 22:51:00 EDT (2023-07-13 02:51:00 UTC) ===

HVAC failure has been confirmed.  The hut was reported temps exceeding 100C.  Site visit could happen this evening to determine state of equipment.

=== Updated by: Richard Klinger on 2023-07-12 17:48:48 EDT (2023-07-12 21:48:48 UTC) ===

Confirmed the status with site provider is assigned critical.  It is expected that the Western team will provide an update before the end of the western business day.  Service manager has been sending out requests for updates regularly and is now using DM to target members of the responsible team to get answers.  We will keep pushing.

=== Updated by: Richard Klinger on 2023-07-12 11:45:30 EDT (2023-07-12 15:45:30 UTC) ===

Engineer team has been engaged to determine if they have temp monitoring in the equipment suite.

=== Updated by: Richard Klinger on 2023-07-12 09:00:44 EDT (2023-07-12 13:00:44 UTC) ===

Service manager is working with the engineering team to investigate site heat issue in Golden BC.

=== Updated by: Richard Klinger on 2023-07-12 08:35:42 EDT (2023-07-12 12:35:42 UTC) ===

Ticket has not been picked up.  We have requested escalation and engaged service manager.

=== Updated by: Richard Klinger on 2023-07-11 18:28:09 EDT (2023-07-11 22:28:09 UTC) ===

Carrier has been engaged after escalations. No known ETR but we have been informed they are now beginning investigation.

=== Updated by: Richard Klinger on 2023-07-11 07:29:41 EDT (2023-07-11 11:29:41 UTC) ===

Updated ticket status to outage.  

=== Created by: Richard Klinger on 2023-07-11 07:09:19 EDT (2023-07-11 11:09:19 UTC) ===

There's an issue affecting the Calgary to Kamloops circuits.  We are investigating.

 

Affected network services:

VNCV1-CLGR2-06(BCNET 200G)