Skip to main content

Service Restored: Firewall Issue impacting campus network

Submitted by keea2562 on

Start Date & Time

End Date & Time

Description

Service Update at 4:45 pm: Firewall service restored for HUM/RGNT/MUEN/ECON. 

Service Update at 4:18 pm: Networking services have been fully restored on these subnet firewalls in ENGR/ENGR2/PHYS.

Service Update at 4:00 pm: An emergency network upgrade needs to occur to address the issue with the campus firewall. Many campus buildings will be without network connectivity (wired and Wi-Fi) during this timeframe. Buildings include HLMS, GUGG, HEND, THTR, ECON, EKLC, DEN, EDUC, MCOL, COTT, ATLS, CHEM. VoIP phones will also be unavailable. The upgrade is expected to occur between 4 and 5 p.m.

Service Issue Updated at 12:41 PM: ENGR primary firewall has rebooted, failover has occurred to the backup unit but the same routing problem with OSPF affecting the HERM firewall is now being experienced on the ENGR firewall. VLAN's behind this network are now experiencing a service interruption. This would include the following firewalls:

ENGR

ENGR2

PHYS

 

Service Issue Updated at 11:39AM: BOTH HERM firewalls have been rebooted. Firewall networks in RGNT are working but firewall networks in ECON/MUEN/HUM continue to be down. Vendor continues investigating.

 

Service Issue Updated at 11:15AM: HERM Primary firewall is rebooting. We've confirmed that firewall networks behind HUM, ECON, MUEN are down. It is believed that networks behind the RGNT firewall are still operational at this time. Backup firewall will likely be rebooted after the primary recovers.

Service Issue Updated at 11:05AM:  Vendor has recommended an emergency reboot of the HERM firewall.

The firewall reboot will begin in the next 5 minutes and networks behind the firewall will be down for approximately 15-20 minutes during the reboot.


Service Issue reported: HERM Firewall is in a degraded state and is impacting customer traffic. We do not have a complete understanding of the full scope at this time but have confirmed networks in CIRES on the ECON firewall are impacted. Vendor is engaged.

List of affected networks:

HERM firewalls

HUM

ECON

RGNT

MUEN

 

ENGR and BIOT firewalls have begun exhibiting similar behavior as HERM. It is believed that traffic is not impacted in these locations at this time.