History / Recent Events
8th November 2023 - Replication Service Failure
A replication failure occured at 10.05am between DC1 and DC2 following a process fault in the replication service. Services were restarted.
A replication delay of approximately 20 minutes occured whilst services were restarted and re-synchronisation completed. No customer services were affected, and replication has recovered for all Live Services. A Full Services Suite Reboot occured out of hours at 8.50pm to ensure stability.
19th September 2023 - Windows Server Servicing Failure
A servicing failure occured during the installation of Microsoft Update KB5030213 resulting in a rollback of the Active Directory (Europe 2) PDC updates. The Failover Services were immediately activated whilst the primary DC was restored and corrected. No customers were affected during the failover or recovery stages, and all dependent services were re-routed. All services were restored at 11.29am on 20th September.
16th August 2023 - DC3 Hardware Failure Event
A Hardware Failure was detected in DC3 on 16th August 2023. Some services were suspended in DC3 and transferred to the alternate datacenter.
The effects included a failover to the assigned backup DC4, with Active Directory (Europe 2) and associated replication services being re-routed. Customer Services were not affected.
The Donated Charity Services were reduced whilst DC4 handled the additional loads of DC3, with a 77% performance limit applied to ensure the smooth operation of DC4
Following the Hardware Replacement, services were restored and re-routed to the original locations - during which there was a 5 minute delay in replication of customer services during the reversal operation. All events were completed within the SLA period, and no negative customer effects occured.