← Go back to
Status of the Grex HPC system
Incident history
2026
(3)
September 2, 2026 at 08:30 UTC
Planned Grex outage - updating SLURM and home
Resolved after 6d 14h 40m of downtime
May 7, 2026 at 15:00 UTC
Unplanned Grex outage - restarting login nodes and OOD
Resolved after 1h 39m of downtime
April 29, 2026 at 17:00 UTC
Unplanned Grex outage - restarting login nodes and OOD
Resolved after 2h 0m
2025
(8)
December 8, 2025 at 08:00 UTC
Planned Grex outage - updating storage
Resolved after 4h 0m of downtime
September 28, 2025 at 06:00 UTC
Grex login failure, login nodes and OOD.
Resolved after 1d 16h 0m
September 24, 2025 at 08:00 UTC
Planned Grex outage, updating storage and patching operating system
Resolved after 2d 9h 50m of downtime
July 18, 2025 at 07:10 UTC
Unplanned project storage outage in HPCC
Resolved after 10h 20m
April 23, 2025 at 09:10 UTC
Unplanned power outage in HPCC, Grex down
Resolved after 3h 30m of downtime
March 16, 2025 at 10:00 UTC
Unplanned storage outage on Grex
Resolved after 7h 10m of downtime
February 23, 2025 at 07:00 UTC
Planned HPCC datacentre power outage
Resolved after 1d 10h 10m of downtime
January 21, 2025 at 11:00 UTC
Unplanned SLURM outage due to a problematic update
Resolved after 5h 5m of downtime
2024
(3)
August 26, 2024 at 08:00 UTC
Planned HPCC/Grex outage for electrical and cooling work.
Resolved after 15d 8h 0m of downtime
July 16, 2024 at 06:00 UTC
Planned HPCC/Grex outage for electrical and cooling work.
Resolved after 2d 12h 0m of downtime
May 7, 2024 at 09:00 UTC
Planned Grex outage for Lustre FS and Major Linux update
Resolved after 3d 4h 0m of downtime
2023
(5)
December 18, 2023 at 09:00 UTC
Planned Grex outage for SLURM and minor OS update
Resolved after 1d 9h 0m of downtime
September 12, 2023 at 18:00 UTC
Two Planned Grex outages for HPCC transformer work
Resolved after 7d 3h 0m of downtime
May 30, 2023 at 07:00 UTC
Unplanned power outage in HPCC datacentre
Resolved after 2h 30m of downtime
February 22, 2023 at 14:30 UTC
Planned Grex outage for HPCC work and storage update
Resolved after 4d 12h 30m of downtime
January 26, 2023 at 14:50 UTC
Electric failure, loss of power to management rack
Resolved after 3h 10m of downtime
2022
(11)
December 1, 2022 at 11:30 UTC
Upcoming cooling outage in HPCC ℹ
October 20, 2022 at 09:30 UTC
Datacentre Plumbing works October 20, 2022
Resolved in under a minute
October 13, 2022 at 08:30 UTC
Upcoming Datacentre Work on Oct 13. ℹ
September 9, 2022 at 11:45 UTC
Planned Network outage of the login nodes
Resolved in under a minute
September 2, 2022 at 08:30 UTC
Hardware failure on one of the login nodes
Resolved in under a minute
August 16, 2022 at 09:00 UTC
CANARIE outage affects Grex external network and Legacy login nodes
Resolved after 5h 0m of downtime
June 23, 2022 at 19:00 UTC
Grex has a problem with external network and login nodes
Resolved after 14h 30m of downtime
May 31, 2022 at 01:30 UTC
Brief power outage on May 31, 2022
Resolved after 30m of downtime
May 13, 2022 at 19:30 UTC
One of the /global/scratch filesystem servers crashed, FS runs in degraded mode
Resolved after 2h 30m
May 9, 2022 at 00:00 UTC
Emergency SLURM update wiped all running jobs
Resolved after 11h 0m of downtime
April 24, 2022 at 11:30 UTC
Brief power outages on April 23, 24 , 2022
Resolved after 1h 30m of downtime
2021
(1)
October 23, 2021 at 15:30 UTC
Brief power outages on October 23, 2021
Resolved after 9h 30m of downtime
Not showing incidents older than from 5 years