{"is":"issue","title":"Unplanned power outage in HPCC, Grex down","body":"\u003ch4 id=\"power-to-the-hpcc-centre-restored\"\u003ePower to the HPCC Centre restored\u003c/h4\u003e\n\u003cp\u003eManitoba Hydro had restored power to Campus, and Grex is back online.\nAll running and queued jobs were lost during the outage.\nWe have used the opportunity to update SLURM scheduler to the current major version 24.11 .\nAll Grex subsystems (compute, storage, login nodes and Web portal) are operational.\u003c/p\u003e\n\u003cp\u003eIf you have questions or concerns, please do not hesitate to contact us at \u003ca href=\"mailto:support@tech.alliancecan.ca\"\u003esupport@tech.alliancecan.ca\u003c/a\u003e , mentioning Grex in the subject line.\u003c/p\u003e\n\u003ch4 id=\"a-power-outage-happened-in-hpcc-centre\"\u003eA power outage happened in HPCC Centre\u003c/h4\u003e\n\u003cp\u003eA power outage in Grex\u0026rsquo;s datacentre happened , with a complete loss of power at about 9:10 AM Winnipeg time.\nThe system is down. The reason for the outage is a problem at Manitoba Hydro, our electricity provider.\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://account.hydro.mb.ca/Portal/outeroutage.aspx\"\u003ehttps://account.hydro.mb.ca/Portal/outeroutage.aspx\u003c/a\u003e\u003c/p\u003e\n\u003cp\u003eWe are waiting for the power to be restored. Thank you for your patience!\u003c/p\u003e\n\u003cp\u003eIf you have questions or concerns, please do not hesitate to contact us at \u003ca href=\"mailto:support@tech.alliancecan.ca\"\u003esupport@tech.alliancecan.ca\u003c/a\u003e , mentioning Grex in the subject line.\u003c/p\u003e\n","createdAt":"2025-04-23 09:10:00 +0000 UTC","lastMod":"2025-04-23 09:10:00 +0000 UTC","permalink":"https://um-grex.github.io/status/issues/2025-04-23-unplanned-power-outage/","severity":"down","resolved":true,"informational":false,"resolvedAt":"2025-04-23 12:40:00","affected":["Compute nodes","Login nodes","Network","Lustre /project","NFS /home","OpenOnDemand portal","ComputeCanada CVMFS"],"filename":"2025-04-23-unplanned-power-outage.md"}