All Systems Operational
Uptime over the past 90 days. View historical uptime.
Phone System ? Operational
90 days ago
100.0 % uptime
Today
NZIX Operational
90 days ago
99.98 % uptime
Today
AKL-IX ? Operational
90 days ago
99.96 % uptime
Today
CHC-IX ? Operational
90 days ago
99.99 % uptime
Today
WLG-IX ? Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Past Incidents
Apr 1, 2023

No incidents reported today.

Mar 31, 2023
[OUTAGE] AKL-IX | VDC Albany (pe2.akl2)
Resolved - The findings remain indeterminate, with a transient issue being the tentative cause. Nevertheless, we have cold spare hardware at the ready in the event that the problem recurs and is determined to be a hardware fault necessitating equipment replacement. We apologise for any inconvenience caused by this unforeseen event.
Mar 31, 14:41 NZDT
Monitoring - The issue stemmed from an ephemeral event driver corruption, leading to a watchdog-triggered system reset. We are reaching out to our vendor for further examination, as recurring incidents point to hardware failure that warrants an RMA. We are currently monitoring the situation while gathering and analysing debug logs.
Mar 31, 13:42 NZDT
Identified - Our switch at VDC Albany crashed and is back online, investigations are underway.
Mar 31, 13:07 NZDT
Mar 30, 2023

No incidents reported.

Mar 29, 2023

No incidents reported.

Mar 28, 2023
[MAINTENANCE] AKL-IX | DataCentre220 (akl1) | New Switch, Port Migrations, RS1.AKL Uplink
Completed - The scheduled maintenance has been completed.
Mar 28, 04:00 NZDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 28, 00:00 NZDT
Scheduled - NZIX Engineers will be installing a new switch into production for greater port availability as well as migrating a number of 10G peers off legacy hardware (pe1.akl1). This includes some port migrations on our modern switch (pe3.akl1). RS1.AKL is also part of this outage as its uplink is being modified.

Window: 4 hours
Expected Downtime: ~10-30 Minutes

* Members connected to DataCentre220 (pe1.akl1, pe3.akl1) should expect their port to go offline.

Service ports will be drained of peering traffic roughly 3-5 minutes before their respective migrations using BCP214 compliant filters. Filters will be removed once the ports are back online and stable.

* ALL Members should expect connectivity to Route Server 1 (rs1.akl.ix.nz) to go down whilst its dual active/standby path is activated. Please verify you are peering with the secondary route server to minimise the impact:

RS2 - 43.243.21.254/24 & 2001:7fa:11:6:0:1db6:0:2/64


The work is expected to take about 1-2 hours. However, 4 hours have been booked in the unlikely event of an emergency.

If you have any queries regarding this notice, please contact noc@ix.nz or +64 9888 9221.
Mar 15, 17:28 NZDT
Mar 27, 2023
[EMERGENCY OUTAGE] CHC-IX | CCE | pe1.chc1 Switch Lock Up
Resolved - This incident has been resolved, newer firmware has been loaded that resolves this bug. Maintenance notices will be booked in soon to apply this code across all NZIX.
Mar 27, 08:23 NZDT
Identified - NZIX Engineers have been alerted to a management plane lock up on our switch at Christchurch Central Exchange (CCE) in CHC-IX. An emergency reboot is underway to resolve this. This bug is also impacting statistics on https://metrics.ix.nz/ for any service on this switch.

Expected Downtime: ~5-10 minutes

Summary of impact during this window:
* Members connected to pe1.chc1 should expect their port to go offline.
* ALL Members at CHC-IX should expect connectivity to rs1.chc.ix.nz to go down

Due to the nature of the software fault, we cannot appropriately install BCP214 compliant filters to ports on the switch to reduce BGP disruption. This means ALL members that have routes via peers on pe1.chc1 may see a period of packet loss whilst BGP re-converges to alternate paths.
Mar 27, 08:12 NZDT
Mar 26, 2023

No incidents reported.

Mar 25, 2023

No incidents reported.

Mar 24, 2023

No incidents reported.

Mar 23, 2023

No incidents reported.

Mar 22, 2023

No incidents reported.

Mar 21, 2023

No incidents reported.

Mar 20, 2023

No incidents reported.

Mar 19, 2023

No incidents reported.

Mar 18, 2023

No incidents reported.

← Incident History Powered by Atlassian Statuspage