Hyonix - NYC network maintenance – Maintenance details

All systems operational

NYC network maintenance

Completed
Scheduled for October 20, 2024 at 6:00 AM – 1:48 PM

Affects

Core Networks

Under maintenance from 6:00 AM to 1:48 PM

New York, New York (NYC1)

Under maintenance from 6:00 AM to 1:48 PM

Updates
  • Completed
    October 20, 2024 at 1:48 PM
    Completed
    October 20, 2024 at 1:48 PM

    The issue has been solved at this time. We no longer see any packet losses or unreachability issues.

    All servers have now been up and remained stable. We've successfully migrated to new Core routers and new network design, which will allow us to scale further without performance penalty.

    Our team will add more capacity next weekend as a part of this upgrade. We will put up another announcement once confirmed.

    Please let us know if you via ticket if you still experience any issues.

    Our apologies for any inconvenience caused during this process.

    Thank you for your patience and understanding!

  • Update
    October 20, 2024 at 11:13 AM
    In progress
    October 20, 2024 at 11:13 AM

    Our team is still working on the issue.

    As noted, majority of servers have been back to normal, we are still observing packet losses toward a few IP ranges and are looking into it.

    Our team will post update once we have more information.

  • Update
    October 20, 2024 at 10:13 AM
    In progress
    October 20, 2024 at 10:13 AM

    Most of our IPs are functional, we are aware of a few subnets still flapping, causing spikes in latency and 5-12% packet losses, our team is investigating on this issue.

    All downlinks to our core routers have been migrated successfully at this time.

  • Update
    October 20, 2024 at 9:13 AM
    In progress
    October 20, 2024 at 9:13 AM

    We are still in the mid of transferring downlinks of old Core router to new, it is expected that servers will experience intermittent packet losses or be unreachable for short period amount of time during this process.

  • Update
    October 20, 2024 at 8:33 AM
    In progress
    October 20, 2024 at 8:33 AM

    Our backup upstream did not pickup our subnets immediately and has resulted in a slight downtime of 5-10 minutes. All subnets have been back online at this time.

  • Update
    October 20, 2024 at 7:56 AM
    In progress
    October 20, 2024 at 7:56 AM

    All of our Edge switches have been updated to latest firmware and configuration at this time. Our team is currently upgrading Core routers to newer hardware. It is expected that your servers will have packet losses or unreachable during this time as we transfer loads back and forth between old and new cores, with new uplinks.

  • In progress
    October 20, 2024 at 6:00 AM
    In progress
    October 20, 2024 at 6:00 AM
    Maintenance is now in progress
  • Planned
    October 20, 2024 at 6:00 AM
    Planned
    October 20, 2024 at 6:00 AM

    We will be performing a network upgrade at our New York location to improve network performance and reliability.


    Scheduled Timeframe: Sunday, October 20, 2024, from 1:00 AM to 12:00 PM (EST).

    During this timeframe, your service may experience periodic packet loss and could become unreachable for up to 15 minutes as we perform software updates across all our switches.

    We have carefully planned this maintenance and do not expect any issues during this process. Our team will promptly post updates as we proceed with the maintenance.

    If you have any questions about this maintenance, please let us know via ticket.

    Thank you for your understanding!