Well, we’re back up; our hosting company got nailed by a higher level ISP packet flood

by Skip
UPDATE: See below for more of a Diagnosis.
***************
Apologies – WE weren’t hacked but our hosting company was effectively thrown offline by a higher level ISP company – their explanation sounds like a massive DDOS attack from the next higher level ISP – or that entity has a MAJOR screwup themselves that filtered downward.
Hello,
Thanks for your continued patience, and my apologies for the delay. During the 6:00am EDT hour we were alerted to a major event which affected multiple services hosted by Nexcess. Further investigation showed that the network event was caused by excessive network saturation by a major upstream provider, which effectively would have impacted websites and internet access far beyond the scope of Nexcess and Liquid Web.
Our networking engineers have re-routed traffic around the Internet providers we utilize who continue to be impacted by the larger Internet issue. At this time all of our datacenters are fully accessible, however depending upon a client’s ISP networking may still reflect a website or Nexcess resource as down or inaccessible. Due to the scale of this event the resources available to us to resolve this issue are limited but our Engineers are still hard at work to ensure stable service is restored.
We are seeing connectivity and network traffic restored to all data centers at this time. however, depending upon a client’s ISP, networking may still reflect a website or a Liquid Web or Nexcess resource down.
We apologize for the disruption and are monitoring both internal and external networks closely. Additional updates will be provided as soon as they are available.
We seem to be back up but things might be a bit sketchy for a while during the process of them wringing out their sections of the InterTubes.
Thanks for your patience!
*********************
UPDATE/Diagnosis:

Network related incident impacting multiple systems

Incident resolved

Following extended monitoring, we have confirmed the routing changes to bypass the global providers experiencing issues have resolved all connectivity issues to our datacenters and resources. Other key providers like Cloudflare are advising they too are seeing network stability.

If you are continuing to see networking issues reaching your website or another resource, please attempt to clear your cache or utilize another network such as your cellular data provider to verify.

We appreciate your patience and understanding as we adjusted our network to work around the issue for the swiftest resolution. If you have any questions or experience further issues, please.
Time posted:  Aug 30, 15:30 UTC

Author

  • Skip

    Co-founder of GraniteGrok, my concern is around Individual Liberty and Freedom and how the Government is taking that away. As an evangelical Christian and Conservative with small "L" libertarian leanings, my fight is with Progressives forcing a collectivized, secular humanistic future upon us. As a TEA Party activist, citizen journalist, and pundit!, my goal is to use the New Media to advance the radical notions of America's Founders back into our culture.

    View all posts
Share to...