Network Outage 2.7.2010

[dvanburen]

Late in the evening on 2.7.2010 we had a power supply failure in our core switch resulting in a short amount of downtime. The power supply was replaced and the network is now working normally.

[mdwatkin]

Just curious, this is far from the first time we've experienced outages from the core router (bad boards, etc.). From those events I thought that VT was building a resilient network to eliminate single points of failure, but here the core router hosed up again. Even if its a short window of downtime, customer notice and call, mostly email users at this time of night.

see http://forum.vortechhosting.com/show...ht_router.html, bad board outage = SPOF


Has VT considered some redundancy or a SMLT/RSMLT solution? Would just like to hear about any plans to eliminate this SPOF...

Thanks for the speedy recovery by the way!

[dvanburen]

We have spares on hand, other than that it's very difficult to have a redundant core switch. The switch does have a backup power supply, the main problem was the DNS issue when the primary vlan dropped.

[treeves]

I checked your Twitter account and didn't see any updates. That would have been very helpful.

[mdwatkin]

Originally Posted by dvanburen

We have spares on hand, other than that it's very difficult to have a redundant core switch. The switch does have a backup power supply, the main problem was the DNS issue when the primary vlan dropped.

Thanks, this is helpful to know.

[dvanburen]

Originally Posted by treeves

I checked your Twitter account and didn't see any updates. That would have been very helpful.

I'll make sure to get the login, I personally don't have it. In all honesty all I could think of was getting everything back up.