Network Outage 1/19/06

[Vantage]

Ok, Heres the story.

One of our upstream providers (Progress comunications) is having some issues accepting our routing table.
In the midst of this issue, Cogent has scheduled a service window. So we had 2 upstream providers have outages at the same time.
The epik issue is still partial as they are unable to accept our 216.81.64.0/20 IP block. We are working on this issue.
Cogent assures us that the maintenance window shoudl total less than an hour. (As I type this it has been about 53 minutes since their service window started.)

More info as it presents itself.

[bocosoft]

Horrible timing

[Stevie]

Know the feeling...

[sandyx]

Steve ; do we have an approx time on when you expect this to be fixed ?

[crocman]

IS nt44 down I can't reach 3 domains hosted on that server thought I'd check here before putting in TT

[Vantage]

I have been working with progress for 30 minutes now... and I hope the cogent window is over soon.

Crocman. That server is in the 216.81.64.0/20 block. That whole block is down at the moment. I am working on resolving that issue with Progress.

[Vantage]

Progress is now accepting that route. The issue should be resolved.

[kattouf]

But i thought the network was redundant... so if one provider/connection goes doesn the network is still accessible or doesn't it work that way?

[admin]

It is redundant. But "Cogent had scheduled a service window" we thought ok we have progresstelecom and others it should be just fine. I really should have know better with progresstelecom. We have had a LOT of issues since install with them. This is there last straw anything happens again they will for sure be out the door.

They let us down at the time we needed them the most. Cogent had there outage planed and they gave us about 2 weeks notice. To be honest cogent is 100x better than progresstelecom in service over the past year. BTW I for get to say Progress charge more than twice as much. LoL

ProgressTelecom SUCKS!!!!!!! This is there last straw, they mess up again and you have my word they are gone. Lets just hope thee next mess up is when cogent is up.

[SRW]

For about 2 hours early this morning I was unable to reach any Vortech site including support site, CP or this forum......

Just curious, how many upstream providers does Vortech use at the moment?

Also what happened to the "external emergency" forum in case all Vortech sites are down and I can't reach anybody by phone.... It used to be at http://66.194.198.60/index.php no? Did I miss something about that?

Thanks,
SRW

[Vantage]

We currently have 2 transit providers and about 15 peers. BOTH transit providers went down last night. My first post in this thread basicaly explains what happened.