Network issues

Apparently Level3 took it upon themselves to null-route mail2. They are not being very cooperative, but we are working hard to get this fixed. Our apologies to everyone for this inconvenience.

[mdallarosa]

It is working now
racing route to 216.157.148.2 [216.157.148.2]...
hop rtt rtt rtt ip address domain name
1 5 0 2 70.84.211.97 61.d3.5446.static.theplanet.com
2 0 0 0 70.84.160.161 vl2.dsr01.dllstx5.theplanet.com
3 0 0 0 70.85.127.105 po51.dsr01.dllstx3.theplanet.com
4 0 0 0 70.85.127.36 ae1-0.ibr04.dllstx3.theplanet.com
5 0 0 0 63.209.48.109 ge-6-8.car4.Dallas1.Level3.net
6 1 1 1 4.68.122.129 ae-1-55.bbr1.Dallas1.Level3.net
7 33 33 40 64.159.0.25 so-3-0-0.mp1.Orlando1.Level3.net
8 33 33 33 209.247.11.38 ge-10-2.hsa1.Orlando1.Level3.net
9 31 31 30 4.79.116.130 VORTECH.hsa1.Orlando1.Level3.net
10 32 31 31 216.81.79.9 barney.rapidcolo.com
11 34 31 32 216.157.148.2 hsphere.cc

Trace complete

THANK YOU

Level3 has removed the null-route. Mail2 should be working now.

[jj1987]

I couldn't view the forums, vortechsupport, vortechhosting, or get any information from the phone system. I'm a new customer, so this was stressful for me, especially since being with idologic and never having downtime in 3 years (or I never noticed).

Anyways, its up, its over, lets move on....

[soky]

Originally Posted by Josh

Level3 has removed the null-route. Mail2 should be working now.

It's working in Bowling Green KY now.

[citywebsystems]

I can get to mail2 from Utah now. Thanks guys!

[powvex]

i'm very curious to know who had did gigabit flood, and why?
why whould someone flooding from an ip that can be traced? whats in it for him? these are the ones that i really dont understand.

he caused many troubles for my company by taking down the network and many angry customers at my side...

[Dean]

I'm not sure we can give an answer as to the motive behind the flood. As for who...the owner of the IP in question was Le Groupe Videotron, apparently an ISP in Quebec.

[Binico]

I wasn't happy, my clients weren't happy but I was confident in telling them that it would be fixed quickly. Things happen systems go down.

Great job Vortech! I appreciate the great support I always get.

[ekrubonline]

I think that some people here are taking our complaints out of context. I know that there was a quick response. I know that Vortech's Techs are workign hard. I never questioned it.

My query was with their not having an efficient system for informing us about what happened, and the comments that so many people here make that suggest that I'm wrong for voicing my conern. I'm from teh Caribbean, I'm young, and I'm pushing into a business that people are now beginning to trust in this region. Not to mention, I trust the people I pay to do things, to keep me in the loop. Including Vortech.

My hope is that the next time something like this happens (God knows I hope its never) there's a better system to deal with it...

That's my concern. That's why I'm angry. That's what caught me off guard with my clients.

I'd prefer to be a lot more comfortable telling my clients the truth when I say "We're on top of it". I don't want to just be saying 'the right thing' when I have no idea. Suppose it was a problem that could take hours upon hours? What would they say when long afterwards I still can't say anything else?

Help me here please.

Anyone else agree?

[Vixen]

Originally Posted by awen

I can understand problems like these, and glad Vortech was on the job getting it fixed. I realize it wasn't an equipment issue so it makes sense that the SLA for outages doesn't apply. Kudos for a job well done.
The thing that irks me the most however is Vortech people who tell US that the forums and other servers and services were NOT down or affected when we are out here and can plainly see that they ARE affected. Just because you're sitting on the inside and don't see a problem doesn't mean that there isn't one and that everyone else who contradicts your claim is lying. I've also noticed Vortech outage lengths tend to be leaner that I've recorded in the past.
I believe these inconsistancies may be due to some technical configuration that lets Vortech see shorter outages and less affected services due to their proximity to the equipment, and that too is reasonable.
However is very unprofessional to deny it when numerous clients are reporting in problems. Maybe you don't see the problem, but that doesn't mean it doesn't exist.
Consider the possiblity and direct your reaction to the network and not at your clients, please.

Actually, we have off network internet access within the office, so when we tell you that a server is not down, it means it is not down for us from Road Runner. Also, we know when a server comes back online. Understandably, this does not mean it is up for you wherever you may be but to call us "unprofessional" for telling you that something is indeed up for us, is extremely one sided and unfair. I am sorry that you feel that way but please consider that we do have a clue what we are talking about before making unsubstantiated claims like this.

[cfrankland]

Originally Posted by Vixen

"unprofessional" for telling you that something is indeed up for us, is extremely one sided and unfair. I am sorry that you feel that way but please consider that we do have a clue what we are talking about

This entire thread is getting ridiculous. The disaster is over everyone.

Due to the nature of an attack such as this, I feel confident that we can assume that while some services were available to some of us, no services were available to others of us. I don't actually believe that anyone lied, we just all had varied results.

[admin]

The varied results came from Level(3) null routing the IP with out us asking, we did not know about them null routing and did not think of it as the attack was coming in over Cogent we had no idea Level(3) even saw any of the attack. Thats of course caused other issues we had to figure out. To us it was back up as we were going over cogent as other were but then some said it was still down. If you look at the posts above they are all Level(3) routes coming in.

Had we asked them to block it we would not of had this issue. They did it on there own and tried to tell us we had to now wait 24 hours to have it removed. They gave us some stupid story that I just found way to hard to understand about the attack affecting there managed services. No clue how our little line from them could affect there managed services. LoL

[jmbeach]

Originally Posted by ekrubonline

Now I have my biggest client, one of the biggest property dev't companies in my country threatening to leave. So much for growth in my fledgeling business!

I've been with Vortech for a long time and doing web dev. even longer, and all I can say is if you put your biggest client on server at a host with hundreds of resellers and thousands, even tens of thousands of sites hosted, they must not be that big of a client. I mean, come on, if this customer is so important would you not first think of hosting them somewhere with a more robust SLA?

Sorry to rant on you, but come on people. Most of us start out at $35/month to host nearly unlimited sites! What do you expect?!

I'm not happy that this happened either, but this is technology man... if this was an every day occurance, I would expect we'd all be gone. But it's not! And we're not!

ps - I see you even got Vixen in the thread... I miss the old days when she and I would go at it - oh, I miss those days when I had boundless anger. Not really!

[powvex]

Originally Posted by jmbeach

...
Sorry to rant on you, but come on people. Most of us start out at $35/month to host nearly unlimited sites! What do you expect?!...

getting a service at price of $35/month doesnt mean that we deserve to have failure over network by flooding or dos attacks.

i dont think this is the price matter, because if you even had a dual xeon dedicated server by price of $400/month here, it also be affected by this outage.

Admin; dont you think to have any anti-DDOS or anti flood hardware in your network? or maybe better router that you can nul-route the destination ip to prevent all network goes down?