network outage - core routers firmware update

[adminless]

just apparently reporting a network outage now by the provider (that it seems like it led to a cut this morning around noon too btw) due a core router kernel bug that it looks it has been fixed now with some core routers firmware updates (which obviously led to another small downtime). from what I could dig it looks like the task should have ended by now and that should have fixed it, sorry for the inconvenience.

[WhoAmI]

Yes, we lost connection during the pickup. It was almost finished. CTF server was working.

[adminless]

I know, unlucky, I was also online doing some maintenance and server work when I lost connectivity and turned into provider and found out about the core router firmware update and the incident. anyways from what I had read and seen so far I believe that should have made and now hopefully the network core routers (which are way beyond the server contract) should be all running fresh firmware so hopefully there should be no other outages any time soon as usual.

[PacMan]

I know, unlucky, I was also online doing some maintenance and server work when I lost connectivity and turned into provider and found out about the core router firmware update and the incident. anyways from what I had read and seen so far I believe that should have made and now hopefully the network core routers (which are way beyond the server contract) should be all running fresh firmware so hopefully there should be no other outages any time soon as usual.

I see this few times now at night , or late eve pickup

[adminless]

as I'm telling you the servers (all of them, the most notable routes) are all monitored 24/7 with the smokeping service and apart from the cuts reported on this incident (that apparently got fixed right on the same day by the provider) and apparently a few spikes this weekend involving the second route I do not observe any kind issue with them. in fact most routes and parameters looks on the improvement and as I just said this provider core routers (backbones/internal core routers) have been all updated to latest firmware so I doubt there should be much problems with them.

[adminless]

hey guys it appears that there was another (still to determine) major network outage with the provider now around 23:00 CET for a hour approx. after a few contacts "service" (i.e. connectivity) seems restored though I'll keep investigating more. sorry for the inconvenience.

[WhoAmI]

Yes, everything works. I'm waiting for players.

[adminless]

lol they are all at the second server or the ctf one. ok, this is all I got so far, I know these guys have some network maintenance/upgrade coming in the next weeks which I though it could be related but it wasn't the case. it seems that it's probably related with the same initial core router issue here. anyways, just as posted there I assume they should implement another fix in the very near term (I mean, the entire provider was down, not just this server).

[PacMan]

hey guys it appears that there was another (still to determine) major network outage with the provider now around 23:00 CET for a hour approx. after a few contacts "service" (i.e. connectivity) seems restored though I'll keep investigating more. sorry for the inconvenience.

Yeah it was messed up pacman was on a mission I also activated my Ami flick bot with wtf power

And then the server went down and reminded me I am just a noob

[adminless]

hehe from what I saw on their panel now provider just marked as solved this an hour or so after the incident, a loop apparently, so I guess there should be no more incidents with the server by now as usual.