secondary server is down

[adminless]

it appears that due a system update issue the secondary server is down since this morning (i.e. that it failed to start), I'm currently working with the data centre techs to get it back online again though in a weekend that might take some time. in any case, thanks to the dual setup at least the primary server is completely unaffected so it shouldn't be such a critical deal and in case a recovery doesn't succeed then I guess I'll just migrate that again in the coming days. unfortunately this impact however all the stats as they reside there. sorry for the inconvenience and thank you for your patience.

[PacMan]

it appears that due a system update issue the secondary server is down since this morning (i.e. that it failed to start), I'm currently working with the data centre techs to get it back online again though in a weekend that might take some time. in any case, thanks to the dual setup at least the primary server is completely unaffected so it shouldn't be such a critical deal and in case a recovery doesn't succeed then I guess I'll just migrate that again in the coming days. unfortunately this impact however all the stats as they reside there. sorry for the inconvenience and thank you for your patience.

Don't servers do backups so an old stat will still be available? Just a knowledge question

[adminless]

just like that, some do and some don't. generally speaking that's a option that gets billed separatelly so it's not part of the standard package which that last is what I always get. that said, I keep backups across the different servers and more extensively in a local physical usb disk so it wouldn't be the end of the world anyways not to mention the dual (triple if you account for the web) server setup this time that was specifically designed to account for this as can be seen for good measures then it's not like the previous time that it went all down. from what I see the rest of the services are working just fine and I hope the server gets back online soon.

speaking of which this afternoon I finally just completed all the proper contacts and it looks like it's already being checked for repairs, once I know more I'll let you know as usual. as for the backups, the thing with any backup policy is that is never (realistically) possible to keep everything backed up at all times as you can understand so with any backup recovery there's a chance to miss something hence why it's always important to recover the server first whatever possible.

[PacMan]

Ok I get you, so it's more of not up-to-date stats can be shown , maybe stats can have some date somewhere unless I missed it lol

[adminless]

no, no currently none can be shown as the web server and service that served those resided on the secondary server that is down now. once it gets back online, that I hope it will do from what I talked with the provider so far, all the stats will be shown. only problem would be if the server never comes back online again or if the disks get wiped during recovery that then I would have to restore from the local backup which is like some months old already. I guess that we will known that in the next days. as said, unfortunately we're at weekend and I know from experience that many departments are closed and/or only available with limited operations so it might be possible that it takes some time to get sorted. in any case, I repeat the rest of the services, notably the "main"/primary server along with the forum for contact are 100% functional.

[adminless]

server recovered now, apparently all good and no data has been lost so sorry for the inconvenience and thank you for your patience. considering it broke in a weekend, where support is more limited, and it got back up on the same day that's a realistically good job from the provider.

[PacMan]

Well atleast it wasn't like the last major failure , that must have been some pressure

Especially with us unfriz addicted noobs waiting for a shot unfriz.

Good job

[adminless]

hehe yes it always gets hot, that's the way it's, specially when working remotely like this but I think that it got sorted promptly this time so hopefully it won't break again in few days, we'll see. in any case, I'm just chugging that local physical backup copy asap as we speak just to be safe and whatever the case is as I said this time the setup, with various servers, account for this kind of failures as you can see.

[adminless]

same thing just happened this morning, I restarted the secondary server after a maintenance and it appears like it crashed or something during reboot and now it's inaccessible again so I'm currently reaching out to the provider so they can repair it. it appears this time the procedure can take more time with the weekend and the holidays so I'm not sure if the server will be back within this weekend. as usual I'll keep monitoring this and if anything it might be time to get another deal. sorry for the inconvenience and thanks for your patience.

[adminless]

server apparently back online now. still trying to figure out more info about the failure. from what I heard from the tech it just got stuck in some POST error that required physical intervention to clear up so I assume that for the rest this server should be just running fine as usual by now.

[adminless]

unfortunately I just rebooted it again to make sure the problem was fixed but the same thing have just happened so escalated again the issue to the provider for further fix up.

[PacMan]

unfortunately I just rebooted it again to make sure the problem was fixed but the same thing have just happened so escalated again the issue to the provider for further fix up.

Maybe do reboots etc at night or early morning when servers less busy .....

[adminless]

I actually performed the maintenance/check up nine in the morning when the server was empty beside I overall left all the main server updates/upgrades for the summer when the turnout is lower. looking back at it I think that after they got it back online in the afternoon I should probably have left it running for the weekend to check it up more thoroughly the Monday. in any case post errors and a server unable to reboot is something that needs immediate action so one way or another it was something that needed fixing and probably the sooner than the later. anyway at least the provider has already been active even despite the timing so I think that it should be sorted promptly beside as usual there's two actual servers for a reason so in the mean time you can probably give glacius some play too beside if by tomorrow or so the server isn't fixed already I guess I can simply just temporally migrate the secondary server into the main server which allows for it and if by the next week there hasn't really been a solution yet I'll just look for another deals as usual. the problem is that there's really not many great alternatives for that budget, that server is still a great performer, so if it can be saved the better. well at least this time I made sure to make a full whole server back up before trying anything so whatever the case is there should not be a major issue beside the down time. as usual sorry for the inconvenience and thank you for your patience, once I know anything else I'll keep this updated.

[adminless]

secondary server back online now and hopefully I'll leave it to run at least for the weekend.