Printable View
At a guess? Their data center lost power. They did not have anyone sitting just to watch the servers so they ran until the battery back-up power ran out. At that time, the servers did a hard crash, the games froze for everyone including the staff members and/or family playing one last time before HD came out. Someone, probably the low boy on the IT totem pole for Lotro, DDO and AC, then drove over to the building and said "OH *%$*" and called the big wigs.Quote:
Originally Posted by Nenuiale
I'm sure that's a question Turbine will be asking who ever they're paying to host their systems in the datacenter. As I understand it, the datacenter isn't owned by Turbine, but rather they pay someone else to host their servers. So it's a fair question and one I'm sure Turbine will be expecting an answer for.Quote:
Originally Posted by Nenuiale
How long you have your staff working isn't really the issue here... The issue really is, if the system is even ready for the upgrade right now. Which I think is best decided after it's been stable for 12+ hours.Quote:
Originally Posted by Namesse
The external host did have a backup power system. Which failed.Quote:
Originally Posted by Nenuiale
I guess you could argue for double or triple backups, but good luck getting any accounting department under the sun to ok that purchase.
>> Didn't read all these long posts in all these doomsday threads today, but my question is nice and simple: How come their professional, expensive servers don't have something to keep them powered in case of power outages?
The original announcements indicated the backup power failed too, they didn't know why. Sometimes back up systems fail, or don't kick in as expected.
Even "professional, expensive" ones.
The important thing is that the data was preserved, which I'm sure it was--the db storage is likely redundant to at least the 3rd level, probably higher. Power systems, though, are expensive and likely go only one level of backup. I for one am fine with that--I don't want to see my subscription jacked up to build another level of redundancy in the power for freak situations that cause inconveniences only the emotionally unstable can't deal with.
I guess it wasn't meant for HD to launch today then. Well no worries, we still got 99 days until Ragnarok.Quote:
Originally Posted by furtim
FYI a games community is a lot more then the forums. I know f2pers can't post in Swtor and age of Conan and limited in Rift. There is a reason why they are not allowed to post in forums. Not all but a vocal minority has nothing but trash to say (see I'm not calling anyone trash I'm calling their comments trash sorry if I offended you).Quote:
Originally Posted by Mysterion
The delay is very disappointing, without doubt. I checked over six hours ago when I heard about the delay and we seem to be no closer all these hours later. I am very surprised it took so long to bring back the servers. The lack of information at this stage doesn't help either, as we don't know if the delay will be a matter of hours (which it has already been) or days. I am hoping it is the former.
-Bel
I'm not guessing about what I'm about to say. But I guess you've never worked in IT Infrastructure before....Quote:
Originally Posted by Darlgon
Most Datacenters have operators on staff 24/7/365. Myself I worked overnight on 12/31/1999 to make sure that nothing blew up, even though we knew we were good. There's backups to do, and maint and all other types of things that can't be done during the day. So they have people staffed do those things.Quote:
They did not have anyone sitting just to watch the servers
Every decent server based UPS has the ability to send emails when it goes on battery power, and that email isn't only sent to 1 person. So as soon as the center lost power, lots of people were informed of it, via email. So they would be well aware of the power outage, long before the UPS should of ran out of power. But in this case apparently the backup generators never kicked in.Quote:
so they ran until the battery back-up power ran out.
But even then, they should of had time to bring the systems down gracefully... Any datacenter should have enough battery power on hand to keep stuff running for 20-30 minutes.
If this was truly an issue with a hard crash, which it seems to be... That means Turbine has contracted what must be one of the most incompetent datacenter companies in the US. There is pretty much no other reason for them not to bring the servers down gracefully... Short of the datacenter itself being damaged in some way.
I wasn't logged in myself during the outage, but I've only heard one (unconfirmed) report of data loss from other people so far. So perhaps they were in fact able to do a graceful shutdown on most of the servers.Quote:
Originally Posted by Solarfox
No, you paid 60$ for a game update, things happen, storms knock out power lines, people get exhausted from being up all night and most of the day. You'll live.Quote:
Originally Posted by BlackDenied
https://www.lotro.com/forums/showthr...-s-Deep-Update
HD delayed till wednesday....
I lost connection, my toon freezing in place until it timed out. Logging in briefly this morning, no loss of anything, and right where I expected to be. Suspect it did gracefully go down after the connection was severed (making it look like a freeze/crash to those logged in). But who knows?
Please use the official discussion thread going forward. Thanks!