from the murphys-law dept.
Tuesday, our webserver crashed. We have now restored the backup from Monday, December 1st 22:00. Read on if you are webmaster of one of our sites or interested how this could happen...
Changes on the websites done during Tuesday are lost. You'll need to redo them. Feel free to contact us in case you get problems with permissions etc.
What happened? First, one of the disks of our webserver failed. No problem, we have RAID-5. The RAID-controller immediately started to rebuild the array on the hot spare. Two and a half hour later, a second disk failed. About half an hour to early for the RAID-controller to finish his work... The server is now replaced by a complete new box, system and data is restored from netbackup. Not a simple task because empty directories are missing in the backup. Hint for every netbackup user: learn to restore a machine before you need it. It helped us a lot to have this know how :-)
Our hardware supplier will check up the machine to find an answer why two disks could fail in the same time. We will inform you on this page.
< | >