Yeah, this morning was fun. There was apparently a UPS failure at the data center. Something that should be next to impossible with the amount of redundancy and preventative maintenance alerts I get. So after about an hour of no power, we were finally able to turn our servers back online, and then spent another 45 minutes or so checking and bringing site services online.
Our secondary database server needs to be re-synched (which takes about 20 minutes of downtime), but that can wait until less people are online.
Ugh.