I hate writing posts like this, but I wanted to let everyone know about the issue that came up today. We were finishing the very last steps of a big database upgrade that we've been working on for the past two weeks. The upgrade was made to ensure that all our sites continue to run as quickly as possibly, and it all went really smoothly, until this last change.
At about 12:20pm PST we made a small but crucial mistake that broke the Publish button in the Greenhouse for all our sites. Fortunately, all changes in the Greenhouse were still being saved, they just couldn't be published to your live site.
We started working on a fix right away, but it ended up being one of the first times we had an error that we couldn't fix immediately. I'm guessing most of you don't care about the technical details, but the gist is that we have a lot of different servers running, and we had to apply a fix on each one and wait for it to finish before continuing on.
We got things working for half our sites at about 3:20pm PST and for everyone by 4:00pm PST.
We're very sorry if this affected you. We take downtime extremely seriously, and we'll do our best to make sure this doesn't happen again. For the past three years since we launched, we've beefed up our system six or seven times, and our goal is always to make sure everything works without a hitch.
If you have any other questions, feel free to give us a call at 805-527-8900. Sorry again!