On Monday, December 9th at 10:27 p.m. PT, Yahoo network operating center alerted the Mail engineering team to a specific hardware outage in one of thier storage systems serving 1% users.
The Mail team immediately started working with the storage engineers to restore access and move it from their back-up systems, estimating that full recovery would be complete by 1:30 p.m. PT on Tuesday.
The problem was a particularly rare one, and the resolution for the affected accounts was nuanced since different users were impacted in different ways. Some of the affected users were unable to access their accounts, instead seeing an outdated “scheduled maintenance” page which was a confusing and incorrect message.
They worked around the clock to restore access and all messages to inboxes. This has included restoring IMAP access for people using other email programs like Outlook or Apple Mail to access their Yahoo Mail.
They are restored access to almost everyone and delivered the backlog of messages. We will continue to work on rolling out IMAP access and to fully restore inbox state.
They are going to be working hard on improvements to prevent issues like this in the future. While our overall uptime is well above 99.9%, even accounting for this incident.
Marissa Mayer, Yahoo CEO said
"This has been a very frustrating week for our users and we are very sorry.
For many of us, Yahoo Mail is a lifeline to our friends, family members and customers. This week, we experienced a major outage that not only interrupted that connection, but caused many of you a massive inconvenience — that’s unacceptable and it’s something we’re taking very seriously. Unfortunately, the outage was much more complex than it seemed at first, which is why it’s taking us several days to resolve the compounding issues."
Author Venkatesh Yalagandula Follow us Google + and Facebook and Twitter
The Mail team immediately started working with the storage engineers to restore access and move it from their back-up systems, estimating that full recovery would be complete by 1:30 p.m. PT on Tuesday.
The problem was a particularly rare one, and the resolution for the affected accounts was nuanced since different users were impacted in different ways. Some of the affected users were unable to access their accounts, instead seeing an outdated “scheduled maintenance” page which was a confusing and incorrect message.
They worked around the clock to restore access and all messages to inboxes. This has included restoring IMAP access for people using other email programs like Outlook or Apple Mail to access their Yahoo Mail.
They are restored access to almost everyone and delivered the backlog of messages. We will continue to work on rolling out IMAP access and to fully restore inbox state.
They are going to be working hard on improvements to prevent issues like this in the future. While our overall uptime is well above 99.9%, even accounting for this incident.
Marissa Mayer, Yahoo CEO said
"This has been a very frustrating week for our users and we are very sorry.
For many of us, Yahoo Mail is a lifeline to our friends, family members and customers. This week, we experienced a major outage that not only interrupted that connection, but caused many of you a massive inconvenience — that’s unacceptable and it’s something we’re taking very seriously. Unfortunately, the outage was much more complex than it seemed at first, which is why it’s taking us several days to resolve the compounding issues."
Author Venkatesh Yalagandula Follow us Google + and Facebook and Twitter
No comments:
Post a Comment