10th Anniversary of the Great PlayStation Network Outage

[Mavrick]

Hard to believe it's really been 10 years since this happened.

On April 20, 2011, the PlayStation Network went down.

It didn't seem like a big deal at first. After all, outages on various gaming networks are semi-common to this day, and the PlayStation Network of 2011 was not exactly known for reliability. The timing was unfortunate, coming right on the heels of anticipated PS3 releases like Portal 2 and SOCOM 4: US Navy SEALs, but frustrated gamers could no doubt find something else to do, get a good night's sleep, and give those games' online functionality another shot the next day.

Unfortunately, the next day Sony gave its first real indication that this was not a normal outage, while still managing to grossly understate the problem.

"While we are investigating the cause of the Network outage, we wanted to alert you that it may be a full day or two before we're able to get the service completely back up and running," it said.

"A full day or two" came and went without Sony restoring service or explaining what had happened. After five days, the company finally confirmed the service had been taken offline as a result of a security breach, with the personal info of more than 77 million registered PlayStation Network and Qriocity users stolen as a result of "an illegal and unauthorized intrusion."

The PlayStation Network would be down entirely for 24 days. Beginning May 15, Sony gradually restored the service over months, with some regions like Japan having some functionality offline for as long as 76 days.

While it was an unprecedented stretch of downtime (and lapse of security) for a major gaming network, it was not entirely unanticipated. Indeed, just a few weeks prior, hacker group Anonymous had warned Sony that it had planned a series of attacks against the company as retribution for its legal pursuit of hackers who cracked the PS3's anti-piracy measures in 2010.

While Anonymous denied involvement in the attack, Sony pointed a finger its way when executives were made to testify before the US House of Representatives. In a letter to Congress, Sony's Kaz Hirai said Anonymous had been executing denial of service attacks on Sony's servers prior to the PSN hack. Additionally, he said that when Sony Online Entertainment suffered a similar breach with nearly 25 million compromised accounts in the wake of the PSN outage, the intruders planted a file on a Sony Online Entertainment server "named 'Anonymous' with the words 'We are Legion.'"

Sony also vowed to "proceed aggressively" against the hackers responsible and bring them to justice. We asked Sony representatives last week to check whether the company was ever successful in that pursuit, but never heard back.

So what was the outcome? Well, there were a lot of class-action lawsuits, and Sony settled them for $15 million. Well, not $15 million actual dollars. $15 million worth of a limited selection of free downloads of PS3 and PSP games and themes that cost Sony basically nothing to hand out. And according to court filings, $2.75 million in actual money paid to the lawyers running the class-action suits.

Sony also paid for 12 months of an identity theft protection service for PSN subscribers, which is an odd half-measure because that's not really how identity theft works. Much of the information stolen could still be used by bad actors to this day. Even outdated information like former addresses provide answers to identity challenge questions from banks or credit reporting agencies, leading to consequences more dire than simply having a credit card number stolen (where the user is typically not liable for fraudulent purchases).

While some were throwing around drastic numbers about what the hack could cost Sony, Wedbush Morgan analyst Michael Pachter offered a depressingly accurate take just days after it happened, saying, "If they offer some free stuff and continue to follow up, this will all be forgotten in a few months."

It's been 10 years now, and while it's a stretch to say the PSN outage has been forgotten, it's difficult to say what kind of long-term influence it's had on the industry, or even Sony itself. While we haven't seen another catastrophic failure on PSN user security, I'm not entirely sure how much of that is due to Sony's efforts. I mean, the company would go five full years from the outage before confirming that it was finally getting around to adding two-step verification to PSN. (Xbox added it in 2013; Nintendo lagged as it often does in anything online-related, rolling out two-step verification for the Nintendo Network in 2017.)

When the PSN hack happened, it was often described in the press as one of the largest data breaches in history. It's much less so now, as security breach tracking site Have I Been Pwned has details of dozens of security breaches involving more than 77 million accounts, including plenty of tech-savvy operations one would hope to be better about security.

Adobe had information for more than 153 million accounts stolen in 2013. LinkedIn lost 164 million email and password combinations in 2016. And as we found out just this month, Facebook patched a security vulnerability in 2019, but not before the personal information of more than 533 million Facebook users around the world had been swiped.

The PSN hack isn't even the biggest data breach in gaming anymore. In 2019, Zynga reported that hackers stole account information belonging to Draw Something and Words With Friends players.

"Cyber attacks are one of the unfortunate realities of doing business today," Zynga said in announcing the breach -- downplaying its failure to secure customer information, neglecting to mention that 173 million users were affected by its failure, and summing up the apparently defeatist attitude towards the subject so many companies have today.

Looking back on the PlayStation Network hack, I can't help think the real lesson companies learned was that compromising the safety and security of millions of your customers is only a truly big deal if it takes your service offline for any length of time.

https://www.gamesindustry.biz/articl...ago-this-month

[Talal86]

10 years

[Diesel]

I got to play the fantastic Dead Nation out of this

[Mavrick]

It was a wild ride. I was trying to find the thread that was posted on here back when but I can't find it for the life of me.

[khalbrae]

It happened RIGHT after my out of warranty first gen PS3 died on me so I didn't get the "welcome back" or whatever reward of freebies they had for people who logged in afterwards.

Wasn't eligible when I bought a replacement PS3 4 years later.

[Hayabusa85]

It was annoying at the time but the real tragedy was that it was the start of the end for Zipper.

[emailking]

I wasn't playing any online games at the time so my gaming was unaffected, other than trophy sync. But I had been doing all my streaming movies on my PS3 so I had to switch to streaming directly from my TV a lot. Sometimes you could get netflix and vudu to launch anyway even though you weren't signed into PSN, but sometimes they would refuse to launch.

[Batman1980]

Originally Posted by Mavrick

It was a wild ride. I was trying to find the thread that was posted on here back when but I can't find it for the life of me.

https://forum.blu-ray.com/showthread...ge#post4728885

[Batman90]

Those was the dark days. I remember those days I still have nightmares. One day the network went down and all was lost.

[Zivouhr]

Dark days indeed.

Thankfully I hardly use PSN except for new games or the rare DLC now and then but I do remember hearing how that affected a lot of gamers.

I always get one of those PSN points digital code cards to buy games to avoid any kind of payment on PSN, since it's already been paid for separately. Just enter that code in redeem codes and that's it. I don't trust Sony much.

[Hayabusa85]

Originally Posted by Batman1980

https://forum.blu-ray.com/showthread...ge#post4728885

https://forum.blu-ray.com/showpost.p...postcount=1493

I see I was involved in important discussions

[Hayabusa85]

So what will it be in April 2031?

[Mavrick]

Hey the more things change the more they stay the same lol

[Nerdkiller likes BD]

Funnily enough, the WipEout game I got as an apology for the hack is missing from my download list. Only the Fury expansion is there. Don't ask me why.

[Batman90]

Originally Posted by Zivouhr

Dark days indeed.

Thankfully I hardly use PSN except for new games or the rare DLC now and then but I do remember hearing how that affected a lot of gamers.

I always get one of those PSN points digital code cards to buy games to avoid any kind of payment on PSN, since it's already been paid for separately. Just enter that code in redeem codes and that's it. I don't trust Sony much.

I only use pre-paid cards for both PlayStation and Xbox including other places like iTunes and stuff.

[Grim Reaper]

Felt like it's been longer than 10 years.

[Steelmaker]

LOL why are commemorating this?

[Musashi]

Originally Posted by Mavrick

Hey the more things change the more they stay the same lol

Originally Posted by Hayabusa85

So what will it be in April 2031?

First the Great PSN Outage, then the Great Blu-ray.com outage!

2031...a GameFAQs outage?

[Zivouhr]

Originally Posted by Musashi

First the Great PSN Outage, then the Great Blu-ray.com outage!

2031...a GameFAQs outage?

Yeah, was about to say a full 7 days without blu-ray.com. Glad it's back! Thanks for everyone who helps run Blu-Ray's site and forums too!

Unexpected downtime

Progress

Update 2021-04-24:
Apologies for the redirect to Communities.com (that many got) due to an incorrect SSL certificate (we've been too busy to fix this properly until now). Basically everything has needed upgrading and compatibility fixing: OS, kernel, modules, specific hardware, php, nginx, mysql, vBulletin. When all is fixed and site back online we will setup a proper powerful mirror so the site can be switched over immediately without downtime like this. This is by far the longest downtime we've had since the site went online 2003 and not ok

Update 2021-04-23:
Site setup very close to being finalized (with vBulletin support). Site estimated to go online on Sunday.

Update 2021-04-22:
Most things configured. Figuring out what to do with old vBulletin and compatibility.

Update 2021-04-21:
Server back online, but not site yet. Server is being configured.

Update 2021-04-18
Since we are offline anyway we are going to take the opportunity to upgrade to a new supported OS which is the better long-term decision. However, it will mean some more days offline since many things needs to be re-installed/configured manually.

Update 2021-04-16:
Hello everyone! We have a faulty OS hard drive which didn't want to be replaced in an easy way, which has caused the unexpected downtime. The site and your data is on other hard drives and we also have mirrored backups in several geographical locations so you don't need to worry about data loss.

The server ran CentOS which was abruptly discontinued recently, therefore we are evaluating our options on whether to try to go back to the OS we have now, or install a new OS.

Because of Covid and that it's Friday night, things will take longer than usual to fix, unfortunately it will probably take several days. We will be working non-stop to get the site back online.

We deeply apologize about this, Blu-ray.com is not run by a large corporation therefore our mirrored backup sites aren't powerful enough to simply switch over the complete site immediately.

// Blu-ray.com team

Blu-ray.com Facebook page

[Hayabusa85]

PSN is down......