[154258] in North American Network Operators' Group

home help back first fref pref prev next nref lref last post

Re: FYI Netflix is down

daemon@ATHENA.MIT.EDU (Grant Ridder)
Sat Jun 30 02:09:35 2012

In-Reply-To: <4FEE978E.8060300@gmail.com>
Date: Sat, 30 Jun 2012 01:09:08 -0500
From: Grant Ridder <shortdudey123@gmail.com>
To: Roy <r.engehausen@gmail.com>
Cc: NANOG <nanog@nanog.org>
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org

well one would think that they could at least get power redundancy right...

On Sat, Jun 30, 2012 at 1:07 AM, Roy <r.engehausen@gmail.com> wrote:

> On 6/29/2012 10:38 PM, jamie rishaw wrote:
>
>> you know what's happening even more?
>>
>> ..Amazon not learning their lesson.
>>
>> they just had an outage quite similar.. they "performed a full audit" on
>> electrical systems worldwide, according to the rfo/post mortem.
>>
>> looks like they need to perform a "full and we mean it" audit, and like
>> I've been doing/participating in at dot coms for a decade plus: Actually
>> Do
>> Regular Load tests..
>>
>> Related/equally to blame: companies that rely heavily on one aws zone, or
>> arguably "one cloud" (period), are asking for it.
>>
>> Please stop these crappy practices, people.  Do real world DR testing.
>>  Play "What If This City Dropped Off The Map" games, because tonight,
>> parts
>> of VA infact did.
>>
>> ...
>>
>
> I am not a computer science guy but been around a long time.  Data centers
> and clouds are like software.  Once they reach a certain size, its
> impossible to keep the bugs out.  You can test and test your heart out and
> something will slip by.  You can say the same thing about nuclear reactors,
> Apollo moon missions, the NorthEast power grid, and most other technology
> disasters.
>
>
>
>

home help back first fref pref prev next nref lref last post