[103304] in North American Network Operators' Group

home help back first fref pref prev next nref lref last post

RE: rack power question

daemon@ATHENA.MIT.EDU (michael.dillon@bt.com)
Tue Mar 25 12:34:37 2008

Date: Tue, 25 Mar 2008 16:04:58 -0000
In-Reply-To: <2ee691ff0803250611v2f6b83e9tb2f66746eecd9654@mail.gmail.com>
From: <michael.dillon@bt.com>
To: <nanog@merit.edu>
Errors-To: owner-nanog@merit.edu


This is a multi-part message in MIME format.

------_=_NextPart_001_01C88E91.D8DBE105
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

>  Or perhaps some non-conductive working fluid instead of water.  =20
>  That might not carry quite as much heat as water, but it would surely

>  carry more than air and if chosen correctly would have more benign
results =20
>  when the inevitable leaks and spills occur. =20
=20
HCFC-123 is likely what would be used, which means that you would want
to limit the amount of time that you spend inside the data center
because, with the large number of connections in the facility, leaks
will be inevitable and inhaling the gas causes liver damage.
=20
Essentially, you are saying that we should get rid of chillers and turn
the entire data center into a giant chiller. Instead of being a building
with rooms and equipment, the data center becomes a machine and humans
only venture inside when the machine is shut down for maintenance.=20
=20
>  Less practical but more fun to contemplate would be data centers
pressurized =20
>  with a working gas that offers better heat transfer than
oxygen/nitrogen and no =20
>  oxidation potential.  Airlocks and suits for the techs, but no fire
worries ever.  =20
>  Heck, just close the room and inject liquid nitrogen under the raised
floor to be =20
>  scavenged overhead and re-compressed, chilled, liquefied and sent
round again. =20
>  Reserve cooling for power outages is just huge dewars full of liquid
nitrogen :)

 >  Not so serious today,
=20
Why not? If you take your pressurized liquid nitrogen scenario and turn
it inside out, then it might well be workable and there would be no need
for suits. For instance, imagine a cylinder containing the liquid nitro
cooling (liquid air might be cheaper) with devices attached all around
like the petals on a flower. Each device has heat exchangers for cooling
the hottest parts (CPUs) and the heat exchangers are attached to the
cooling cylinder. With continued increase in density of cores, this
could be feasible. In essence it would be a kind of blade server with
the cooling and backplane in a central cylinder. Added benefits might
come from supercooling the backplane.
=20
Consider what is happening beyond the consumer dual and 8-core (PS3)
machines.=20
<http://www.tilera.com/products/boards.php>
<http://www.sicortex.com/architecture_tour>
=20
--Michael Dillon
=20

------_=_NextPart_001_01C88E91.D8DBE105
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.2800.1601" name=3DGENERATOR></HEAD>
<BODY>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; &nbsp;</FONT></SPAN>Or perhaps some =
non-conductive=20
working fluid instead of water.&nbsp;&nbsp;<SPAN =
class=3D121455215-25032008><FONT=20
face=3DArial color=3D#0000ff size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>That might not carry =
quite as much=20
heat as water, but it would surely&nbsp;<SPAN =
class=3D121455215-25032008><FONT=20
face=3DArial color=3D#0000ff size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>carry more than air =
and if chosen=20
correctly would have more benign results&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>when the inevitable =
leaks and=20
spills occur.&nbsp;&nbsp;<BR><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>HCFC-123 is likely what would be used, which =
means that you=20
would want to limit the amount of time that you spend inside&nbsp;the =
data=20
center because, with the large&nbsp;number of connections in the =
facility, leaks=20
will&nbsp;be inevitable and&nbsp;inhaling the gas causes liver=20
damage.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN =
class=3D121455215-25032008></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>Essentially, you are saying that we should get =
rid of=20
chillers&nbsp;and turn the entire data center into a giant chiller. =
Instead of=20
being a building with rooms and equipment, the data center becomes a =
machine and=20
humans only venture inside when&nbsp;the machine is shut down for=20
maintenance.</FONT>&nbsp;</SPAN></DIV><SPAN =
class=3D121455215-25032008><FONT=20
face=3DArial color=3D#0000ff size=3D2></FONT></SPAN>
<DIV dir=3Dltr align=3Dleft><SPAN =
class=3D121455215-25032008>&nbsp;</SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; &nbsp;</FONT></SPAN>Less practical but =
more fun to=20
contemplate would be data centers pressurized&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>with a working gas =
that offers=20
better heat transfer than oxygen/nitrogen and no&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>oxidation =
potential.&nbsp;=20
Airlocks and suits for the techs, but no fire worries =
ever.&nbsp;&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>Heck, just close the =
room and=20
inject liquid nitrogen under the raised floor to be&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt; </FONT>&nbsp;</SPAN>scavenged overhead and =

re-compressed, chilled, liquefied and sent round again.&nbsp;<SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&gt;</FONT>&nbsp;</SPAN> Reserve cooling for =
power outages=20
is just huge dewars full of liquid nitrogen :)<BR><BR><SPAN=20
class=3D121455215-25032008><FONT face=3DArial color=3D#0000ff =
size=3D2>&nbsp;<FONT=20
face=3D"Times New Roman" color=3D#000000 size=3D3>&gt; =
</FONT>&nbsp;</FONT></SPAN>Not=20
so serious today,<BR><SPAN class=3D121455215-25032008><FONT face=3DArial =

color=3D#0000ff size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>Why not? If you take your pressurized liquid =
nitrogen=20
scenario and turn it inside out, then&nbsp;it might well be workable and =
there=20
would&nbsp;be no need for suits. For instance,&nbsp;imagine =
a&nbsp;cylinder=20
containing the liquid nitro cooling (liquid air might be =
cheaper)&nbsp;with=20
devices attached all around like the petals on a flower. Each device=20
has&nbsp;heat exchangers for cooling the hottest parts (CPUs) and the =
heat=20
exchangers are attached to the cooling cylinder. With =
continued&nbsp;increase in=20
density of cores, this could be feasible. In essence it would be a kind =
of blade=20
server with the cooling and&nbsp;backplane in a central cylinder. Added =
benefits=20
might come from supercooling the backplane.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>Consider what is happening&nbsp;beyond the =
consumer dual=20
and 8-core (PS3) machines. </FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&lt;<A=20
href=3D"http://www.tilera.com/products/boards.php">http://www.tilera.com/=
products/boards.php</A>&gt;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>&lt;<A=20
href=3D"http://www.sicortex.com/architecture_tour">http://www.sicortex.co=
m/architecture_tour</A>&gt;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN =
class=3D121455215-25032008>&nbsp;</SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D121455215-25032008><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>--Michael Dillon</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN=20
class=3D121455215-25032008></SPAN>&nbsp;</DIV></BODY></HTML>

------_=_NextPart_001_01C88E91.D8DBE105--


home help back first fref pref prev next nref lref last post