[25894] in resnet

home help back first fref pref prev next nref lref last post

Re: how do you handle streaming video?

daemon@ATHENA.MIT.EDU (Miller, Gregory William)
Wed Feb 2 09:31:52 2011

Content-Language: en-US
Content-Type: multipart/alternative; boundary="_000_E5F9E11A03C48240A148BB141C11C48B0BE193D205PITTEXCH10uni_"
MIME-Version: 1.0
Message-ID:  <E5F9E11A03C48240A148BB141C11C48B0BE193D205@PITT-EXCH-10.univ.pitt.edu>
Date:         Wed, 2 Feb 2011 09:30:56 -0500
Reply-To: Resnet Forum <RESNET-L@listserv.nd.edu>
From: "Miller, Gregory William" <gwm9@pitt.edu>
To: RESNET-L@listserv.nd.edu
In-Reply-To:  <4F5F31A69D45B746B439BDA98B62378D8FC2F65769@EXCMS.msu.montana.edu>

--_000_E5F9E11A03C48240A148BB141C11C48B0BE193D205PITTEXCH10uni_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

We too are experiencing similar issues, and believe streaming media to a ma=
jor contributing factor.


A little off topic, but I feel worth mentioning... It is my opinion that ba=
ndwidth allotments for the average home user certainly haven't decreased in=
 recent years; meaning five years ago I could pick up a cable modem interne=
t package at 6Mbps, and today I still have that same connection. The differ=
ence being that five years ago, I never needed that throughput, but today, =
with everybody and their brother producing on demand video/audio content, I=
 can certainly bump up against it. Recently we have seen a majority of the =
major tv networks offer their tv shows, plus extra "internet only" content,=
 the day after the show airs. Additionally NetFlix on demand service is ext=
remely popular with our students. Our users are coming from an environment =
where they have ungodly amounts of bandwidth allotment for 1 or 2 users (Fi=
OS) and are expecting the same, if not better, experience when they come to=
 a University.



The other change that I have noticed, is student's ability to consume data!=
 A perfect example was right outside of our office. A student was sitting a=
t a table with her BlackBerry, iPod (could have been streaming media), and =
her laptop. All three device connected to our wifi. I have also noticed, wh=
ile looking at flow data, that users are multitasking from the same device.=
 For instance, viewing pictures on facebook, while listening to Pandora or =
having a Netflix movie running. Or perhaps "facebooking" while using a gami=
ng console to stream Netflix or game. Many combinations of fairly bandwidth=
 intensive activities.



In an attempt to combat the apparent increase in streaming media demand, we=
 have been demoing a caching proxy server. This appliance spoofs dns to for=
ce specified websites through it; caching content, then re-serving future r=
equests for the same content locally. We have had mixed results, with an av=
erage savings of only 28%,  however the statistics are shocking (at least t=
o me). Our on campus population (ResNet) is approaching 900 users. Every si=
ngle day the caching proxy does over 50 GB (gigabytes) of internet traffic =
from ONLY youtube and facebook! This is roughly 15% of all inbound (from in=
ternet) traffic to our entire campus.



We are also using a bluecoat shaper in an application tree setup. We have a=
 streaming media partition that includes: generic flash video, youtube, Pan=
dora, Silverlight (NetFlix), Quicktime and a few others. After shaping (cap=
ping) Silverlight our overall average inbound rate has slightly decreased. =
Our P2P partition is nearly non-existent, allowing just 100Kbps. BitTorrent=
 is being blocked, but as expected, our "advanced users" have found ways ar=
ound it.



We have ~900 students who are allowed 39Mbps during the day and ~60Mbps in =
the evenings. When the allotment changes, around 5:30pm, the traffic instan=
taneously jumps from 39Mbps to 60Mbps in a matter of minutes.


From: Resnet Forum [mailto:RESNET-L@LISTSERV.ND.EDU] On Behalf Of Crowe, Sh=
eila
Sent: Tuesday, February 01, 2011 6:33 PM
To: RESNET-L@LISTSERV.ND.EDU
Subject: how do you handle streaming video?

Recently (this past fall), two changes were made to our bandwidth pipe.


1.       We paid for an additional 100 mbps to add to the 200 mbps we were =
paying for.

2.       Before this change, ResNet shared the whole commodity internet pip=
e with the rest of the campus (400 mbps); after this upgrade, we were limit=
ed to 300 mbps only.

What has changed so dramatically from last year that even our increased ban=
dwidth isn't near enough to handle the demand? Because we are hitting the 3=
00 mbps threshold every single day.  Our network admins (my vendor, so to s=
peak) tell me that it is streaming video and p2p traffic.  We had streaming=
 video last year and p2p traffic.  Unless they removed the shaping for p2p =
traffic, I can't see that that traffic should ramp up so significantly this=
 year.

So what are other schools doing about this increased demand on their bandwi=
dth?  Are you seeing this same, significant increase in demand?  If nothing=
 has changed for us from last year except for our increase in bandwidth,  w=
hy does our service suck so much for our customers?  Anyone?

Sheila Crowe
Montana State University ResNet
___________________________________________________ You are subscribed to t=
he ResNet-L mailing list.

To subscribe, unsubscribe or search the archives, go to http://LISTSERV.ND.=
EDU/archives/resnet-l.html ________________________________________________=
___

___________________________________________________
You are subscribed to the ResNet-L mailing list.

To subscribe, unsubscribe or search the archives,
go to http://LISTSERV.ND.EDU/archives/resnet-l.html
___________________________________________________

--_000_E5F9E11A03C48240A148BB141C11C48B0BE193D205PITTEXCH10uni_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:x=3D"urn:schemas-microsoft-com:office:excel" xmlns:m=3D"http://schema=
s.microsoft.com/office/2004/12/omml" xmlns=3D"http://www.w3.org/TR/REC-html=
40"><head><meta http-equiv=3DContent-Type content=3D"text/html; charset=3Du=
s-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 (filtered medi=
um)"><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
p
	{mso-style-priority:99;
	mso-margin-top-alt:auto;
	margin-right:0in;
	mso-margin-bottom-alt:auto;
	margin-left:0in;
	font-size:12.0pt;
	font-family:"Times New Roman","serif";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
	{mso-style-priority:34;
	margin-top:0in;
	margin-right:0in;
	margin-bottom:0in;
	margin-left:.5in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
span.EmailStyle18
	{mso-style-type:personal;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
span.EmailStyle20
	{mso-style-type:personal-reply;
	font-family:"Calibri","sans-serif";
	color:#1F497D;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
/* List Definitions */
@list l0
	{mso-list-id:47388304;
	mso-list-type:hybrid;
	mso-list-template-ids:33093738 67698703 67698713 67698715 67698703 6769871=
3 67698715 67698703 67698713 67698715;}
@list l0:level1
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level2
	{mso-level-tab-stop:1.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level3
	{mso-level-tab-stop:1.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level4
	{mso-level-tab-stop:2.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level5
	{mso-level-tab-stop:2.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level6
	{mso-level-tab-stop:3.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level7
	{mso-level-tab-stop:3.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level8
	{mso-level-tab-stop:4.0in;
	mso-level-number-position:left;
	text-indent:-.25in;}
@list l0:level9
	{mso-level-tab-stop:4.5in;
	mso-level-number-position:left;
	text-indent:-.25in;}
ol
	{margin-bottom:0in;}
ul
	{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue vli=
nk=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span style=3D'c=
olor:#1F497D'>We too are experiencing similar issues, and believe streaming=
 media to a major contributing factor.<o:p></o:p></span></p><p class=3DMsoN=
ormal><span style=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><p class=3D=
MsoListParagraph style=3D'margin-left:0in'><span style=3D'color:#1F497D'>A =
little off topic, but I feel worth mentioning&#8230; It is my opinion that =
bandwidth allotments for the average home user certainly haven&#8217;t decr=
eased in recent years; meaning five years ago I could pick up a cable modem=
 internet package at 6Mbps, and today I still have that same connection. Th=
e difference being that five years ago, I never needed that throughput, but=
 today, with everybody and their brother producing on demand video/audio co=
ntent, I can certainly bump up against it. Recently we have seen a majority=
 of the major tv networks offer their tv shows, plus extra &#8220;internet =
only&#8221; content, the day after the show airs. Additionally NetFlix on d=
emand service is extremely popular with our students. Our users are coming =
from an environment where they have ungodly amounts of bandwidth allotment =
for 1 or 2 users (FiOS) and are expecting the same, if not better, experien=
ce when they come to a University.<o:p></o:p></span></p><p class=3DMsoListP=
aragraph style=3D'margin-left:0in'><span style=3D'color:#1F497D'><o:p>&nbsp=
;</o:p></span></p><p class=3DMsoListParagraph style=3D'margin-left:0in'><sp=
an style=3D'color:#1F497D'>The other change that I have noticed, is student=
&#8217;s ability to consume data! A perfect example was right outside of ou=
r office. A student was sitting at a table with her BlackBerry, iPod (could=
 have been streaming media), and her laptop. All three device connected to =
our wifi. I have also noticed, while looking at flow data, that users are m=
ultitasking from the same device. For instance, viewing pictures on faceboo=
k, while listening to Pandora or having a Netflix movie running. Or perhaps=
 &#8220;facebooking&#8221; while using a gaming console to stream Netflix o=
r game. Many combinations of fairly bandwidth intensive activities.<o:p></o=
:p></span></p><p class=3DMsoListParagraph style=3D'margin-left:0in'><span s=
tyle=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoListParagr=
aph style=3D'margin-left:0in'><span style=3D'color:#1F497D'>In an attempt t=
o combat the apparent increase in streaming media demand, we have been demo=
ing a caching proxy server. This appliance spoofs dns to force specified we=
bsites through it; caching content, then re-serving future requests for the=
 same content locally. We have had mixed results, with an average savings o=
f only 28%, &nbsp;however the statistics are shocking (at least to me). Our=
 on campus population (ResNet) is approaching 900 users. Every single day t=
he caching proxy does over 50 GB (gigabytes) of internet traffic from ONLY =
youtube and facebook! This is roughly 15% of all inbound (from internet) tr=
affic to our entire campus.<o:p></o:p></span></p><p class=3DMsoListParagrap=
h style=3D'margin-left:0in'><span style=3D'color:#1F497D'><o:p>&nbsp;</o:p>=
</span></p><p class=3DMsoListParagraph style=3D'margin-left:0in'><span styl=
e=3D'color:#1F497D'>We are also using a bluecoat shaper in an application t=
ree setup. We have a streaming media partition that includes: generic flash=
 video, youtube, Pandora, Silverlight (NetFlix), Quicktime and a few others=
. After shaping (capping) Silverlight our overall average inbound rate has =
slightly decreased. Our P2P partition is nearly non-existent, allowing just=
 100Kbps. BitTorrent is being blocked, but as expected, our &#8220;advanced=
 users&#8221; have found ways around it.<o:p></o:p></span></p><p class=3DMs=
oListParagraph style=3D'margin-left:0in'><span style=3D'color:#1F497D'><o:p=
>&nbsp;</o:p></span></p><p class=3DMsoListParagraph style=3D'margin-left:0i=
n'><span style=3D'color:#1F497D'>We have ~900 students who are allowed 39Mb=
ps during the day and ~60Mbps in the evenings. When the allotment changes, =
around 5:30pm, the traffic instantaneously jumps from 39Mbps to 60Mbps in a=
 matter of minutes.<o:p></o:p></span></p><p class=3DMsoNormal><span style=
=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><span s=
tyle=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><div><div style=3D'borde=
r:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=
=3DMsoNormal><b><span style=3D'font-size:10.0pt;font-family:"Tahoma","sans-=
serif"'>From:</span></b><span style=3D'font-size:10.0pt;font-family:"Tahoma=
","sans-serif"'> Resnet Forum [mailto:RESNET-L@LISTSERV.ND.EDU] <b>On Behal=
f Of </b>Crowe, Sheila<br><b>Sent:</b> Tuesday, February 01, 2011 6:33 PM<b=
r><b>To:</b> RESNET-L@LISTSERV.ND.EDU<br><b>Subject:</b> how do you handle =
streaming video?<o:p></o:p></span></p></div></div><p class=3DMsoNormal><o:p=
>&nbsp;</o:p></p><p class=3DMsoNormal>Recently (this past fall), two change=
s were made to our bandwidth pipe.&nbsp; <o:p></o:p></p><p class=3DMsoNorma=
l><o:p>&nbsp;</o:p></p><p class=3DMsoListParagraph style=3D'text-indent:-.2=
5in;mso-list:l0 level1 lfo2'><![if !supportLists]><span style=3D'mso-list:I=
gnore'>1.<span style=3D'font:7.0pt "Times New Roman"'>&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp; </span></span><![endif]>We paid for an additional 100 mbps =
to add to the 200 mbps we were paying for.<o:p></o:p></p><p class=3DMsoList=
Paragraph style=3D'text-indent:-.25in;mso-list:l0 level1 lfo2'><![if !suppo=
rtLists]><span style=3D'mso-list:Ignore'>2.<span style=3D'font:7.0pt "Times=
 New Roman"'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </span></span><![endif]>B=
efore this change, ResNet shared the whole commodity internet pipe with the=
 rest of the campus (400 mbps); after this upgrade, we were limited to 300 =
mbps only.<o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=
=3DMsoNormal>What has changed so dramatically from last year that even our =
increased bandwidth isn&#8217;t near enough to handle the demand? Because w=
e are hitting the 300 mbps threshold every single day.&nbsp; Our network ad=
mins (my vendor, so to speak) tell me that it is streaming video and p2p tr=
affic.&nbsp; We had streaming video last year and p2p traffic.&nbsp; Unless=
 they removed the shaping for p2p traffic, I can&#8217;t see that that traf=
fic should ramp up so significantly this year.&nbsp; <o:p></o:p></p><p clas=
s=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>So what are other s=
chools doing about this increased demand on their bandwidth?&nbsp; Are you =
seeing this same, significant increase in demand?&nbsp; If nothing has chan=
ged for us from last year except for our increase in bandwidth,&nbsp; why d=
oes our service suck so much for our customers?&nbsp; Anyone?<o:p></o:p></p=
><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Sheila Crow=
e<o:p></o:p></p><p class=3DMsoNormal>Montana State University ResNet<o:p></=
o:p></p><p class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"T=
imes New Roman","serif"'>__________________________________________________=
_ You are subscribed to the ResNet-L mailing list. <o:p></o:p></span></p><p=
>To subscribe, unsubscribe or search the archives, go to <a href=3D"http://=
LISTSERV.ND.EDU/archives/resnet-l.html">http://LISTSERV.ND.EDU/archives/res=
net-l.html</a> ___________________________________________________ <o:p></o=
:p></p></div></body></html>=
___________________________________________________
You are subscribed to the ResNet-L mailing list.
<p>
To subscribe, unsubscribe or search the archives,
go to http://LISTSERV.ND.EDU/archives/resnet-l.html
___________________________________________________

--_000_E5F9E11A03C48240A148BB141C11C48B0BE193D205PITTEXCH10uni_--

home help back first fref pref prev next nref lref last post