[193058] in North American Network Operators' Group
Re: Wanted: volunteers with bandwidth/storage to help save climate
daemon@ATHENA.MIT.EDU (DaKnOb)
Fri Dec 16 11:42:52 2016
X-Original-To: nanog@nanog.org
From: DaKnOb <daknob.mac@gmail.com>
In-Reply-To: <20161216163008.GG28510@sizone.org>
Date: Fri, 16 Dec 2016 18:42:46 +0200
To: Ken Chase <math@sizone.org>
Cc: nanog@nanog.org, Rich Kulawiec <rsk@gsp.org>
Errors-To: nanog-bounces@nanog.org
We are currently working on a scheme to successfully authenticate and =
verify the integrity of the data. Datasets in =
https://climate.daknob.net/ are compressed to a .tar.bz2 and then hashed =
using SHA-256. The final file with all checksums is then signed using a =
set of PGP keys.
We are still working on a viable way to verify the authenticity of files =
before there are tons of copies lying around and there=E2=80=99s a =
working group in the Slack team I sent previously where your input is =
much needed!
Thanks,
Antonios=20
> On 16 Dec 2016, at 18:30, Ken Chase <math@sizone.org> wrote:
>=20
> Surfing through the links - any hints on how big these datasets are? =
Everyone's got
> a few TB to throw at things, but fewer of us have spare PB to throw =
around.
>=20
> There's some random #s on the goog doc sheet for sizes (100's of TB =
for the
> landsat archive seems credible), and there's one number that destroys
> credibility of the sheet (100000000000 GB (100 ZB)) for the EPA =
archive.
>=20
> The other page has many 'TBA' entries for size.
>=20
> Not sure what level of player one needs to be to be able to serve a =
useful=20
> segment of these archives. I realize some of the datasets are tiny =
(<GB)
> but which ones are most important vs size (ie the win-per-byte ratio) =
isnt indicated.
> (I know its early times.)
>=20
> Also I hope they've SHA512'd the datasets for authenticity before all =
these
> myriad copies being flungabout are 'accused' of being manipulated 'to =
promote
> the climate change agenda' yadda.
>=20
> Canada: time to step up! (Cant imagine the Natl Research Council would =
do so
> on their mirror site, too much of a gloves-off slap in the face to =
Trump.)
>=20
> /kc
>=20
>=20
> On Fri, Dec 16, 2016 at 06:02:46PM +0200, DaKnOb said:
>> If you???re interested, there???s also a Slack team: =
climatemirror.slack.com
>>=20
>> You can find more info about that here:
>>=20
>> - https://climate.daknob.net/
>> - http://climatemirror.org/
>> - http://www.ppehlab.org/datarefuge
>>=20
>> Thank you for your help!
>>=20
>>=20
>>> On 16 Dec 2016, at 17:58, Rich Kulawiec <rsk@gsp.org> wrote:
>>>=20
>>> This is a short-term (about one month) project being thrown together
>>> in a hurry...and it could use some help. I know that some of
>>> you have lots of resources to throw at this, so if you have an
>>> interest in preserving a lot of scientific research data, I've set
>>> up a mailing list to coordinate IT efforts to help out. Signup via
>>> climatedata-request@firemountain.net or, if you prefer Mailman's web
>>> interface, http://www.firemountain.net/mailman/listinfo/climatedata
>>> should work.
>>>=20
>>> Thanks,
>>> ---rsk
>>>=20
>>=20
>=20
> --=20
> Ken Chase - math@sizone.org Guelph Canada
