[2879] in Privacy_Forum
[ PRIVACY Forum ] F1 - The Fault-Tolerant Distributed RDBMS
daemon@ATHENA.MIT.EDU (PRIVACY Forum mailing list)
Sat Jun 2 11:55:06 2012
Date: Sat, 2 Jun 2012 08:38:48 -0700
To: privacy-list@vortex.com
Message-ID: <20120602153848.GB25284@vortex.com>
MIME-Version: 1.0
Content-Disposition: inline
From: PRIVACY Forum mailing list <privacy@vortex.com>
Reply-To: PRIVACY Forum mailing list <privacy@vortex.com>
Content-Type: text/plain; charset="iso-8859-1"
Errors-To: privacy-bounces+privacy-forum=mit.edu@vortex.com
Content-Transfer-Encoding: 8bit
F1 - The Fault-Tolerant Distributed RDBMS Supporting Google's Ad
Business (SIGMOD 2012)
http://j.mp/K2J1Uk (Google Research [Abstract])
http://j.mp/K2Ji9W (Full Paper - PDF)
"Many of the services that are critical to Google's ad business have
historically been backed by MySQL. We have recently migrated several
of these services to F1, a new RDBMS developed at Google. F1
implements rich relational database features, including a strictly
enforced schema, a powerful parallel SQL query engine, general
transactions, change tracking and notication, and indexing, and is
built on top of a highly distributed storage system that scales on
standard hardware in Google data centers. The store is dynamically
sharded, supports transactionally-consistent replication across data
centers, and is able to handle data center outages without data loss.
The strong consistency properties of F1 and its storage system come at
the cost of higher write latencies compared to MySQL. Having
successfully migrated a rich customerfacing application suite at the
heart of Google's ad business to F1, with no downtime, we will
describe how we restructured schema and applications to largely hide
this increased latency from external users. The distributed nature of
F1 also allows it to scale easily and to support signicantly higher
throughput for batch workloads than a traditional RDBMS."
- - -
Obviously the approaches embodied in this work could have very wide
applicability in many other contexts.
--Lauren--
Lauren Weinstein (lauren@vortex.com): http://www.vortex.com/lauren
Co-Founder: People For Internet Responsibility: http://www.pfir.org
Founder:
- Data Wisdom Explorers League: http://www.dwel.org
- Network Neutrality Squad: http://www.nnsquad.org
- Global Coalition for Transparent Internet Performance: http://www.gctip.org
- PRIVACY Forum: http://www.vortex.com
Member: ACM Committee on Computers and Public Policy
Lauren's Blog: http://lauren.vortex.com
Google+: http://vortex.com/g+lauren / Twitter: http://vortex.com/t-lauren
Tel: +1 (818) 225-2800 / Skype: vortex.com
_______________________________________________
privacy mailing list
http://lists.vortex.com/mailman/listinfo/privacy
