This entry | Main blog

***Dave Does the Blog

Thursday, 2 December 2004, 3:39 PM
Magic

The magic of Google:

When Arthur C. Clarke said that any sufficiently advanced technology is indistinguishable from magic, he was alluding to the trick of hiding the complexity of the job from the audience, or the user. Nobody hides the complexity of the job better than Google does ....

Google is, in many ways, exactly what we expected computers to be forty or fifty years ago -- near-instantaneous return of any information requested. In some ways, if it's not on Google, it doesn't actually exist, as far as the Internet is concerned. While Google has refrained from being a portal per se, for many people, it is the most important interface to the Net.

The statistics -- the non-magical bits -- behind Google is astonishing.

* Over four billion Web pages, each an average of 10KB, all fully indexed
* Up to 2,000 PCs in a cluster
* Over 30 clusters
* 104 interface languages including Klingon and Tagalog
* One petabyte of data in a cluster -- so much that hard disk error rates of 10**-15 begin to be a real issue
* Sustained transfer rates of 2Gbps in a cluster
* An expectation that two machines will fail every day in each of the larger clusters
* No complete system failure since February 2000

Amazing.


Filed under :: Hi-Tech

Friday, 3 December 2004, 5:35 AM
Quoth Zachary Braverman ...

Actually, they recently increased their count to about 8 b. If you go now you can see that it says 8,058,044,651.

Friday, 3 December 2004, 7:08 AM
Quoth *** Dave ...

Yowzers. Amazing.

Original material on this weblog is available under a Creative Commons License (http://creativecommons.org/licenses/by-nc/1.0/) from
The views expressed by me on this website/weblog are mine alone and do not necessarily reflect the views of
my employer, my church, my party, my candidate, my community, my spouse, or, on occasion, myself.
Views expressed by others are, well, theirs.
This document's URL is: http://www.hill-kleerup.org/blog/2004/12/02/magic.html