Simon and some users put a bunch of Tsunami videos on the Internet
Archive last week and it is dominating our access still (over 35% of
our accesses to non wayback machine data).
I am very happy with how the Archive staff responded-- well, uh, after
it broke several of our systems. The problem was not the bandwidth,
it is the hits to the website. We spread the videos onto a number of
machines, but these were even hit so hard the overloaded and caused the
website to wobble. We introduced caching of metadata, more efficient
scripting, more web servers, changes to our database backup, and now we
are serving smoothly.
We peak at about 1.4gigabits/sec of bandwidth out of the US and EU
Archives. We also are getting 100 hits per second to our website,
which is a record.
http://www.archive.org/search.php?query=tsunami
http://homeserver.archive.org/test-cgi/top_50_items.cgi
Now, lets get some more!
-brewster