Tuesday, November 20, 2007

The Wayback Machine

The Time Machine
 
19 Nov 2007
 

In 1996, I opened Libtech, the UK's main exhibition for librarians. I had an urgent message to deliver. I'd noticed that web sites were not just appearing in growing numbers, they were disappearing, too. People were updating pages all the time and nobody was keeping any sort of record - not even the people running the sites.

Libraries had preserved much of our past on paper, but our digital history was almost blank, and could never be retrieved. Who would save it, if not librarians?

Fortunately someone else had not only thought about it, he had decided to do it. In 1996, Brewster Kahle of Alexa Internet in San Francisco started keeping snapshots of the web to create the Internet Archive. In 2001, he launched the Wayback Machine, making about 10 billion archived pages publicly available.

Even at this early stage, Kahle's data took up about 100 terabytes, making it about five times as large as a digital US Library of Congress. Today, it has 85 billion pages and takes up 1.5 petabytes.

Anytime and forever

Kahle's ultimate aim is even more ambitious. In a CNet interview in Second Life, he said: "We're out to help build the Library of Alexandria version 2, starting with humankind's published works, books, music, video, web pages, software, and make it available to everyone anywhere at anytime, and forever."

Kahle is also working to make this a global system, starting with another copy of the archive at the Library of Alexandria in Egypt.

As a result, anyone can now go to the Wayback Machine, paste in a web address, click the button that says Take Me Back, and see what it looked like in the otherwise dim but not so distant past.

What you get is a list of the dates when a snapshot was taken, arranged by year. Clicking a link brings up a cached copy of the page. The record is necessarily incomplete, but it's enough to track things like changes in design.

In the Guardian's case, the first page is dated a month after my talk. There are only three snapshots for 1997, and four for 1998. There are 202 for this year, so far.

History in the making

In some cases, the archive's curators have put together packages that cover historical events. These Web Collections include US elections, hurricanes Katrina and Rita, and the December 2004 Asian Tsunami.

The Wayback Machine can be useful. The web is a boulevard of broken links, and so it is the only way you can see what a site looked like before the creator lost interest, the company went bust, or a once-popular address was taken over by spammers. But even when it doesn't have what you want, it's a wonderful place to browse.

It may be frustrating when pages or vital pictures are missing, or the Wayback Machine seems to be taking an hour off. But this is a not-for-profit organisation heroically tackling an impossible task. If Kahle had left it to publishers, librarians, corporations or even governments, it wouldn't exist at all.

~ Link ~

~ The Wayback Machine ~

 

 

No comments:


Google
 

image from http://www.spitting-image.net

Favorite Links

~325~ ~9-11...Who Really Did It~ ~10:10~ ~10 Zen Monkeys~ ~911 Truth~ ~13 Indigenous Grandmothers~ ~15O~ ~15th October~ ~Activist Post~ ~ACT UP~ ~Adbusters~ ~Aerogaz (greek)~ ~Afinity Project~ ~Aging Hipsters~ ~Alecto's Ophelia~ ~Al-Jazeera~ ~Alex Constantine's Blacklist~ ~Alliance for Human Research Protection~ ~All Things Cynthia McKinney~ ~All Things Pakistan~ ~Alternative Insight~ ~Alternative Press Review~ ~Alternet~ ~American Friends Service Committee~ ~American Street~ ~Anarkismo~ ~Andy Worthington~ ~Anglican Pacifist Fellowship~ ~Anomaly News Syndicate~ ~Another Day In The Empire~ ~AntiWar~ ~Antiwar League~ ~Anxiety Culture~ ~Appeal For Redress From The War In Iraq~ ~A Poetic Justice~ ~Artists Without Frontiers~ ~Art of Europe~ ~Arts And Letters Daily~ ~Attack the System~ ~Athens IMC~ ~Ballardian~ ~Bilderberg.org~ ~Black Box Voting~ ~BlackListed News~ ~Black Vault~ ~Blog Bioethics net~ ~Blog of the Unknown Writer~ ~Blondsense~ ~Boiling Frog~ ~Boiling Frogs Post~ ~BoingBoing~ ~Book Ninja~ ~Bookslut~ ~Bradley Manning Support Network~ ~Brand New Law~ ~Brainsturbator~ ~Bring Them Home Now~ ~Bruce Eisner's Vision Thing~ ~Buckminster Fuller Institute~ ~Bulletin of the Atomic Scientists~ ~Bureau of Public Secrets~ ~Business & Human Rights Resource Centre~ ~Buzzflash~ ~Campaign For Real Farming~ ~Catapult the Propaganda~ ~Campus Antiwar Network~ ~Cargo Culte~ ~Castan Centre for Human Rights Law~ ~Catch of the Day~ ~Censorship Paradise~ ~Center for Media and Democracy~ ~Centre for Conflict and Peace Studies, Afghanistan~ ~Centre for Research and Action for Peace~ ~Center on Law and Security~ ~Chapati Mystery~ ~Choike~ ~Chomsky.info~ ~Chronicle of Higher Education~ ~Church of the FSM~ ~CIA & Drugs~ ~Citizens for Legitimate Government~ ~Citizens for Tax Justice~ ~Clandestina~ ~CODEPINK~ ~Coilhouse mag~ ~Collateral Murder~ ~Common Dreams~ ~Complete 9/11 Timeline~ ~Concerned Africa Scholars~ ~Connexions~ ~Conspiracy Archive~ ~Contra Info~ ~Corrente~ ~COTO Report~ ~Coup d'Etat in America~ ~Countercurrents~ ~Crapaganda~ ~Create Real Democracy~ ~Creative-i~ ~Crimes of the State~ ~CrimethInc~ ~Crisis Group~ ~Critical Legal Thinking~ ~Cronache da Mileto (Italian)~ ~Crooks and Liars~ ~Crowd Modelling~ ~Cryptoforestry~ ~Cryptome~ ~Cyclos~ ~Culture Change~ ~Cutting Through The Matrix~ ~Cyrano's Journal~ ~Daily What~ ~Damn Interesting~ ~Dangerous Minds~ ~Deliberative Democracy Consortium~ ~Democracy Center~ ~Democracy Journal~ ~Democracy Now~ ~Democratic Underground~ ~Detournement~ ~Digital Rights [greek lang.]~ ~Diplomacy Lessons~ ~Direct Power!~ ~Discoveries-Researchings-Visions-Understandings-Enlightenments~ ~Disinformation~ ~DistributorCap NY~ ~Dr Hugo Heyrman-Motions of the Mind~ ~Dylanology~ ~EAGAINST~ ~Earthnocentric~ ~Eco Tort~ ~Ectoplasmosis!~ ~Educate Yourself~ ~E-Flux~ ~Electronic Frontier Foundation~ ~Electronic Intifada~ ~Eliminate War Forever~ ~End Evil~ ~Energy Bulletin~ ~Eradicating Ecocide~ ~EROCx1 Blog~
~Europeanrevolution~ ~European Revolution~ ~Eurozine~ ~Exposing the Truth~ ~Extinction Protocol: 2012 and beyond~ ~Families of the Fallen for Change~ ~Fellowship of Reconciliation~ ~Financial Armageddon~ ~FKN Newz~ ~Food For Your Eyes~ ~Forward the Revolution~ ~Franchot's Band~ ~Free Bloggers in Greece~ ~Free Expression Network~ ~Free Press International~ ~Freethinking for Dummies~ ~Free Thought Manifesto~ ~From the Wilderness~ ~F-t-W's Peak Oil Blog~ ~G1000~ ~Ghostdancing in Venice~ ~GIMP~ ~Gilles Duley~ ~Global Guerillas~ ~Global Integrity~ ~Global Policy Forum~ ~Global Revolution~ ~Global Security Institute~ ~Global Voices Online~ ~Gold Star Families for Peace~ ~Government Dirt~ ~Greek Alert [greek lang.]~ ~Greek Assembly in London~ ~Green Left Weekly~ ~Groklaw~ ~Hack Democracy~ ~Hakim Bey and Ontological Anarchy~ ~Hiroshima Peace Institute~ ~History Is A Weapon Blog~ ~How Appealing~ ~How To Vanish~ ~Human Rights Law Review~ ~I Can't Believe It's Not a Democracy!~ ~Idler~ ~Impropaganda~ ~Independent Media Center~ ~INIREF~ ~Institute for Media Peace and Security~ ~International Action Center~ ~International ANSWER (Act Now to Stop War and End Racism)~ ~In These Times~ ~Information Clearing House~ ~Information Liberation~ ~Infoshop~ ~Institute for Policy Studies~ ~Institute for War and Peace Reporting~ ~Insurgent American~ ~Intel Hub~ ~International Labor Rights Forum~ ~Intrinsic Impact~ ~Invisible History~ ~Iraq Citizens Against the War~ ~Iraq Freedom Congress~ ~Iraq Veterans Against the War~ ~Irish Peace Institute~ ~Issues and Alibis~ ~James Howard Kunstler~ ~Jesus Radicals~ ~John Zerzan~ ~Jorgen Schäfer's Homepage~ ~JUST~ ~Just For The Love Of It~ ~Justice Not Vengeance~ ~Kasama Project~ ~Keep Talking Greece~ ~Kia Mistilis~ ~Kill Me If You Can by Bob Miller~ ~Killer Coke~ ~Labor Rights~ ~Labor Rights Now~ ~Labour Start~ ~Lava Cocktail~ ~Lemon Gloria~ ~Lemony Snicket~ ~L'ennui mélodieux~ ~Lessig~ ~Liberation Theology~ ~Libertarians for Peace~ ~Life After the Oil Crash~ ~Life & Peace Institute~ ~Lunch Street Party~ ~Lycaeum~ ~Links by George~ ~Literary Kicks~ ~Lubinproductions~ ~MacNN~ ~Mad Cow Morning News~ ~Manageable Ants~ ~Mario Profaca's Cyberspace Station~ ~Maro Kouri~ ~Maud Newton~ ~May it Please the Court~ ~McSpotlight~ ~Medical Foundation for the Care of Victims of Torture~ ~Metta Center for Nonviolence~ ~Metanoia~ ~Michael Moore - Must Read~ ~Mind Control~ ~Military Families Speak Out~ ~Mind in Peace (greek)~ ~Miss Welby~ ~MK Gandhi Institute for Nonviolence~ ~Molly's Blog~ ~Mother Jones~ ~MungBeing Magazine~ ~MyAntiwar.org~ ~n +1 mag~ ~National War Tax Resistance Coordinating Committee~ ~Natural Farming~ ~Neatorama~ ~Neuromarketing~ ~Neurosecurity~ ~New Internationalist~ ~News Dissector~ ~News Frames~ ~News Making News~ ~News Now~ ~New Tactics in Human Rights~ ~New World Dawning~ ~NEXUS~ ~NFAK~ ~Nomadic Academy Of Fools~ ~Non Fides~ ~Noor Images~ ~Not In Our Name~ ~Not Stupid~ ~Nuclear Resister~ ~NUTOPIA2~ ~[Occupy] 2012 Scenario~ ~Occupy America Social Network~ ~OCCUPY Cafe~ ~Occupy Istanbul~ ~Occupy Together~ ~Occupy Together Field Manual~ ~OWS~ ~Occupy Writers~ ~October 2011~ ~Odious Debts~ ~ODYS~ ~Olmaz~ ~On the Path to 2012~ ~Op Ed News~ ~Open Letters to George W. Bush from his ardent admirer,Belacqua Jones~ ~Open Revolt!~ ~Open Source Ecology~ ~Orthodox Peace Fellowship~ ~Orwell Today~ ~Outlaw Journalism~ ~OWNI~ ~Patriots Question 9/11~ ~Peace in Mind (greek)~ ~PeaceJam~ ~Peace Now~ ~Peaceful Tomorrows~ ~Peak Moment~ ~People's Assemblies Network~ ~Peter Frase~ ~Photography is Not a Crime~ ~Picture the Homeless~ ~Pieman~ ~Places the U.S. has bombed~ ~Pogo Was Right - privacy news~ ~Political Reform.ie~ ~Post Carbon Institute~ ~Praxis Peace Institute~ ~Primate Poetics~ ~Prisoner Solidarity~ ~Professors question 9/11~ ~Project Camelot~ ~Project Censored~ ~Project for the Old American Century~ ~Project on Corporations, Law and Democracy~ ~Psyche, Science and Society~ ~Psychogeography~ ~Public Employees for Environmental Responsibility~ ~Radical Anthropology~ ~Rainbow Family~ ~RawStory~ ~Reality Sandwich~ ~Real Democacy GR~ ~Real Democracy Now.net~ ~Rebel Dog~ ~Reflections on a Revolution~ ~Reporters Without Borders~ ~Re-public~ ~Resistance Studies Magazine~ ~Resource Based Economy Foundation~ ~Re-volt Radio~ ~Richard Heinberg's Museletter~ ~Rockefeller's War on Drugs~ ~Ruckus Society~ ~Sacred Texts~ ~Salon~ ~Save Orphan Works~ ~Scholars and Rogues~ ~Scoop~ ~SCOTUS Blog~ ~Secrecy News~ ~Service Academy Graduates Against the War~ ~Shadow Government Statistics~ ~Signs of the Times News~ ~Slovenia Peace Institute~ ~Smirking Chimp~ ~smygo~ ~SNU Project~ ~Soil And Health Library~ ~SourceWatch~ ~Speaking Truth to Power~ ~Spirit Horse Foundation~ ~Spunk~ ~Squattastic~ ~Starhawk~ ~Stockholm International Peace Research Institute~ ~StopCartel TV-GR~ ~Stop The Arms Fair~ ~Stop the Spying.org~ ~Strangers in a Tangled Wilderness~ ~Students Against War~ ~Survival Acres~ ~Survival International~ ~Swan's Commentary~ ~Take The Square~ ~Tangible Information~ ~Tax Justice Network~ ~Tax Research UK~ ~Theatre of the Oppressed~ ~The Black Commentator~ ~The Black Vault~ ~The Borowitz Report~ ~The Carpetbagger Report~ ~The Center for Public Integrity~ ~The Daily Reckoning~ ~The Dark Age Blog~ ~The Digger Archives~ ~The End of Being~ ~The Guardian~ ~The Hidden Evil~ ~The Huffington Post~ ~The Intelligence Daily~ ~The Lazy Man's Guide To Enlightenment~ ~The Mountain Sentinel~ ~The Nation~ ~The National Security Archive~ ~The New Z-Land Project~ ~The Other Israel~ ~The Pathology Guy~ ~The Progress Report~ ~The Progressive Magazine~ ~The Real News~ ~The Situation Room~ ~The Truth Seeker~ ~ The Watcher Files~ ~Think Progress~ ~Third World Traveller~ ~This Land Is Ours~ ~This Modern World~ ~TomDispatch~ ~Total Collapse~ ~Total Dick-Head~ ~Transform!~ ~Transnational Institute~ ~Transnational Foundation for Peace and Future Research~ ~True Democracy~ ~Troops Out Now~ ~True Democracy Party~ ~Truthdig~ ~Truth News~ ~Truthout~ ~TW3 and fotografia la dolce vita~ ~Uncommon Thought~ ~United for Peace & Justice~ ~United States Institute of Peace~ ~Unknown News~ ~UNPA Campaign~ ~Urbanibalism~ ~US Labor Against the War~ ~VBS TV~ ~Veterans Against the Iraq War~ ~Veterans for Peace and Justice~ ~Video Rebel's Blog~ ~Vietnam Veterans Against the War~ ~Virusmyth - Rethinking AIDS~ ~visionOntv~ ~Voices for Creative Non-Violence~ ~Void Network~ ~Voice Memo~ ~Voters for Peace~ ~Waging Nonviolence~ ~Waking the Midnight Sun~ ~Want To Know~ ~War Costs~ ~War Crimes and Military Improprieties~ ~War Criminals Watch~ ~War on Society~ ~War is Illegal~ ~War Resisters International~ ~War Resisters League~ ~Was Jack Kerouac a Punjabi?~ ~Watergate Exposed~ ~West Point Graduates Against The War~ ~What Really Happened~ ~What’s On My Food?~ ~Why Work? Creating Livable Alternatives to Wage Slavery~ ~Wikileaks~ ~WikiLeaks Central~ ~Wild Wild Left~ ~willyloman~ ~Winning Cancer~ ~Win Without War~ ~Women's International League for Peace and Freedom (WILPF)~ ~Wonkette~ ~World Prout Assembly~ ~Worldwide Hippies~ ~Yes Lab~ ~Yippie Museum~ ~Young Protester~ ~Youth Against War and Racism (YAWR)~ ~Zapatistas~ ~Zine Library~ ~Zippy Elder-at-Large~ ~ZMag~
~ Thank you for visiting Circle of 13 ~

FAIR USE NOTICE

This blog may contain videos with copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in an effort to advance understanding of environmental, political, human rights, economic, democracy, scientific, and social justice issues, etc. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes.