Digital information
The Internet Archive records a snapshot of all the information on the web

Sun upgrades Internet Archive to 4.5 petabytes

Wayback Machine swelling by 100 terabytes a month

Written by Iain Thomson in San Francisco

Sun Microsystems has upgraded the Internet Archive to a capacity of 4.5 petabytes. The archive has been recording a snapshot of all the information on the web every two months since 1997, storing it in a searchable online archive known as the Wayback Machine.

"The Internet Archive offers long-term digital preservation to the ephemeral internet," said Brewster Kahle, founder of the Internet Archive organisation.

"As more of the world's most valuable information moves online and data grows exponentially, the Internet Archive will serve as a living history to ensure that future generations can access and continue to preserve these important documents over time."

The entire system is installed in a single shipping container containing 63 Sun Fire x4500 servers running multi-core x86 processors. The system is run on Solaris 10 with ZFS.

"We have worked closely with the Internet Archive to ensure that the right technology platform is in place to handle and manage growing amounts of the world's most valuable data, and that it lives on for future generations," said Dave Douglas, chief sustainability officer and senior vice president of cloud computing at Sun.

The Internet Archive is run from a site in the Presidion complex in San Francisco, and currently holds around three petabytes of data. This increases by around 100 terabytes each time the web is mirrored.

The information was held in an offsite datacentre, and Sun will now host the container on its Santa Clara campus.

  • Have your say
  • Send to a friend
  • Print this
  • Share

reader comments

related articles

GoogleCommunications

Google Voice takes on the telecoms giants

New service will challenge traditional telcos and VoIP providers 12 Mar 2009

 

Google kicks off magazine project

Company plans to digitise old periodicals 11 Dec 2008

IBM outlines the future of storage

Vendor unveils services, products and research initiatives 09 Sep 2008

Nasa opens up space image library

Historic photographs, film and video available to the public 25 Jul 2008

FBI backs down on web gagging order

Internet Archive stands firm 08 May 2008

EFF co-founder John Gilmore wins FSF award

Free Software Foundation honours services to the community 24 Mar 2010

Oracle's StorageTek takes tape to 150 petabytes

Slot allocations and standards allow huge storage systems 27 Jul 2010

CommVault offers route to cloud storage

Vendor hopes new partners and technology will encourage cloud-based storage take-up 11 Feb 2010

related white papers

today's top stories

Financial IT job market recovery continues

Recruitment growth suggests IT budgets are increasing 30 Jul 2010

Satellite broadband touted as digital divide clincher

KA-SAT launch promises 10Mbit/s service for hard-to-reach locations 29 Jul 2010

Ofcom slams ISPs for exaggerated broadband speed claims

New code of practice for ISPs planned by the regulator 27 Jul 2010

Aerohive offers traffic light Wi-Fi monitoring

Firm promises simple 'red, yellow or green' system with Client Health Score tool 27 Jul 2010

Flaw in top wireless security protocol WPA2 uncovered

Disgruntled insiders could hack corporate wireless LAN 26 Jul 2010

Advertisement

How to achieve business and financial-system implementation success
A look at how organisations - regardless of size - can work towards successful business software installations and factors that determine the outcome.

Case study: Specsavers put customer care into focus
How Specsavers captured customer feedback at point of sale and incorporated the results into its CRM system.

Advertisement

Citrix

Keep up to date with the latest products, services and technologies from the world's leading IT companies; IThound.com brings you thousands of white papers, case studies and analyst reports.

Advertisement

Newsletter signup

Sign up for our range of FREE newsletters:

More available - click 'submit' to view

Existing User

Newsletter user login:

Jobs

Related jobs

Job of the week

Job alerts

Sign up here

Find your next job

IT Salary Checker

Check salary here

Advertisement

Latest poll

ICO to lean more heavily on public sector bodies

ICO to lean more heavily on public sector bodies

The ICO has said it will lean more heavily on public sector bodies to secure timely FOI responses, do you think this is:

View poll results

Latest audio and video articles

picture of Jason HartVideo

Ethical hacker reveals the security secrets behind cloud computing

Jason Hart, Senior VP at Cryptocard, shows Computing just how easy it is to illegally gain access to corporate cloud services to wreak havoc and steal money. 29 Jun 2010

gartner logoVideo

Part 1: 2010 trends in SOA and Application Development and Integration

Gartner analyst Paolo Malinverno explores trends in SOA 29 Jun 2010

Latest in-depth articles

Map of 3G coverageComment

The risks of selling off the 800MHz radio spectrum at the wrong price

It's a choice between revenue now or universal broadband later 30 Jul 2010

Luton Borough Council officesAnalysis

Local authority leads the way in digital backup technology

Luton Borough Council tells of the benefits of early adopter of VTL, data deduplication and virtualisation 27 Jul 2010

Primary Navigation