than humankind has ever seen," said Homer Neal of the University of Michigan, a member of the ATLAS team. "They're going to produce petabytes of data per year. Right now we don't know how to handle that much data."
Petabytes of data means a thousand trillion bytes. This is the amount of data that can be stored by a million personal computer hard drives. These data are produced in Geneva, but scientists in universities and laboratories all over the world will want to use and analyze it.
Here's where the Grid becomes essential. Neal likens the situation to sitting in Michigan and trying to sip from a soda at the cafeteria in Geneva: you'd have to suck through a 3,000-mile- (4,800-kilometer-) long straw. That's why we'll need the Grid -- a network of computers all over the world that will work together to deal with these huge databases.
No one computer is powerful enough to do the job, so a worldwide pool of computers will be necessary.
"We'll collect resources of universities, supercomputers, national labs, etc. to build one great virtual computer," said Paul Avery, lead scientist of the GriPhyN project and University of Florida physics professor. The Grid will know which computers in the pool are sitting idle at any given time; when a scientist submits a job, it will be sent out to whatever computer isn't being used.
For example, even for a scientist in Michigan, maybe it will turn out to be most convenient for the Grid to send both the analysis program written by the scientist and the relevant part of the data to the University of Chicago; there the data gets analyzed and the results sent back to the scientist in Michigan.
"GriPhyN could be thought of as a Napster for scientists, where the tunes being downloaded are not purloined hits but crucial insights into the nature of the universe," said project co-leader Ian Foster, professor in Computer Science at the University of Chicago.
The Grid gets its name from its similarity to the network of power grids that bring us our electricity.
When we plug an appliance into the 110-volt socket in the wall, we don't know who generated the power, we don't know what plant the power came from and we don't know how it got here. Whether it comes from a hydroelectric power plant in Colorado or from somewhere in Idaho, we expect the lights to turn on and the refrigerator to stay cool.
In the Grid, the same idea is being applied to computer interconnectivity. When scientists submit a processing job to this worldwide network of computers, the only thing they care about is that the job gets done. They don't know which machine (or machines) the work gets farmed out to. They don't care whether it's the National Computer Center in Indiana or some PCs in Arizona that are doing the job, as long as it's completed. The average household PC has the computing power of a $200,000 machine in the 1950's. The Grid is going to network together machines from all over the world.
One day the Grid may be commonplace, with every household plugging in. Currently the GriPhyN project includes the two experiments at CERN; The Sloan Digital Sky Survey, which will gather information about hundreds of millions of galaxies and the Laser Interferometer Gravitational-Wave Observatory, a gravity wave detector.
Future applications for the Grid are mind-boggling. A medical school professor could use the Grid to present a holographic representation of a cadaver, with the images loaded with data representing millimeter-thick slides of tissue such that students could conduct a virtual dissection. The Grid also could manage the quantity of data needed to create avatars to simulate co-present conversations and interactions.
In the near future scientific endeavors such as the Human Genome Project and the Earth Observing System will need to handle huge databases. The growth of computer power averages about 1 percent per month. The improvement of cost/performance over the last 35 years has been on the order of 100 million. Imagine where we'll be a hundred years from now.
Katherine Freese is a professor of physics at the University of Michigan.