You are on page 1of 2

The Anatomy of the Grid: Enabling Scalable Virtual Organizations

Ian Foster
Mathematics and Computer Science Division, Argonne National Laboratory
Department of Computer Science, The University of Chicago, USA
foster@{mcs.anl.gov,cs.uchicago.edu}
http://www.mcs.anl.gov/~foster

The term “the Grid” was coined in the mid1990s to and/or institutions defined by such sharing rules form
denote a proposed distributed computing infrastructure what we call a virtual organization (VO).
for advanced science and engineering [4]. The following are examples of VOs: the
Considerable progress has since been made on the application service providers, storage service
construction of such an infrastructure (e.g., [1, 2, 6, 7]) providers, cycle providers, and consultants engaged by
but the term “Grid” has also been conflated, at least in a car manufacturer to perform scenario evaluation
popular perception, to embrace everything from during planning for a new factory; members of an
advanced networking to artificial intelligence. One industrial consortium bidding on a new aircraft; a
might wonder whether the term has any real substance crisis management team and the databases and
and meaning. Is there really a distinct “Grid problem” simulation systems that they use to plan a response to
and hence a need for new “Grid technologies”? If so, an emergency situation; and members of a large,
what is the nature of these technologies, and what is international, multiyear high-energy physics
their domain of applicability? While numerous groups collaboration. Each represents an approach to
have interest in Grid concepts and share, to a computing and problem solving based on collaboration
significant extent, a common vision of Grid in computation- and data-rich environments.
architecture, we do not see consensus on the answers As these examples show, VOs vary tremendously
to these questions. in their purpose, scope, size, duration, structure,
My purpose in this talk is to argue that the Grid community, and sociology. Nevertheless, careful
concept is indeed motivated by a real and specific study of underlying technology requirements leads us
problem and that there is an emerging, well-defined to identify a broad set of common concerns and
Grid technology base that solves this problem. In the requirements. In particular, we see a need for highly
process, I develop a detailed architecture and roadmap flexible sharing relationships, ranging from client-
for current and future Grid technologies. I also argue server to peer-to-peer and brokered; for complex and
that while Grid technologies are currently distinct from high levels of control over how shared resources are
other major technology trends, such as Internet, used, including fine-grained access control, delegation,
enterprise, distributed, and peer-to-peer computing, and application of local and global policies; for
these other trends can benefit significantly from sharing of varied resources, ranging from programs,
growing into the problem space addressed by Grid files, and data to computers, sensors, and networks;
technologies. and for diverse usage modes, ranging from single user
The real and specific problem that underlies the to multi-user and from performance sensitive to cost-
Grid concept is coordinated resource sharing and sensitive and hence embracing issues of quality of
problem solving in dynamic, multi-institutional virtual service, scheduling, co-allocation, and accounting.
organizations. The sharing that we are concerned with Current distributed computing technologies do not
is not primarily file exchange but rather direct access address the concerns and requirements just listed. For
to computers, software, data, and other resources, as is example, current Internet technologies address
required by a range of collaborative problem-solving communication and information exchange among
and resource-brokering strategies emerging in computers but not the coordinated use of resources at
industry, science, and engineering. This sharing is, multiple sites for computation. Business-to-business
necessarily, highly controlled, with resource providers exchanges focus on information sharing (often via
and consumers defining clearly and carefully just what centralized servers). So do virtual enterprise
is shared, who is allowed to share, and the conditions technologies, although here sharing may eventually
under which sharing occurs. A set of individuals extend to applications and physical devices.

Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGRID ’01)
0-7695-1010-8/01 $10.00 © 2001 IEEE
Enterprise distributed computing technologies such as exchange information. As the examples presented
CORBA and Enterprise Java focus on enabling here illustrate, the need to engage in collaborative
resource sharing within a single organization. Storage processes is fundamental to many diverse disciplines
service providers (SSPs) and application service and activities: it is not limited to science, engineering
providers allow organizations to outsource storage and and business activities. It is because of this broad
computing requirements to other parties, but only in applicability of VO concepts that Grid technology is
constrained ways: for example, SSP resources are important.
typically linked with a customer via a virtual private
network. Emerging “Internet computing” companies Acknowledgments
seek to harness idle computers on an international This text is based on the introductory section of an
scale [3] but, to date, support only centralized access article [5] that addresses these issues at length. I thank
to those resources. In summary, current technology my co-authors, Carl Kesselman and Steven Tuecke,
either does not accommodate the range of resource for their contributions, as well as numerous colleagues
types or does not provide the flexibility and control on who whom we have discussed these ideas.
sharing relationships needed to establish VOs.
It is here that Grid technologies enter the picture.
Over the past five years, research and development References
efforts within the Grid community have produced 1. Beiriger, J., Johnson, W., Bivens, H., Humphreys,
protocols, services, and tools that address precisely the S. and Rhea, R., Constructing the ASCI Grid. In
challenges that arise when we seek to build scalable Proc. 9th IEEE Symposium on High Performance
VOs. These technologies include security solutions Distributed Computing, 2000, IEEE Press.
that support management of credentials and policies
when computations span multiple institutions; resource 2. Brunett, S., Czajkowski, K., Fitzgerald, S., Foster,
management protocols and services that support secure I., Johnson, A., Kesselman, C., Leigh, J. and
remote access to computing and data resources and the Tuecke, S., Application Experiences with the
co-allocation of multiple resources; information query Globus Toolkit. In Proc. 7th IEEE Symp. on High
protocols and services that provide configuration and Performance Distributed Computing, 1998, IEEE
status information about resources, organizations, and Press, 81-89.
services; and data management services that locate and
3. Foster, I. Internet Computing and the Emerging
transport datasets between storage systems and
Grid. Nature Web Matters, 2000. www.nature.com/
applications.
nature/webmatters/grid/grid.html.
Because of their focus on dynamic, cross-
organizational sharing, Grid technologies complement 4. Foster, I. and Kesselman, C. (eds.). The Grid:
rather than compete with existing distributed Blueprint for a New Computing Infrastructure.
computing technologies. For example, enterprise Morgan Kaufmann, 1999.
distributed computing systems can use Grid
technologies to achieve resource sharing across 5. Foster, I., Kesselman, C. and Tuecke, S. The
institutional boundaries; in the ASP/SSP space, Grid Anatomy of the Grid: Enabling Scalable Virtual
technologies can be used to establish dynamic markets Organizations. Intl. J. Supercomputer Applications,
for computing and storage resources, hence (to appear) 2001. www.globus.org/research/papers/
overcoming the limitations of current static anatomy.pdf.
configurations.
In my talk, I will expand upon each of these points 6. Johnston, W.E., Gannon, D. and Nitzberg, B.,
in turn. My objectives are to (1) clarify the nature of Grids as Production Comp uting Environments: The
VOs and Grid computing for those unfamiliar with the Engineering Aspects of NASA's Information
area; (2) contribute to the emergence of Grid Power Grid. In Proc. 8th IEEE Symposium on High
computing as a discipline by establishing a standard Performance Distributed Computing, 1999, IEEE
vocabulary and defining an overall architectural Press.
framework; and (3) define clearly how Grid
technologies relate to other technologies, explaining 7. Stevens, R., Woodward, P., DeFanti, T. and Catlett,
both why various emerging technologies are not yet C. From the I-WAY to the National Technology
the Grid and how these technologies can benefit from Grid. Communications of the ACM, 40(11):50-61.
Grid technologies. 1997.
It is my belief that VOs have the potential to
change dramatically the way we use computers to
solve problems, much as the web has changed how we

Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGRID ’01)
0-7695-1010-8/01 $10.00 © 2001 IEEE