Kumar - Introduction to Parallel Computing

You are seeing our new document Reader view. Click here to revert. Feel free to leave us feedback on this feature here.

×

Embed Doc
Copy Link
Readcast
Collections

CommentGo Back

•Table of Contents

Introduction to Parallel Computing, Second Edition

By

,

,

,

Publisher: Addison WesleyPub Date: January 16, 2003ISBN: 0-201-64865-2Pages: 856

Increasingly, parallel processing is being seen as the only cost-effective method for the fastsolution of computationally large and data-intensive problems. The emergence of inexpensiveparallel computers such as commodity desktop multiprocessors and clusters of workstations orPCs has made such parallel methods generally applicable, as have software standards forportable parallel programming. This sets the stage for substantial growth in parallel software.Data-intensive applications such as transaction processing and information retrieval, datamining and analysis and multimedia services have provided a new challenge for the moderngeneration of parallel platforms. Emerging areas such as computational biology andnanotechnology have implications for algorithms and systems development, while changes inarchitectures, programming models and applications have implications for how parallelplatforms are made available to users in the form of grid-based services.This book takes into account these new developments as well as covering the more traditionalproblems addressed by parallel computers.Where possible it employs an architecture-independent view of the underlying platforms and designs algorithms for an abstract model.Message Passing Interface (MPI), POSIX threads and OpenMP have been selected asprogramming models and the evolving application mix of parallel computing is reflected invarious examples throughout the book.

•Table of Contents

Introduction to Parallel Computing, Second Edition

By

,

,

,

Publisher: Addison WesleyPub Date: January 16, 2003ISBN: 0-201-64865-2Pages: 856 Copyright Pearson Education Preface Acknowledgments Chapter 1. Introduction to Parallel Computing Section 1.1. Motivating Parallelism Section 1.2. Scope of Parallel Computing Section 1.3. Organization and Contents of the Text Section 1.4. Bibliographic Remarks Problems Chapter 2. Parallel Programming Platforms Section 2.1. Implicit Parallelism: Trends in Microprocessor Architectures* Section 2.2. Limitations of Memory System Performance* Section 2.3. Dichotomy of Parallel Computing Platforms Section 2.4. Physical Organization of Parallel Platforms Section 2.5. Communication Costs in Parallel Machines Section 2.6. Routing Mechanisms for Interconnection Networks Section 2.7. Impact of Process-Processor Mapping and Mapping Techniques Section 2.8. Bibliographic Remarks Problems

Chapter 3. Principles of Parallel Algorithm Design Section 3.1. Preliminaries Section 3.2. Decomposition Techniques Section 3.3. Characteristics of Tasks and Interactions Section 3.4. Mapping Techniques for Load Balancing Section 3.5. Methods for Containing Interaction Overheads Section 3.6. Parallel Algorithm Models Section 3.7. Bibliographic Remarks Problems Chapter 4. Basic Communication Operations Section 4.1. One-to-All Broadcast and All-to-One Reduction Section 4.2. All-to-All Broadcast and Reduction Section 4.3. All-Reduce and Prefix-Sum Operations Section 4.4. Scatter and Gather Section 4.5. All-to-All Personalized Communication Section 4.6. Circular Shift Section 4.7. Improving the Speed of Some Communication Operations Section 4.8. Summary Section 4.9. Bibliographic Remarks Problems Chapter 5. Analytical Modeling of Parallel Programs Section 5.1. Sources of Overhead in Parallel Programs Section 5.2. Performance Metrics for Parallel Systems Section 5.3. The Effect of Granularity on Performance Section 5.4. Scalability of Parallel Systems Section 5.5. Minimum Execution Time and Minimum Cost-Optimal Execution Time Section 5.6. Asymptotic Analysis of Parallel Programs Section 5.7. Other Scalability Metrics Section 5.8. Bibliographic Remarks Problems Chapter 6. Programming Using the Message-Passing Paradigm Section 6.1. Principles of Message-Passing Programming Section 6.2. The Building Blocks: Send and Receive Operations Section 6.3. MPI: the Message Passing Interface Section 6.4. Topologies and Embedding Section 6.5. Overlapping Communication with Computation Section 6.6. Collective Communication and Computation Operations Section 6.7. Groups and Communicators Section 6.8. Bibliographic Remarks Problems Chapter 7. Programming Shared Address Space Platforms

of 00

Leave a Comment