Skip to main content

Advanced Topics in Dataflow Computing and Multithreading



Advanced Topics in Dataflow Computing and Multithreading

Guang R. Gao, Lubomir Bic, Jean-Luc Gaudiot

ISBN: 978-0-818-66542-4 July 1995 Wiley-IEEE Computer Society Pr 464 Pages


Examines recent advances in design, modeling, and implementation of dataflow and multithreaded computers. The text contains reports concerning many of the world's leading projects engaged in the continuing evolution and application of dataflow concepts. It covers the broad range of dataflow principles in program representation -- from language design to processor architecture -- and compiler optimization techniques.

The first section of the book delves into massively parallel distributed memory and multithreaded architecture design, synchronization and pipelined design, and superpipelined data-driven VLSI processors. The next section, on language and programming issues, discusses stream data types, the development of well-structured software, and coarse-grain dataflow programming.

Other parts of the text study parallelization of dataflow programs, an analytical model for the behavior of dataflow graphs, compare a centralized work distribution scheme with a distributed scheme, and present a comprehensive approach to understanding workload management schemes. Altogether, the book introduces the reader to dataflow concepts that show how functional programming ideas can be harnessed to exploit the power of parallel computing.

Foreword vii

Introduction ix

Processor Design

Design Principle of Massively Parallel Distributed-Memory Multiprocessor Architecture 1
M. Amamiya and T. Kawano

StarT the Next Generation: Integrating Global Caches and Dataflow Architecture 19
B.S. Ang, Arvind, and D. Chiou

Synchronization and Pipeline Design for a Multithreaded Massively Parallel Computer 55
S. Sakai

Superpipelined Dynamic Data-Driven VLSI Processors 75
H. Terada, M. Iwata, S. Miyata, and S. Komori

Language and Programming Issues

Stream Data Types for Signal Processing 87
J.B. Dennis

Multilateral Diagrammatical Specification Environment Based on Data-Driven Paradigm 103
M. Iwata and H. Terada

Coarse-Grain Dataflow Programming of Conventional Parallel Computers 113
R. Jagannathan

Distributed Data Structure in Thread-Based Programming for a Highly Parallel Dataflow Machine EM-4 131
M. Sato, Y. Kodama, S. Sakai, Y. Yamaguchi, and S. Sekiguchi

Programmability and Performance Issues of Multiprocessors on Hard Nonnumeric Problems 143
A. Sohn and J.-L. Gaudiot


Exploiting Iteration-Level Parallelism in Dataflow Programs 167
L. Bic, J.M.A. Roy, and M. Nagel

Empirical Study of a Dataflow Language on the CM-5 187
D.E. Culler, S.C. Goldstein, K.E. Schauser, and T. von Eicken

Programming the ADAM Architecture with SISAL 211
S. Mitrovic

Can Dataflow Machines Be Programmed with an Imperative Language? 229
S.F. Wail and D. Abramson

Resource Management and Scheduling

The Token Flow Model 267
J. Buck and E.A. Lee

Distributed Task Management in SISAL 291
M. Haines and A.P.W. Bohm

Load Balancing and Resource Management in the ADAM Machine 307
O.C. Maquelin

Workload Management in Massively Parallel Computers: Some Dataflow Experiences 325
D.F. Snelling and J.R. Gurd

Studies on Optimal Task Granularity and Random Mapping 349
T. Sterling, J. Kuehn, M. Thistle, and T. Anastasio

The Effects of Resource Limitations on Program Parallelism 367
K.B. Theobald, G.R. Gao, and L.J. Hendren

Program Characteristics and Performance Studies

The Dataflow Parallelism of FFT 393
A.P.W. Bohm and R.E. Hiromoto

Locality in the Dataflow Paradigm 405
I. Gottlieb and L. Biran

Locality and Latency in Hybrid Dataflow 417
W.A. Najjar, W.M. Miller, and A.P.W. Bohm

Implementation of Manipulator Control Computation on Conventional and Dataflow Multiprocessor 435
S. Zeng and G.K. Egan

Biography 449