Programming Multicore and Many-core Computing Systems
Programming multi-core and many-core computing systems
Sabri Pllana, Linnaeus University, Sweden
Fatos Xhafa, Technical University of Catalonia, Spain
Provides state-of-the-art methods for programming multi-core and many-core systems
The book comprises a selection of twenty two chapters covering: fundamental techniques and algorithms; programming approaches; methodologies and frameworks; scheduling and management; testing and evaluation methodologies; and case studies for programming multi-core and many-core systems.
Program development for multi-core processors, especially for heterogeneous multi-core processors, is significantly more complex than for single-core processors. However, programmers have been traditionally trained for the development of sequential programs, and only a small percentage of them have experience with parallel programming. In the past, only a relatively small group of programmers interested in High Performance Computing (HPC) was concerned with the parallel programming issues, but the situation has changed dramatically with the appearance of multi-core processors on commonly used computing systems. It is expected that with the pervasiveness of multi-core processors, parallel programming will become mainstream.
The pervasiveness of multi-core processors affects a large spectrum of systems, from embedded and general-purpose, to high-end computing systems. This book assists programmers in mastering the efficient programming of multi-core systems, which is of paramount importance for the software-intensive industry towards a more effective product-development cycle.
- Lessons, challenges, and roadmaps ahead.
- Contains real world examples and case studies.
- Helps programmers in mastering the efficient programming of multi-core and many-core systems.
The book serves as a reference for a larger audience of practitioners, young researchers and graduate level students. A basic level of programming knowledge is required to use this book.
LIST OF CONTRIBUTORS ix
PART I FOUNDATIONS
1 Multi- and Many-Cores, Architectural Overview for Programmers 1
Lasse Natvig, Alexandru Iordan, Mujahed Eleyat, Magnus Jahre and Jorn Amundsen
2 Programming Models for MultiCore and Many-Core Computing Systems 29
Ana Lucia Varbanescu, Rob V. van Nieuwpoort, Pieter Hijma, Henri E. Bal, Rosa M. Badia and Xavier Martorell
3 Lock-free Concurrent Data Structures 59
Daniel Cederman, Anders Gidenstam, Phuong Ha, Håkan Sundell, Marina Papatriantafilou and Philippas Tsigas
4 Software Transactional Memory 81
PART II PROGRAMMING APPROACHES
5 Hybrid/Heterogeneous Programming with OMPSs and its Software/Hardware Implications 101
Eduard Ayguade, Rosa M. Badia, Pieter Bellens, Javier Bueno, Alejandro Duran, Yoav Etsion, Montse Farreras, Roger Ferrer, Jesus Labarta, Vladimir Marjanovic, Lluis Martinell, Xavier Martorell, Josep M. Perez, Judit Planas, Alex Ramirez, Xavier Teruel, Ioanna Tsalouchidou and Mateo Valero
6 Skeleton Programming for Portable Many-Core Computing 121
Christoph Kessler, Sergei Gorlatch, Johan Enmyren, Usman Dastgeer, Michel Steuwer and Philipp Kegel
7 DSL Stream Programming on Multicore Architectures 143
Pablo de Oliveira Castro, Stephane Louise and Denis Barthou´
8 Programming with Transactional Memory 165
Vincent Gramoli and Rachid Guerraoui
9 Object-Oriented Stream Programming 185
Frank Otto and Walter F. Tichy
10 Software-Based Speculative Parallelization 205
Chen Tian, Min Feng and Rajiv Gupta
11 Autonomic Distribution and Adaptation 227
Lutz Schubert, Stefan Wesner, Daniel Rubio Bonilla and Tom-maso Cucinotta
PART III PROGRAMMING FRAMEWORKS
12 PEPPHER: Performance Portability and Programmability for Heterogeneous Many-Core Architectures 243
Siegfried Benkner, Sabri Pllana, Jesper Larsson Trff, Philippas Tsigas, Andrew Richards, George Russell, Samuel Thibault, Cdric Augonnet, Raymond Namyst, Herbert Cornelius, Christoph Keler, David Moloney and Peter Sanders
13 Fastflow: High-Level and Efficient Streaming on Multicore 261
Marco Aldinucci, Marco Danelutto, Peter Kilpatrick and Massimo Torquati
14 Parallel Programming Framework for H.264/AVC Video Encoding in Multicore Systems 281
Nuno Roma, Antnio Rodrigues and Leonel Sousa
15 Parallelizing Evolutionary Algorithms on GPGPU Cards with the EASEA Platform 301
Ogier Maitre, Frederic Kruger, Deepak Sharma, Stephane Querry, Nicolas Lachiche and Pierre Collet
PART IV TESTINE, EVALUATION AN OPTIMIZATION
16 Smart Interleavings for Testing Parallel Programs 323
17 Parallel Performance Evaluation and Optimization 343
18 A Methodology for Optimizing Multithreaded System Scalability on Multicores 363
Neil Gunther, Shanti Subramanyam and Stefan Parvu
19 Improving Multicore System Performance through Data Compression 385
Ozcan Ozturk and Mahmut Kandemir
PART V SCHEDULING AND MANAGEMENT
20 Programming and Managing Resources on Accelerator-Enabled Clusters 407
M. Mustafa Rafique, Ali R. Butt and Dimitrios S. Nikolopoulos
21 An Approach for Efficient Execution of SPMD Applications on Multicore Clusters 431
Ronal Muresano, Dolores Rexachs and Emilio Luque
22 Operating System and Scheduling for Future Multicore and Many-Core Platforms 451
Tommaso Cucinotta, Giuseppe Lipari and Lutz Schubert
Fatos Xhafa received his PhD in Computer Science in 1998 from the Technical University of Catalonia (UPC), Barcelona, Spain. Currently, he holds a permanent position of Professor Titular d’Universitat at UPC. He was a Visiting Professor at University of London (UK), 2009-2010, and Research Associate at Drexel University (USA), 2004/2005. He has widely published in international journals, conferences/workshops, book chapters, edited books and proceedings in the field. He is editor in Chief of the International Journal of Grid and Utility Computing, International Journal of Space-based and Situated Computing, Inderscience. He is Editor in Chief of the Elsevier Book Series “Intelligent Data-Centric Systems” and of Springer Lecture Notes in Data Engineering and Communication Technologies. He is a member of IEEE Communications Society, IEEE Systems, Man & Cybernetics Society and Emerging Technical Subcommittee of IoT. His research interests include parallel and distributed computing, massive data processing, collective intelligence, optimization, trustworthy computing, machine learning, etc.