Ruud van der Pas & Eric Stotzer 
Using OpenMP-The Next Step [PDF ebook] 
Affinity, Accelerators, Tasking, and SIMD

A guide to the most recent, advanced features of the widely used Open MP parallel programming model, with coverage of major features in Open MP 4.5.This book offers an up-to-date, practical tutorial on advanced features in the widely used Open MP parallel programming model. Building on the previous volume, Using Open MP: Portable Shared Memory Parallel Programming (MIT Press), this book goes beyond the fundamentals to focus on what has been changed and added to Open MP since the 2.5 specifications. It emphasizes four major and advanced areas: thread affinity (keeping threads close to their data), accelerators (special hardware to speed up certain operations), tasking (to parallelize algorithms with a less regular execution flow), and SIMD (hardware assisted operations on vectors).As in the earlier volume, the focus is on practical usage, with major new features primarily introduced by example. Examples are restricted to C and C++, but are straightforward enough to be understood by Fortran programmers. After a brief recap of Open MP 2.5, the book reviews enhancements introduced since 2.5. It then discusses in detail tasking, a major functionality enhancement; Non-Uniform Memory Access (NUMA) architectures, supported by Open MP; SIMD, or Single Instruction Multiple Data; heterogeneous systems, a new parallel programming model to offload computation to accelerators; and the expected further development of Open MP.