Coarse Grained Parallelism
by MichaelS from High-Performance Computing News Analysis | insideHPC on (#12WZ3)
"MPI is generally a coarse-grained, as the parallelism where MPI is used would be higher up in the algorithm. Using MPI for an application requires a developer to think more about the individual servers and how to distribute parts of the application to these servers. The amount of work done by each of the connected servers would ideally be equal and equal to 1/Nth of the total work, where N is the number of servers."
The post Coarse Grained Parallelism appeared first on insideHPC.