Reduce
Two questions?
- is this the right order (high bit first)?
- can we do better?
The “global sum” operation is an example of a class of collective communication operations called reduction operations
In a global reduction operation all processes in the communicator provide data that is combined using a commutative and associative binary operation