Synchronization
Why?
- Collective communications are points of synchronization
- On systems with no buffering this is strictly true and the broadcast will not return until every process has received the data
- If there is adequate buffering they may return before completion but they’re matched in the order in which they’re executed