Outline

• Collect assignment #1 and #2

• Broadcast

• Tags, Safety, Buffering, and Synchronization

• Reduce

• Example: Dot Product

• Allreduce

• Gather/Scatter

• Allgather

• Grouping Data for Communication

Previous slide

Next slide

Back to first slide

View graphic version