MPI Basics: Point-to-Point and Collective Communications

This lecture covers the basics of MPI, including the distributed memory programming paradigm, point-to-point communications, collective communications, and synchronizations. It explains how to run multiple instances of a program, different types of communications in MPI, and the importance of matching sends with receives to avoid race conditions or deadlocks. The lecture also delves into blocking and non-blocking point-to-point communications, MPI barriers, wildcard receives, and collective communications like MPI_Bcast, MPI_Scatter, MPI_Gather, and MPI_Reduce. Additionally, it discusses receiving image parts in order, out-of-order, and with a collective, as well as the importance of avoiding collective calls within conditional clauses and customizing communicators and datatypes.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related concepts (26)

MATH-454: Parallel and high-performance computing

This course provides insight into a broad variety of High Performance Computing (HPC) concepts and the majority of modern HPC architectures. Moreover, the student will learn to have a feeling about wh

Message Passing Interface

Message Passing Interface (MPI) is a standardized and portable message-passing standard designed to function on parallel computing architectures. The MPI standard defines the syntax and semantics of library routines that are useful to a wide range of users writing portable message-passing programs in C, C++, and Fortran. There are several open-source MPI implementations, which fostered the development of a parallel software industry, and encouraged development of portable and scalable large-scale parallel applications.

Race condition

A race condition or race hazard is the condition of an electronics, software, or other system where the system's substantive behavior is dependent on the sequence or timing of other uncontrollable events. It becomes a bug when one or more of the possible behaviors is undesirable. The term race condition was already in use by 1954, for example in David A. Huffman's doctoral thesis "The synthesis of sequential switching circuits". Race conditions can occur especially in logic circuits, multithreaded, or distributed software programs.

Race and health

Race and health refers to how being identified with a specific race influences health. Race is a complex concept that has changed across chronological eras and depends on both self-identification and social recognition. In the study of race and health, scientists organize people in racial categories depending on different factors such as: phenotype, ancestry, social identity, genetic makeup and lived experience. "Race" and ethnicity often remain undifferentiated in health research.

Race and genetics

Researchers have investigated the relationship between race and genetics as part of efforts to understand how biology may or may not contribute to human racial categorization. Many constructions of race are associated with phenotypical traits and geographic ancestry, and scholars like Carl Linnaeus have proposed scientific models for the organization of race since at least the 18th century. Following the discovery of Mendelian genetics and the mapping of the human genome, questions about the biology of race have often been framed in terms of genetics.

Race (human categorization)

Race is a categorization of humans based on shared physical or social qualities into groups generally viewed as distinct within a given society. The term came into common usage during the 16th century, when it was used to refer to groups of various kinds, including those characterized by close kinship relations. By the 17th century, the term began to refer to physical (phenotypical) traits, and then later to national affiliations. Modern science regards race as a social construct, an identity which is assigned based on rules made by society.