Publication
On the Generalization of Stochastic Gradient Descent with Momentum
Related concepts (33)
Risk aversion
In economics and finance, risk aversion is the tendency of people to prefer outcomes with low uncertainty to those outcomes with high uncertainty, even if the average outcome of the latter is equal to or higher in monetary value than the more certain outcome. Risk aversion explains the inclination to agree to a situation with a more predictable, but possibly lower payoff, rather than another situation with a highly unpredictable, but possibly higher payoff.
Empirical risk minimization
Empirical risk minimization (ERM) is a principle in statistical learning theory which defines a family of learning algorithms and is used to give theoretical bounds on their performance. The core idea is that we cannot know exactly how well an algorithm will work in practice (the true "risk") because we don't know the true distribution of data that the algorithm will work on, but we can instead measure its performance on a known set of training data (the "empirical" risk).
Negative mass
In theoretical physics, negative mass is a hypothetical type of exotic matter whose mass is of opposite sign to the mass of normal matter, e.g. −1 kg. Such matter would violate one or more energy conditions and show some strange properties such as the oppositely oriented acceleration for an applied force orientation. It is used in certain speculative hypothetical technologies, such as time travel to the past and future, construction of traversable artificial wormholes, which may also allow for time travel, Krasnikov tubes, the Alcubierre drive, and potentially other types of faster-than-light warp drives.