Error functionIn mathematics, the error function (also called the Gauss error function), often denoted by erf, is a complex function of a complex variable defined as: Some authors define without the factor of . This nonelementary integral is a sigmoid function that occurs often in probability, statistics, and partial differential equations. In many of these applications, the function argument is a real number. If the function argument is real, then the function value is also real.
Kronecker deltaIn mathematics, the Kronecker delta (named after Leopold Kronecker) is a function of two variables, usually just non-negative integers. The function is 1 if the variables are equal, and 0 otherwise: or with use of Iverson brackets: For example, because , whereas because . The Kronecker delta appears naturally in many areas of mathematics, physics, engineering and computer science, as a means of compactly expressing its definition above.
Chebyshev polynomialsThe Chebyshev polynomials are two sequences of polynomials related to the cosine and sine functions, notated as and . They can be defined in several equivalent ways, one of which starts with trigonometric functions: The Chebyshev polynomials of the first kind are defined by Similarly, the Chebyshev polynomials of the second kind are defined by That these expressions define polynomials in may not be obvious at first sight, but follows by rewriting and using de Moivre's formula or by using the angle sum formulas for and repeatedly.
Oliver HeavisideOliver Heaviside FRS (ˈhɛvisaɪd; 18 May 1850 – 3 February 1925) was an English self-taught mathematician and physicist who invented a new technique for solving differential equations (equivalent to the Laplace transform), independently developed vector calculus, and rewrote Maxwell's equations in the form commonly used today. He significantly shaped the way Maxwell's equations are understood and applied in the decades following Maxwell's death.
Laurent SchwartzLaurent-Moïse Schwartz (ʃvaʁts; 5 March 1915 – 4 July 2002) was a French mathematician. He pioneered the theory of distributions, which gives a well-defined meaning to objects such as the Dirac delta function. He was awarded the Fields Medal in 1950 for his work on the theory of distributions. For several years he taught at the École polytechnique. Laurent Schwartz came from a Jewish family of Alsatian origin, with a strong scientific background: his father was a well-known surgeon, his uncle Robert Debré (who contributed to the creation of UNICEF) was a famous pediatrician, and his great-uncle-in-law, Jacques Hadamard, was a famous mathematician.
Cauchy principal valueIn mathematics, the Cauchy principal value, named after Augustin Louis Cauchy, is a method for assigning values to certain improper integrals which would otherwise be undefined. In this method, a singularity on an integral interval is avoided by limiting the integral interval to the singularity (so the singularity is not covered by the integral). Depending on the type of singularity in the integrand f, the Cauchy principal value is defined according to the following rules: In some cases it is necessary to deal simultaneously with singularities both at a finite number b and at infinity.
Ramp functionThe ramp function is a unary real function, whose graph is shaped like a ramp. It can be expressed by numerous definitions, for example "0 for negative inputs, output equals input for non-negative inputs". The term "ramp" can also be used for other functions obtained by scaling and shifting, and the function in this article is the unit ramp function (slope 1, starting at 0). In mathematics, the ramp function is also known as the positive part.
Logistic distributionIn probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It resembles the normal distribution in shape but has heavier tails (higher kurtosis). The logistic distribution is a special case of the Tukey lambda distribution.
Dirac delta functionIn mathematical physics, the Dirac delta distribution (δ distribution), also known as the unit impulse, is a generalized function or distribution over the real numbers, whose value is zero everywhere except at zero, and whose integral over the entire real line is equal to one. The current understanding of the unit impulse is as a linear functional that maps every continuous function (e.g., ) to its value at zero of its domain (), or as the weak limit of a sequence of bump functions (e.g.
Activation functionActivation function of a node in an artificial neural network is a function that calculates the output of the node (based on its inputs and the weights on individual inputs). Nontrivial problems can be solved only using a nonlinear activation function. Modern activation functions include the smooth version of the ReLU, the GELU, which was used in the 2018 BERT model, the logistic (sigmoid) function used in the 2012 speech recognition model developed by Hinton et al, the ReLU used in the 2012 AlexNet computer vision model and in the 2015 ResNet model.
