Indeterminate form

In calculus and other branches of mathematical analysis, when the limit of the sum, difference, product, quotient or power of two functions is taken, it may often be possible to simply add, subtract, multiply, divide or exponentiate the corresponding limits of these two functions respectively. However, there are occasions where it is unclear what the sum, difference, product or power of these two limits ought to be. For example, it is unclear what the following expressions ought to evaluate to: These seven expressions are known as indeterminate forms. More specifically, such expressions are obtained by naively applying the algebraic limit theorem to evaluate the limit of the corresponding arithmetic operation of two functions, yet there are examples of pairs of functions that after being operated on converge to 0, converge to another finite value, diverge to infinity or just diverge. This inability to decide what the limit ought to be explains why these forms are regarded as indeterminate. A limit confirmed to be infinity is not indeterminate since it has been determined to have a specific value (infinity). The term was originally introduced by Cauchy's student Moigno in the middle of the 19th century. The most common example of an indeterminate form is the quotient of two functions each of which converges to zero. This indeterminate form is denoted by . For example, as approaches , the ratios , , and go to , , and respectively. In each case, if the limits of the numerator and denominator are substituted, the resulting expression is , which is indeterminate. In this sense, can take on the values , , or , by appropriate choices of functions to put in the numerator and denominator. A pair of functions for which the limit is any particular given value may in fact be found. Even more surprising, perhaps, the quotient of the two functions may in fact diverge, and not merely diverge to infinity. For example, .

Towards Stable and Efficient Adversarial Training against $l_1$ Bounded Adversarial Attacks

Sabine Süsstrunk, Mathieu Salzmann, Yulun Jiang, Chen Liu, Zhuoyi Huang

We address the problem of stably and efficiently training a deep neural network robust to adversarial perturbations bounded by an

l_1

norm. We demonstrate that achieving robustness against

l_1

-bounded perturbations is more challenging than in the

l_2

...

2023

Towards Stable and Efficient Adversarial Training against $l_1$ Bounded Adversarial Attacks

A Continuized View on Nesterov Acceleration

A variational investigation of the SU(N) Heisenberg model in antisymmetric irreducible representations

A Continuized View on Nesterov Acceleration

A variational investigation of the SU(N) Heisenberg model in antisymmetric irreducible representations

Towards Stable and Efficient Adversarial Training against $l_1$ Bounded Adversarial Attacks