Publications related to IMPROVED VARIANTS OF THE HUTCH plus plus ALGORITHM FOR TRACE ESTIMATION

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

François Fleuret, Nikolaos Pappas, Angelos Katharopoulos, Apoorv Vyas

Transformers achieve remarkable performance in several tasks but due to their quadratic complexity, with respect to the input’s length, they are prohibitively slow for very long sequences. To address this limitation, we express the self-attention as a line ...

Idiap2020

Quantitative lower bounds on the Lyapunov exponent from multivariate matrix inequalities

Marius Christopher Lemm

The Lyapunov exponent characterizes the asymptotic behavior of long matrix products. Recognizing scenarios where the Lyapunov exponent is strictly positive is a fundamental challenge that is relevant in many applications. In this work we establish a novel ...

2020

MATHICSE Technical Report : On maximum volume submatrices and cross approximation for symmetric semidefinite and diagonally dominant matrices

Daniel Kressner, Stefano Massei, Alice Cortinovis

The problem of finding a

k\times k

submatrix of maximum volume of a matrix A is of interest in a variety of applications. For example, it yields a quasi-best low-rank approximation constructed from the rows and columns of A. We show that such a submatrix ...

MATHICSE2019

Rational Krylov for Stieltjes matrix functions: convergence and pole selection

Stefano Massei

Evaluating the action of a matrix function on a vector, that is

x=f(\mathcal M)v

, is an ubiquitous task in applications. When

\mathcal M

is large, one usually relies on Krylov projection methods. In this paper, we provide effective choices for the pole ...

2019

Method of displaying an image on a see-through display

Sabine Süsstrunk, Adrien Birbaumer, Martinus Bosch

The present invention concerns a method of displaying an image on a see-through display. The method comprises: obtaining (101) a first electromagnetic radiation matrix of an object, the first matrix comprising first matrix elements representing radiation i ...

2019

Decompositions of dependence for high-dimensional extremes

Emeric Rolland Georges Thibaud

We propose two decompositions that help to summarize and describe high-dimensional tail dependence within the framework of regular variation. We use a transformation to define a vector space on the positive orthant and show that transformed-linear operatio ...

OXFORD UNIV PRESS2019

Multi-panel, on-single-chip Memristive Biosensing

Giovanni De Micheli, Sandro Carrara, Danilo Demarchi, Ioulia Tzouvadaki, Abuduwaili Tuoheti

Memristive biosensors have demonstrated excellent capabilities for ultrasensitive bio-detection. In the present work, memristive biosensing chips are designed, fabricated and implemented in a for the first time presented multi-panel on-chip detection for d ...

2019

Convergence of the Exponentiated Gradient Method with Armijo Line Search

Volkan Cevher, Yen-Huan Li

Consider the problem of minimizing a convex differentiable function on the probability simplex, spectrahedron, or set of quantum density matrices. We prove that the expo-nentiated gradient method with Armijo line search always converges to the optimum, if ...

2018

A Row-Column Accessed Dynamic Element Matching DAC Architecture for SAR ADCs

Mustafa Kilic, Selman Ergünay, Yusuf Leblebici

Capacitor mismatch in high resolution Successive Approximation Register (SAR) Analog to Digital Converters (ADCs) causes non-linearity effects that reduce the Spurious-Free Dynamic Range (SFDR). This paper presents a novel dynamic element matching (DEM) te ...

IEEE2018

Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization

Sebastian Urban Stich

We present the first accelerated randomized algorithm for solving linear systems in Euclidean spaces. One essential problem of this type is the matrix inversion problem. In particular, our algorithm can be specialized to invert positive definite matrices i ...

2018

IMPROVED VARIANTS OF THE HUTCH plus plus ALGORITHM FOR TRACE ESTIMATION

Graph Chatbot

Chat with Graph Search

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

Quantitative lower bounds on the Lyapunov exponent from multivariate matrix inequalities

MATHICSE Technical Report : On maximum volume submatrices and cross approximation for symmetric semidefinite and diagonally dominant matrices

Rational Krylov for Stieltjes matrix functions: convergence and pole selection

Method of displaying an image on a see-through display

Decompositions of dependence for high-dimensional extremes

Multi-panel, on-single-chip Memristive Biosensing

Convergence of the Exponentiated Gradient Method with Armijo Line Search

A Row-Column Accessed Dynamic Element Matching DAC Architecture for SAR ADCs

Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization

Convergence of the Exponentiated Gradient Method with Armijo Line Search

Method of displaying an image on a see-through display

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

Quantitative lower bounds on the Lyapunov exponent from multivariate matrix inequalities

MATHICSE Technical Report : On maximum volume submatrices and cross approximation for symmetric semidefinite and diagonally dominant matrices

Rational Krylov for Stieltjes matrix functions: convergence and pole selection

Multi-panel, on-single-chip Memristive Biosensing

Decompositions of dependence for high-dimensional extremes

Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization

A Row-Column Accessed Dynamic Element Matching DAC Architecture for SAR ADCs