Concept
Rate of convergence
Related publications (32)
Enabling Uncertainty Estimation in Iterative Neural Networks
Pascal Fua, Nikita Durasov, Doruk Oner, Minh Hieu Lê
Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...
2024Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning
Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...
EPFL2024Randomized flexible GMRES with deflated restarting
For a high dimensional problem, a randomized Gram-Schmidt (RGS) algorithm is beneficial in computational costs as well as numerical stability. We apply this dimension reduction technique by random sketching to Krylov subspace methods, e.g. to the generaliz ...
Springer2024Residual-based attention in physics-informed neural networks
Nikolaos Stergiopoulos, Sokratis Anagnostopoulos
Driven by the need for more efficient and seamless integration of physical models and data, physics -informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains ...
Lausanne2024Quantitative convergence rates for scaling limit of SPDEs with transport noise
We consider on the torus the scaling limit of stochastic 2D (inviscid) fluid dynamics equations with transport noise to deterministic viscous equations. Quantitative estimates on the convergence rates are provided by combining analytic and probabilistic ar ...
Academic Press Inc Elsevier Science2024