Publication
Survey of Precision-Scalable Multiply-Accumulate Units for Neural-Network Processing
Related publications (44)
Safe Deep Neural Networks
The capabilities of deep learning systems have advanced much faster than our ability to understand them. Whilst the gains from deep neural networks (DNNs) are significant, they are accompanied by a growing risk and gravity of a bad outcome. This is tr ...
Fundamental Limits in Statistical Learning Problems: Block Models and Neural Networks
This thesis focuses on two selected learning problems: 1) statistical inference on graphs models, and, 2) gradient descent on neural networks, with the common objective of defining and analysing the measures that characterize the fundamental limits.In the ...
EPFL2023Expectation consistency for calibration of neural networks
Florent Gérard Krzakala, Lenka Zdeborová, Lucas Andry Clarte, Bruno Loureiro
Despite their incredible performance, it is well reported that deep neural networks tend to be overoptimistic about their prediction confidence. Finding effective and efficient calibration methods for neural networks is therefore an important endeavour tow ...
2023Polynomial-time universality and limitations of deep learning
The goal of this paper is to characterize function distributions that general neural networks trained by descent algorithms (GD/SGD), can or cannot learn in polytime. The results are: (1) The paradigm of general neural networks trained by SGD is poly-time ...
WILEY2023Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations
Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as natural language proc ...
EPFL2023Deep Learning Generalization with Limited and Noisy Labels
Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...
EPFL2023Bed Topography Inference from Velocity Field Using Deep Learning.
Christophe Ancey, Mehrdad Kiani Oshtorjani
Measuring bathymetry has always been a major scientific and technological challenge. In this work, we used a deep learning technique for inferring bathymetry from the depth-averaged velocity field. The training of the neural network is based on 5742 labora ...
2023Spatial-Temporal Graph Attention Fuser for Calibration in IoT Air Pollution Monitoring Systems
Olga Fink, Mengjie Zhao, Keivan Faghih Niresi
The use of Internet of Things (IoT) sensors for air pollution monitoring has significantly increased, resulting in the deployment of low-cost sensors. Despite this advancement, accurately calibrating these sensors in uncontrolled environmental conditions r ...
Institute of Electrical and Electronics Engineers2023Stop Wasting my FLOPS: Improving the Efficiency of Deep Learning Models
Deep neural networks have completely revolutionized the field of machinelearning by achieving state-of-the-art results on various tasks ranging fromcomputer vision to protein folding. However, their application is hindered bytheir large computational and m ...
EPFL2022Impulsive noise removal via a blind CNN enhanced by an iterative post-processing
Hatef Otroshi Shahreza, Seyedeh Sahar Sadrizadeh
In digital imaging, especially in the process of data acquisition and transmission, images are often affected by impulsive noise. Therefore, it is essential to remove impulsive noise from images before any further processing. Due to the remarkable performa ...
ELSEVIER2022