Concept
Fonction d'activation
Publications associées (88)
On the number of regions of piecewise linear neural networks
Michaël Unser, Alexis Marie Frederic Goujon
Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...
2024Automatic Parameterization for Aerodynamic Shape Optimization via Deep Geometric Learning
We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization. Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric patterns, elimina ...
2023Leveraging Spiking Deep Neural Networks to Understand the Neural Mechanisms Underlying Selective Attention
Spatial attention enhances sensory processing of goal-relevant information and improves perceptual sensitivity. Yet, the specific neural mechanisms underlying the effects of spatial attention on performance are still contested. Here, we examine different a ...
MIT PRESS2022Exploring quantum perceptron and quantum neural network structures with a teacher-student scheme
Near-term quantum devices can be used to build quantum machine learning models, such as quantum kernel methods and quantum neural networks (QNN), to perform classification tasks. There have been many proposals on how to use variational quantum circuits as ...
2022