Publications related to Margin (machine learning)

Deep Learning Theory Through the Lens of Diagonal Linear Networks

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Error scaling laws for kernel classification under source and capacity conditions

Florent Gérard Krzakala, Lenka Zdeborová, Hugo Chao Cui, Bruno Loureiro

In this manuscript we consider the problem of kernel classification. While worst-case bounds on the decay rate of the prediction error with the number of samples are known for some classifiers, they often fail to accurately describe the learning curves of ...

2023

Understanding and Improving Fast Adversarial Training

Nicolas Henri Bernard Flammarion, Maksym Andriushchenko

A recent line of work focused on making adversarial training computationally efficient for deep learning models. In particular, Wong et al. (2020) showed that ℓ∞-adversarial training with fast gradient sign method (FGSM) can fail due to a phenomenon called ...

2020

Automatic Feature Learning for Spatio-Spectral Image Classification With Sparse SVM

Devis Tuia

Including spatial information is a key step for successful remote sensing image classification. In particular, when dealing with high spatial resolution, if local variability is strongly reduced by spatial filtering, the classification performance results ...

Ieee-Inst Electrical Electronics Engineers Inc2014

Non-Linear Domain Adaptation with Boosting

Pascal Fua, Carlos Joaquin Becker, Christos Marios Christoudias

A common assumption in machine vision is that the training and test samples are drawn from the same distribution. However, there are many problems when this assumption is grossly violated, as in bio-medical applications where different acquisitions can gen ...

2013

Frequency Domain Controller Design by Linear Programming Guaranteeing Quadratic Stability

Alireza Karimi, Roland Longchamp, Marc Kunze

In a recent work, a frequency method based on linear programming is proposed to design fixed-order linearly parameterized controllers for stable linear multi- model SISO systems. The method is based on the shaping of the open-loop transfer functions in the ...

IEEE2008

Robust Controller Design by Linear Programming with Application to a Double-Axis Positioning System

Alireza Karimi, Roland Longchamp, Marc Kunze

A linear programming approach is proposed to tune fixed-order linearly parameterized controllers for stable LTI plants. The method is based on the shaping of the open-loop transfer function in the Nyquist diagram. A lower bound on the crossover frequency a ...

2007

Melanoma Recognition Using Representative and Discriminative Kernel Classifiers

Barbara Caputo, Tatiana Tommasi

Malignant melanoma is the most deadly for of skin lesion. Early diagnosis is of critical importance to patient survival. Visual recognition algorithms could potentially be of great help for physicians in a computer assisted diagnosis system. Previous work ...

2006

Robust PID Controller Design by Linear Programming

Alireza Karimi, Roland Longchamp, Marc Kunze

A linear programming approach is proposed to tune fixed-order linearly parameterized controllers for stable LTI plants. The method is based on the shaping of the open-loop transfer function in the Nyquist diagram. A lower bound on the crossover frequency a ...

2006

A Kernel Classifier for Distributions

Samy Bengio, Alexei Pozdnoukhov

This paper presents a new algorithm for classifying distributions. The algorithm combines the principle of margin maximization and a kernel trick, applied to distributions. Thus, it combines the discriminative power of support vector machines and the well- ...

IDIAP2005

Margin (machine learning)

Graph Chatbot

Chat with Graph Search

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Error scaling laws for kernel classification under source and capacity conditions

Understanding and Improving Fast Adversarial Training

Automatic Feature Learning for Spatio-Spectral Image Classification With Sparse SVM

Non-Linear Domain Adaptation with Boosting

Frequency Domain Controller Design by Linear Programming Guaranteeing Quadratic Stability

Robust Controller Design by Linear Programming with Application to a Double-Axis Positioning System

Melanoma Recognition Using Representative and Discriminative Kernel Classifiers

Robust PID Controller Design by Linear Programming

A Kernel Classifier for Distributions

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Error scaling laws for kernel classification under source and capacity conditions

Automatic Feature Learning for Spatio-Spectral Image Classification With Sparse SVM

Understanding and Improving Fast Adversarial Training

Non-Linear Domain Adaptation with Boosting

Frequency Domain Controller Design by Linear Programming Guaranteeing Quadratic Stability

Robust Controller Design by Linear Programming with Application to a Double-Axis Positioning System

Melanoma Recognition Using Representative and Discriminative Kernel Classifiers

Robust PID Controller Design by Linear Programming

A Kernel Classifier for Distributions