Publications related to Gradient boosting

Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions

Mathieu Salzmann, Yinlin Hu, Shuxuan Guo

Knowledge distillation facilitates the training of a compact student network by using a deep teacher one. While this has achieved great success in many tasks, it remains completely unstudied for image-based 6D object pose estimation. In this work, we intro ...

Los Alamitos2023

Model agnostic methods meta-learn despite misspecifications

Nicolas Henri Bernard Flammarion, Oguz Kaan Yüksel, Etienne Patrice Boursier

Due to its empirical success on few shot classification and reinforcement learning, meta-learning recently received a lot of interest. Meta-learning leverages data from previous tasks to quickly learn a new task, despite limited data. In particular, model ...

2023

Spatially adaptive machine learning models for predicting water quality in Hong Kong

Rongrong Li, Qiaoli Wang, Yu Xu

Water quality prediction in the spatially heterogeneous environment is challenging as the importance of water quality parameters (WQPs) and the performance of prediction models may vary across space. Thus, this study proposed spatially adaptive machine lea ...

ELSEVIER2023

Byzantine Machine Learning: A Primer

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot

The problem of Byzantine resilience in distributed machine learning, a.k.a., Byzantine machine learning, consists in designing distributed algorithms that can train an accurate model despite the presence of Byzantine nodes, i.e., nodes with corrupt data or ...

2023

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

Touradj Ebrahimi, Yuhang Lu

Cross-resolution face recognition has become a challenging problem for modern deep face recognition systems. It aims at matching a low-resolution probe image with high-resolution gallery images registered in a database. Existing methods mainly leverage pri ...

2023

The statistical complexity of early-stopped mirror descent

Tomas Vaskevicius, Varun Kanade

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by early-stopped unconstrain ...

Oxford2023

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Nirupam Gupta

In this article, we study the problem of Byzantine fault-tolerance in a federated optimization setting, where there is a group of agents communicating with a centralized coordinator. We allow up to

f

Byzantine-faulty agents, which may not follow a prescr ...

Piscataway2023

Fixing the problems of deep neural networks will require better training data and learning algorithms

Martin Schrimpf, Adrien Christophe Doerig, Matthias Bethge, Jianghao Liu, Kuntal Ghosh

Bowers et al. argue that deep neural networks (DNNs) are poor models of biological vision because they often learn to rival human accuracy by relying on strategies that differ markedly from those of humans. We show that this problem is worsening as DNNs ar ...

Cambridge2023

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Colin Neil Jones, Bratislav Svetozarevic, Loris Di Natale

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert knowledge of the syste ...

2023

Subtleties in the trainability of quantum machine learning models

A new paradigm for data science has emerged, with quantum data, quantum models, and quantum computational devices. This field, called quantum machine learning (QML), aims to achieve a speedup over traditional machine learning for data analysis. However, it ...

SPRINGERNATURE2023

Gradient boosting

Graph Chatbot

Chat with Graph Search

Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions

Model agnostic methods meta-learn despite misspecifications

Spatially adaptive machine learning models for predicting water quality in Hong Kong

Byzantine Machine Learning: A Primer

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

The statistical complexity of early-stopped mirror descent

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Fixing the problems of deep neural networks will require better training data and learning algorithms

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Subtleties in the trainability of quantum machine learning models

Model agnostic methods meta-learn despite misspecifications

Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions

Spatially adaptive machine learning models for predicting water quality in Hong Kong

Byzantine Machine Learning: A Primer

The statistical complexity of early-stopped mirror descent

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Fixing the problems of deep neural networks will require better training data and learning algorithms

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

Subtleties in the trainability of quantum machine learning models