Publications related to Machine Learning and Optimization Laboratory

Exploring neural networks and their potential for species distribution modeling

Devis Tuia, Benjamin Alexander Kellenberger, Nina Marion Aurélia Van Tiel, Robin Adrien Zbinden, Lloyd Haydn Hughes

Species distribution models (SDMs) relate species occurrence data with environmental variables and are used to understand and predict species distributions across landscapes. While some machine learning models have been adopted by the SDM community, recent ...

2023

A multi-modal pre-training transformer for universal transfer learning in metal-organic frameworks

Berend Smit, Hyunsoo Park

Metal-organic frameworks (MOFs) are a class of crystalline porous materials that exhibit a vast chemical space owing to their tunable molecular building blocks with diverse topologies. An unlimited number of MOFs can, in principle, be synthesized. Machine ...

NATURE PORTFOLIO2023

The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations

Vinitra Swamy, Jibril Albachir Frej

Explainable Artificial Intelligence (XAI) plays a crucial role in enabling human understanding and trust in deep learning systems, often defined as determining which features are most important to a model's prediction. As models get larger, more ubiquitous ...

2023

Fast Adversarial Training With Adaptive Step Size

Sabine Süsstrunk, Mathieu Salzmann, Chen Liu, Zhuoyi Huang, Yong Zhang, Jue Wang

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of recent works to ...

Piscataway2023

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Karl Aberer, Rémi Philippe Lebret, Mohammadreza Banaei

Recent transformer language models achieve outstanding results in many natural language processing (NLP) tasks. However, their enormous size often makes them impractical on memory-constrained devices, requiring practitioners to compress them to smaller net ...

Assoc Computational Linguistics-Acl2023

Time Series Analysis of Urban Liveability

Devis Tuia, Diego Marcos Gonzalez, Alex Hubertus Levering

In this paper we explore deep learning models to monitor longitudinal liveability changes in Dutch cities at the neighbourhood level. Our liveability reference data is defined by a country-wise yearly survey based on a set of indicators combined into a liv ...

IEEE2023

MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks

Martin Jaggi, Mary-Anne Hartley, Vinitra Swamy, Jibril Albachir Frej, Thierry Bossy, Thijs Vogels, Malika Satayeva

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space with aligned sema ...

2023

Byzantine Machine Learning: A Primer

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot

The problem of Byzantine resilience in distributed machine learning, a.k.a., Byzantine machine learning, consists in designing distributed algorithms that can train an accurate model despite the presence of Byzantine nodes, i.e., nodes with corrupt data or ...

2023

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Nirupam Gupta

In this article, we study the problem of Byzantine fault-tolerance in a federated optimization setting, where there is a group of agents communicating with a centralized coordinator. We allow up to

f

Byzantine-faulty agents, which may not follow a prescr ...

Piscataway2023

Rethinking data augmentation for adversarial robustness

Kathrin Grosse

Recent work has proposed novel data augmentation methods to improve the adversarial robustness of deep neural networks. In this paper, we re-evaluate such methods through the lens of different metrics that characterize the augmented manifold, finding contr ...

2023

Machine Learning and Optimization Laboratory

Graph Chatbot

Chat with Graph Search

Exploring neural networks and their potential for species distribution modeling

A multi-modal pre-training transformer for universal transfer learning in metal-organic frameworks

The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations

Fast Adversarial Training With Adaptive Step Size

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Time Series Analysis of Urban Liveability

MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks

Byzantine Machine Learning: A Primer

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Rethinking data augmentation for adversarial robustness

MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks

The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations

Rethinking data augmentation for adversarial robustness

Fast Adversarial Training With Adaptive Step Size

Time Series Analysis of Urban Liveability

A multi-modal pre-training transformer for universal transfer learning in metal-organic frameworks

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Byzantine Machine Learning: A Primer

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Exploring neural networks and their potential for species distribution modeling