Publications de Oguzhan Fatih Kar

Scaling the Modalities in Multimodal Foundation Models

Having a single neural network to handle a wide and varied range of tasks and modalities has been a long-standing goal. Such a model brings notable advantages, such as test-time computational efficiency, modality fusion, and reduced model size. Our goal in ...

EPFL2025

4M: Massively Multimodal Masked Modeling

Amir Roshan Zamir, Oguzhan Fatih Kar, Roman Christian Bachmann, Shuqing Teresa Yeo, David Mizrahi

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...

Neural Information Processing Systems (Nips)2023

Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback

Amir Roshan Zamir, Oguzhan Fatih Kar, Shuqing Teresa Yeo, Zahra Sodagar

We propose a method for adapting neural networks to distribution shifts at test-time. In contrast to training-time robustness mechanisms that attempt to anticipate and counter the shift, we create a closed-loop system and make use of test-time feedback sig ...

Ieee Computer Soc2023

3D Common Corruptions and Data Augmentation

Amir Roshan Zamir, Oguzhan Fatih Kar, Andrei Atanov, Shuqing Teresa Yeo

We introduce a set of image transformations that can be used as corruptions to evaluate the robustness of models as well as data augmentation mechanisms for training neural networks. The primary distinction of the proposed transformations is that, unlike e ...

IEEE COMPUTER SOC2022

Robustness via Cross-Domain Ensembles

Amir Roshan Zamir, Oguzhan Fatih Kar, Shuqing Teresa Yeo

We present a method for making neural network predictions robust to shifts from the training data distribution. The proposed method is based on making predictions via a diverse set of cues (called 'middle domains') and ensembling them into one strong predi ...

IEEE2021

High-Resolution Multi-Spectral Imaging With Diffractive Lenses and Learned Reconstruction

Oguzhan Fatih Kar, Can Deniz Bezek

Spectral imaging is a fundamental diagnostic technique with widespread application. Conventional spectral imaging approaches have intrinsic limitations on spatial and spectral resolutions due to the physical components they rely on. To overcome these physi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021