Publications associées à Data engineering

Diversity and neocolonialism in Big Data research: Avoiding extractivism while struggling with paternalism

The extractive logic of Big Data-driven technology and knowledge production has raised serious concerns. While most criticism initially focused on the impacts on Western societies, attention is now increasingly turning to the consequences for communities i ...

Sage Publications Inc2023

Interactive-time Exploration, Querying, and Analysis of Large High-dimensional Datasets

Sachin Basil John

In the current era of big data, aggregation queries on high-dimensional datasets are frequently utilized to uncover hidden patterns, trends, and correlations critical for effective business decision-making. Data cubes facilitate such queries by employing p ...

EPFL2023

Blue Brain Nexus: An open, secure, scalable system for knowledge graph management and data-driven science

Henry Markram, Sean Lewis Hill, Samuel Claude Kerrien, Carolina Johanna Elisabeth Lindqvist, Alejandra Garcia Rojas Martinez, Huanxiang Lu, Mohameth François Sy, Anna-Kristin Kaufmann, Jonathan Raël Lurie, Henry Genet

Modern data-driven science often consists of iterative cycles of data discovery, acquisition, preparation, analysis, model building and validation leading to knowledge discovery as well as dissemination at scale. The unique challenges of building and simul ...

2023

Bridging the gap between model-driven and data-driven methods in the era of Big Data

Gael Lederrey

Data-driven and model-driven methodologies can be regarded as competitive fields since they tackle similar problems such as prediction. However, these two fields can learn from each other to improve themselves. Indeed, data-driven methodologies have been d ...

EPFL2022

Columnar Storage Optimization and Caching for Data Lakes

Haoqiong Bian

As a unified data repository, data lake plays a vital role in enterprise data management and analysis. It composes the raw files into tables that are processed in-situ by various computation engines and applications. Therefore, the read performance of the ...

2022

Deep Learning Enables Individual Xenograft Cell Classification in Histological Images by Analysis of Contextual Features

Michaël Unser, Cathrin Brisken, Daniel Sage, Olivier Burri, Quentin Juppet, Fabio De Martino, Martin Weigert

Patient-Derived Xenografts (PDXs) are the preclinical models which best recapitulate inter- and intra-patient complexity of human breast malignancies, and are also emerging as useful tools to study the normal breast epithelium. However, data analysis gener ...

2021

Historical City Maps Semantic Segmentation Dataset

Rémi Guillaume Petitpierre

This dataset includes a total of 635 annotated image patches from historical city maps. It is designed for the semantic segmentation of the maps into 5 semantic classes (building blocks, non-built, water, road network, background frame). 330 patches are ta ...

Zenodo2021

Countering Bias in Personalized Rankings From Data Engineering to Algorithm Development

Mirko Marras

This tutorial presents recent advances on the assessment and mitigation of data and algorithmic bias in personalized rankings. We first introduce fundamental concepts and definitions associated with bias issues, covering the state of the art and describing ...

IEEE COMPUTER SOC2021

Decentralized Industrial IoT Data Management Based on Blockchain and IPFS

Dimitrios Kyritsis, Jinzhi Lu, Xiaochen Zheng

The wide application of Internet of Things (IoT) has fostered the development of Industry 4.0. In manufacturing domain, Industrial IoT (IIoT) are key components of the Factories of the Future (FoF). The big IIoT data are the foundation of implementing data ...

SPRINGER INTERNATIONAL PUBLISHING AG2020

DELF: Safeguarding deletion correctness in Online Social Networks

Georgios Damaskinos

Deletion is a core facet of Online Social Networks (OSNs). For users, deletion is a tool to remove what they have shared and control their data. For OSNs, robust deletion is both an obligation to their users and a risk when developer mistakes inevitably oc ...

USENIX ASSOC2020