Conceptual modeling of multimedia databases

The gap between the semantic content of multimedia data and its underlying physical representation is one of the main problems in the modern multimedia research in general, and, in particular, in the field of multimedia database modeling. We believe that one of the principal reasons of this problem is the attempt to conceptually represent multimedia data in a way, which is similar to its low-level representation by applications dealing with encoding standards, feature-based multimedia analysis, etc. In our opinion, such conceptual representation of multimedia contributes to the semantic gap by separating the representation of multimedia information from the representation of the universe of discourse of an application, to which the multimedia information pertains. In this research work we address the problem of conceptual modeling of multimedia data in a way to deal with the above-mentioned limitations. First, we introduce two different paradigms of conceptual understanding of the essence of multimedia data, namely: multimedia as data and multimedia as metadata. The multimedia as data paradigm, which views multimedia data as the subject of modeling in its own right, is inherent to so-called multimedia-centric applications, where multimedia information itself represents the main part of the universe of discourse. The examples of such kind of applications are digital photo collections or digital movie archives. On the other hand, the multimedia as metadata paradigm, which is inherent to so-called multimedia-enhanced applications, views multimedia data as just another (optional) source of information about whatever universe of discourse that the application pertains to. An example of a multimedia-enhanced application is a human-resource database augmented with employee photos. Here the universe of discourse is the totality of company employees, while their photos simply represent an additional (possibly optional) kind of information describing the universe of discourse. The multimedia conceptual modeling approach that we present in this work allows addressing multimedia-centric applications, as well as, in particular, multimedia-enhanced applications. The model that we propose builds upon MADS (Modeling Application Data with Spatio-temporal features), which is a rich conceptual model defined in our laboratory, and which is, in particular, characterized by structural completeness, spatio-temporal modeling capabilities, and multirepresentation support. The proposed multimedia model is provided in the form of a new modeling dimension of MADS, whose orthogonality principle allows to integrate the new multimedia modeling dimension with already existing modeling features of MADS. The following multimedia modeling constructs are provided: multimedia datatypes, simple and complex representational constraints (relationships), a multimedia partitioning mechanism, and multimedia multirepresentation features. Following the description of our conceptual multimedia modeling approach based on MADS, we present the peculiarities of logical multimedia modeling and of conceptual-to-logical inter-layer transformations. We provide a set of mapping guidelines intended to help the schema designer in coming up with rich logical multimedia document representations of the application domain, which conform with the conceptual multimedia schema. The practical interest of our research is illustrated by a mock-up application, which has been developed to support the theoretical ideas described in this work. In particular, we show how the abstract conceptual set-based representations of multimedia data elements, as well as simple and complex multimedia representational relationships can be implemented using Oracle DBMS.

Towards real-world biomechanical analysis of performance and functional capacity using wearable sensors

Salil Apte

Today, wearable heart rate monitors are an integral part of runners' training sessions, with heart rate data routinely used to assess effort intensity and stress on the body. As athletes translate their physical capacity into performance on the field through their movement, biomechanical assessment can provide valuable information that complements physiological assessment. However, the potential of using biomechanical information in the evaluation of training sessions and standardized tests in practice remains largely untapped, partly because the assessment devices remain cumbersome to use and often require long post-processing, as well as programming skills. The proposed work aims to realize this potential by developing field methods for performance and capacity evaluation using portable inertial measurement units (IMUs) and Global Navigation Satellite System (GNSS) receivers.Running performance can be characterized by the ability to maintain appropriate running technique despite fatigue, while keeping the effort intensity prescribed by the coach, or planned as a pacing strategy. In this work, a systematic review was conducted to examine and synthesize the results of fatigue protocols in running, fol-lowed by continuous measurements during a competition to confirm the trends obtained from the review with data from the field and to measure the changes in running technique due to fatigue. In addition, models were developed to accurately estimate running power using foot-worn IMU over a range of speeds and inclines and validated using gold standard methods in the laboratory, to better characterize running intensity. The second part of this work consisted of investigating the ability of IMUs and GNSS to improve the evaluation of athletes in standardized tests, referred to as their functional capacity. Functional capacity is typically used by coaches to develop appropriate training loads for athletes. This work presented validated methods to instrument common functional tests with wearable sensors to measure the speed, agility, and endurance of athletes in the field. In addition, these methods enable the extraction and a deeper analysis of relevant biomechanical parameters that contribute to the measured capacity and help the sporting staff understand athletes' strengths and weaknesses in detail. All of the research conducted and methods developed in this work are based on various combinations of a minimal body-worn sensor setup with foot-worn IMUs and a single trunk-worn IMU-GNSS unit. The signal processing algorithms and models developed in this work allow the recorded signals to be translated into easily interpretable and actionable information. Based on this information, coaches and physical therapists can develop customized training programs that target the relevant parameters. The proposed sensor setups and methods have been used and validated in a variety of situations, such as pre-season testing of a professional soccer team, training sessions of elite sprinters, the Lausanne half-marathon race, etc., highlighting their potential for real-world application. I believe that this work will help pave the way towards a deeper understanding of the biomechanical contributions to performance in running and provide new tools for the development of personalized training and rehabilitation programs, with the goal of optimizing positive adaptation to training stimuli, thereby improving performance and reducing the incidence of injury.

EPFL2022

Cost Calculator for DMP

Antoine Louis Claude Masson

In recent years, funding agencies, governments, and international organization have issued a series of research data management and sharing policies, like the H2020 [1]. Researchers are encouraged or required to share their production in an open way, including attached publications and data [2]. One consequence of those policies for researchers is the necessity of providing a DMP (Data Management Plan) when applying for funding. This DMP describes the life-cycle of the data during the funded project. In particular, researchers have to specify a description of the generated data, along with their storage, protection, publication and archive strategies. In order to assist researchers with those new requirements and provide them with good practices, many university libraries have developed services around the management of their data [3a][3b]. Among the many information required in a DMP, some are dedicated to the costs the researchers will face for their data management, storage or curation. Those questions are usually painful, as the applicant has to have full knowledge of existing providers for storage, archive or publication services. These providers can be part of their institution or exist outside. Few helpful information exists. One can find costing tools in form of a spreadsheet or a static document in which the researcher is lost or will spend a lot of time to find the needed information. Most of these tools do neither give any providers’ nor real cost information. It's in this context that the Research Data Management Team of EPFL Library has developed an online tool, creating a central place for researchers to find and calculate their costs related to the data life-cycle [4]. The tool contains a cost database that includes most of our institution services and some external providers. Furthermore, this tool provides good practice for the researchers around calculating costs. It is designed entirely for self-use and doesn't need any training. By using a modern code repository and open source libraries, the cost database can be updated and changed easily without specific technical knowledge, which makes deployment in other institutions handy. The cost database can be implemented with any kind of providers, such as institutional or private ones and adapted for any kind of pricing model. During the presentation, we will first introduce the tool and its functionalities, discuss the advantages for the researchers, and end with how the tool can be used by other interested partners. Bibliography [1] : Guedj, D., Ramjoué, C.: European Commission Policy on Open-Access to Scientific Publications and Research Data in Horizon 2020. Biomed Data J. 2015;1(1):11-14. DOI: http://dx.doi.org/10.11610/bmdj.01102 [2] : Whyte, A., Pryor, G.: Open Science in Practice: Researcher Perspectives and Participation. Int. J. Digit. Curation. 6, 199–213 (2011). DOI : https://doi.org/10.2218/ijdc.v6i1.182 [3a] : Peters, C., Dryden, A.R.: Assessing the Academic Library’s Role in Campus-Wide Research Data Management: A First Step at the University of Houston. Sci. Technol. Libr. 30, 387–403 (2011). DOI : https://doi.org/10.1080/0194262X.2011.626340 [3b] : Tenopir, C. et al.: Research Data Services in European Academic Research Libraries, LIBER Quarterly, vol. 27, n° 1, 23‑44 (2017). DOI : http://doi.org/10.18352/lq.10180 [4] : Cost Calculator, A. Masson, EPFL Library DOI: http://dx.doi.org/10.5281/zenodo.1469035 https://rdmepfl.github.io/costcalc/

2019

Towards Seamless Continuation of Knowledge in Product Lifecycle Management

Apostolos Perdikakis

The current ICT for manufacturing landscape is characterized by scattered data formats, tools and processes dedicated to different phases in the product lifecycle. Due to the diversity of tools and data formats, manufacturing struggles to cope with new trends in this area. What is clearly missing in the current ICT landscape for manufacturing is an integrated, holistic view on data about products to be manufactured, resources (including human resources) and processes across the full product lifecycle. There is a need to formalize knowledge for the automatic integration in existing engineering tools. In this work ontology-based semantics were exploited to develop machine-understandable models, which are able to understand the meaning of the data and information they contain. The system developed using semantic web methods and tools is designed to support interoperability and data integration, as well as lead a way towards the usage of information contained in the system to extract useful knowledge. This knowledge may provide feedback for improving the design of future generations of products. Thus, the concept of seamless continuation of knowledge all along product-system lifecycles is introduced.The first step of this work was to study the state-of-the-art in PLM and Semantic web Technologies. This included theoretical background in concepts like Beginning Of Life (BOL), Middle Of Life (MOL) and End Of Life (EOL) regarding PLM as well as the definition and theoretical background of Ontologies and Semantic Web Technologies. After completing the study of theoretical background, more advanced research concepts and methodologies for both domains were thoroughly analysed. Examples include Closed Loop Lifecycle Management (CL2M) for PLM and NEON Method-ology for Ontology engineering. The next logical step followed was to find and discover relevant standards like STEP for PLM and W3C standards for Ontologies and Semantic Web Technologies. The engineering aspect of this study imposed the review of available tools both for PLM and Ontology Engineering. Ontology development tools like Protégé, TopBraid composer and Anzo Ontology editor were studied. More advanced software solutions for applications of the semantic web were also studied. Examples include Anzo Enterprise and the Open Semantic Framework. Inspiration also came from previous European projects like EC FP6 Promise. The problem of discontinuation, even after an Ontology model is created, is evident in most of the applications studied as background of this work. Ontology models have to be exploitable and that requires a framework of which they can be part of. The research for successful implementations of ontology driven frameworks was imperative. At first, the open seman-tic framework (osf) was the software stack that came into focus. After being thoroughly studied, it proved difficult to deploy and maintain, for it had still many problematic areas with its configuration and required people with very ad-vanced software skills (both in programing and system configuration). Nevertheless, the examples of use are promis-ing and give many ideas for exploitation. This finding triggered the efforts towards the definition and application of the solution proposed in this work, which has the following characteristics. First and most important, the solution is easy to deploy and maintain, since it is targeting SMEs and large enterprises that want to test the capabilities of the proposed[...]

EPFL2015