Reference-based vs. task-based evaluation of human language technology
Graph Chatbot
Chat with Graph Search
Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.
DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.
For about 25 years already, automatic thawing agent spraying systems have been a helpful contribution to the task of winter maintenance. These systems allow a quick intervention as soon as a risk of icing of the roadway appears by spraying a liquid thawing ...
Scene structuring is a video analysis task for which no common evaluation procedures have been fully adopted. In this paper, we present a methodology to evaluate such task in home videos, which takes into account human judgement, and includes a representat ...
The early requirements of an IT system should be aligned with the organization’s business imperatives. To understand these imperatives it is necessary to understand the organization’s position within its environment. SEAM for Business is a method designed ...
The evaluation of learning environments depends highly on the evaluation instruments used and on the position of the evaluation in the design cycle. In this article, we present a use-case report of a summative evaluation of a Web-based learning environment ...
iNEER in cooperation with Begell House Publishers2004
In this paper, we review half a century of research on the design of systems displaying (physical) self-assembly of macroscopic components. We report on the experience gained in the study of 22 such systems, exhibiting components ranging from passive mecha ...
Scene structuring is a video analysis task for which no common evaluation procedures have been fully adopted. In this paper, we present a methodology to evaluate such task in home videos, which takes into account human judgement, and includes a representat ...
This paper extends recent research studying biases in venture capitalist's decision making. We contribute to this literature by analyzing biases arising from similarities between a venture capitalist and members of a venture team. We summarize the psycholo ...
The need to distribute large files across multiple wide-area sites is becoming increasingly common, for instance, in support of scientific computing, configuring distributed systems, distributing software updates such as open source ISOs or Windows patches ...
Current research on performance evaluation of video segmentation methods is primarily focussed on the development of objective figures of merit. There is no standardised methodology for subjective evaluations of segmentation performance and these are curre ...
We apply the boundary element method to the analysis of the plasmon response of systems that consist of coupled metallic nanoscatterers. For systems made of two or more objects, the response depends strongly on the individual particle behavior as well as o ...
