Reference-based vs. task-based evaluation of human language technology
Publications associées (44)
Graph Chatbot
Chattez avec Graph Search
Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.
AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.
In this paper, we review half a century of research on the design of systems displaying (physical) self-assembly of macroscopic components. We report on the experience gained in the study of 22 such systems, exhibiting components ranging from passive mecha ...
This paper extends recent research studying biases in venture capitalist's decision making. We contribute to this literature by analyzing biases arising from similarities between a venture capitalist and members of a venture team. We summarize the psycholo ...
For about 25 years already, automatic thawing agent spraying systems have been a helpful contribution to the task of winter maintenance. These systems allow a quick intervention as soon as a risk of icing of the roadway appears by spraying a liquid thawing ...
We apply the boundary element method to the analysis of the plasmon response of systems that consist of coupled metallic nanoscatterers. For systems made of two or more objects, the response depends strongly on the individual particle behavior as well as o ...
The evaluation of learning environments depends highly on the evaluation instruments used and on the position of the evaluation in the design cycle. In this article, we present a use-case report of a summative evaluation of a Web-based learning environment ...
iNEER in cooperation with Begell House Publishers2004
The need to distribute large files across multiple wide-area sites is becoming increasingly common, for instance, in support of scientific computing, configuring distributed systems, distributing software updates such as open source ISOs or Windows patches ...
Scene structuring is a video analysis task for which no common evaluation procedures have been fully adopted. In this paper, we present a methodology to evaluate such task in home videos, which takes into account human judgement, and includes a representat ...
Scene structuring is a video analysis task for which no common evaluation procedures have been fully adopted. In this paper, we present a methodology to evaluate such task in home videos, which takes into account human judgement, and includes a representat ...
Current research on performance evaluation of video segmentation methods is primarily focussed on the development of objective figures of merit. There is no standardised methodology for subjective evaluations of segmentation performance and these are curre ...
The early requirements of an IT system should be aligned with the organization’s business imperatives. To understand these imperatives it is necessary to understand the organization’s position within its environment. SEAM for Business is a method designed ...