1,721,765 research outputs found
Proposal for an evaluation framework for compliance checkers for long-term digital preservation
No full textPROMISE: Advancing the Evaluation of Multilingual and Multimedi Information Systems
No full textMeasuring is a key to scientific progress. This is particularly true for research concerning complex systems, whether natural or human-built. PROMISE will provide a virtual laboratory for conducting participative research and experimentation to carry out, advance and bring automation into the evaluation and benchmarking of complex multilingual and multimedia information systems
La rete di eccellenza europea PROMISE
No full textL'articolo descrive le motivazioni, finalità, e conseguimenti della rete di eccellenza PROMISE sulla valutazione sperimentale di sistemi di reperimento ed accesso all'informazione multilingue e multimedial
The CLEF Initiative: Conference and Labs of the Evaluation Forum
No full textThis contribution describes the new structure, aims, and motivations behind the CLEF (Conference and Labs of the Evaluation Forum) initiative
CLEF 15th Birthday: Past, Present, and Future
No full text2014 marks the 15th birthday for CLEF, an evaluation campaign activity which has applied the Cranfield evaluation paradigm to the testing of multilingual and multimodal information access systems in Europe. This paper provides a summary of the motivations which led to the establishment of CLEF, and a description of how it has evolved over the years, the major achievements, and what we see as the next challenges
DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation
No full textPROMISE is a network of excellence focused on the experimental evaluation of multilingual and multimedia information access systems. One of its key contributions is to develop and provide an open evaluation infrastructure, which brings automation to the evaluation process, managing, curating, and providing access to the scientific data produced during the evaluation activities
- …
