Overview

Events

«Back

PROMISE session at CLEF 2011: "The PROMISE evaluation infrastructure, where Visual Analytics meets Information Retrieval"

8/1/11 10:53 AM

The session is part of CLEF 2011 program. It will describe the overall PROMISE infrastructure architecture, pointing out the role that a Visual Analytics component will play in such a context in order to understand and make sense of the huge amount of measures and other experimental data that an automated environment will quickly host.

The session foresees both oral presentations and live demos, demonstrating the basic ideas behind the PROMISE project: data management, data visualization and analysis, and interaction.

Speakers

  • Giuseppe Santucci - The PROMISE NoE
  • Marco Dussin - The PROMISE Infrastructure
  • Giuseppe Santucci - The role of Visual Analytics within experimental evaluation campaigns
  • Ivano Masiero and Giuseppe Tino - Novel visualizations for Information Retrieval
  • Guido Lorenzo Granato - The PROMISE Visual Analytics Architecture

Demos

  • Accessing the PROMISE Data
  • Analyzing experimental data with interactive visualizations
  • A Visual Analitycs environment for the comparison of ranked result cumulated gains
By Ivano Masiero
37172 Views,

PROMISE: Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation

Large-scale worldwide experimental evaluations provide fundamental contributions to the advancement of state-of-the-art techniques through common evaluation procedures, regular and systematic evaluation cycles, comparison and benchmarking of the adopted approaches, and spreading of knowledge. In the process, vast amounts of experimental data are generated that beg for analysis tools to enable interpretation and thereby facilitate scientific and technological progress.

PROMISE will provide a virtual laboratory for conducting participative research and experimentation to carry out, advance and bring automation into the evaluation and benchmarking of such complex information systems, by facilitating management and offering access, curation, preservation, re-use, analysis, visualization, and mining of the collected experimental data. PROMISE will:

  • foster the adoption of regular experimental evaluation activities;
  • bring automation into the experimental evaluation process;
  • promotecollaboration and re-use over the acquired knowledge-base;
  • stimulate knowledge transfer and uptake.

Europe is unique: a powerful economic community that politically and culturally strives for equality in its languages and an appreciation of diversity in its citizens. New Internet paradigms are continually extending the media and the task where multiple language based interaction must be supported. PROMISE will direct a world-wide research community to track these changes and deliver solutions so that Europe can achieve one of its most cherished goals.