PIR-CLEF 2019

The core objective of PIR-CLEF 2019 is to develop laboratory-based evaluation methods to enable comparative evaluation of personalization in Web search and medical search.

ORGANIZERS
  • Gabriella Pasi, University of Milano-Bicocca (DISCo), Milan, Italy
  • Gareth Jones, Dublin City University, Dublin, Ireland
TASKS
  • Task 1 – Web Search
  • Task 2 – Medical Search
Task 1 – Web Search

The Web Search task aims to explore personalization in web search sessions based on user profiles and activity with the current and previous search sessions by this user. Task participants will be provided with user profile data and logs of search activity with the objective of improving search effectiveness over that achieved in the logged search sessions. A particular focus in PIR-CLEF 2019 will be on the exploration of methods and metrics for comparative of search sessions.

Task 2 – Medical Search

Medical search is one of the most common interests of users of search engines. User queries for medical information are often highly ambiguous. The Medical Search task will focus on adaptation and personalization of medical search sessions carried out by volunteer searchers based on defined diverse search scenarios and logged search behavior. Task participants will be provided with user profiles, queries and search session logs. Similar to the Web Search task, the Medical task will also explore the methods and metrics for comparative evaluation of search sessions.