What question did this study set out to answer?

The aim is to present an overview of the ULTRE task, focusing on unbiased learning to rank methodologies.

April 1, 2026Open Access

Overview of the NTCIR-16 Unbiased Learning to Rank Evaluation (ULTRE) Task

Key Points

The aim is to present an overview of the ULTRE task, focusing on unbiased learning to rank methodologies.
Introduced the NTCIR-16 task including two subtasks: offline and online ULTR.
Outlined the dataset used for the evaluation.
Described the simulation method employed.
Detailed the evaluation protocols established for the task.
Reported official evaluation results based on the received runs of ULTRE.

Abstract

In this paper, we present an overview of the NTCIR-16 Unbiased Learning to Rank (ULTRE) task. The ULTRE task is motivated by the ongoing development of Unbiased Learning to Rank research, consisting of two subtasks: offline ULTR and online ULTR. In the overview, we introduce the dataset , simulation method and evaluation protocols of ULTRE, and report the official evaluation results of the received runs.

Read Full Paperexternally

Demander à l'IA

Bookmark

View Full Paper