In this paper, we present an overview of the NTCIR-16 Unbiased Learning to Rank (ULTRE) task. The ULTRE task is motivated by the ongoing development of Unbiased Learning to Rank research, consisting of two subtasks: offline ULTR and online ULTR. In the overview, we introduce the dataset , simulation method and evaluation protocols of ULTRE, and report the official evaluation results of the received runs.
Zhao et al. (Tue,) studied this question.