KASYS at the NTCIR-16 WWW-4 Task

The KASYS team participated in the English subtask of the NTCIR-16 WWW-4 task. This paper describes our approach of generating NEW runs, and REV runs in the NTCIR-16 WWW-4 task. We applied BERT reading comprehension model to the WWW-4 task for generating NEW runs. We investigated the effectiveness of reading comprehension model in the ad-hoc Web document retrieval task. The evaluation results showed that our run outperformed the baseline in the gold relevance assessment for the four runs we submitted. The evaluation results of REV runs showed that our runs in WWW-3 still well performed in WWW-4.