What question did this study set out to answer?

The research aims to provide a comprehensive overview of the NTCIR-18 project and its contributions to IR and NLP.

April 1, 2026Open Access

Overview of NTCIR-18

Key Points

The research aims to provide a comprehensive overview of the NTCIR-18 project and its contributions to IR and NLP.
Organized by the National Institute of Informatics in Japan.
Features seven core tasks and three pilot tasks.
Includes participation from 113 teams globally.
NTCIR-18 emphasizes LLM evaluation and advanced information retrieval techniques.
Introduces innovative methods for handling personal data management in NLP.

Abstract

The NTCIR project, organized by the National Institute of Informatics (NII) in Japan, has been a key platform for information retrieval (IR) and natural language processing (NLP) research since 1997. NTCIR-18, running from January 2024 to June 2025, features seven core tasks and three pilot tasks covering LLM evaluation, advanced IR, domain-specific NLP, and personal data management. A total of 113 teams worldwide participated, registering 178 times across tasks. This paper provides an overview of NTCIR-18, highlighting its objectives, methodologies, and key findings, along with future directions.

Read Full Paperexternally

AIに質問

Bookmark

View Full Paper