Answers are grounded in this paper and cite their sources.
Three representation methods are empirically investigated for Chinese information retrieval: l-gram (single character), bigram (two contiguous overlapping characters), and short-word indexing based on a simple segmentation of the text.The retrieval collection is the approximately 170 MB TRBC-5 Chinese corpus of news articles, and 28 queries that are long and rich in wordings.Evaluation shows that l-gram indexing is good but not sufficiently competitive, while bigram indexing works surprisingly well.Bigrarn indexing leads to a large index term space, three times that of short-word indexing, but is as good as short-word indexing in precision, and about 5% better in relevants retrieved.The best average non-interpolated precision is about 0.45, 17% better than 1-gram indexing and quite high for a mainly statistical approach.
No takes yet. Share an insight, caveat, or question.
K. L. Kwok (1997) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: