We present two measures for comparing corpora based on information theory statistics such as gain ratio as well as simple term-class frequency counts. We tested the predictions made by these measures about corpus difficulty in two domains --- news and molecular biology --- using the result of two well-used paradigms for NE, decision trees and HMMs and found that gain ratio was the more reliable predictor.
No takes yet. Share an insight, caveat, or question.
Nobata et al. (2000) studied this question.
Synapse has enriched 4 closely related papers on similar clinical questions. Consider them for comparative context: