Predicting next Word using RNN and LSTM cells: Stastical Language Modeling

Language Modeling is defined as the operation of predicting next word. It is considered as one of the basic tasks of Natural Language Processing(NLP) and Language Modeling has several applications. In this research paper, the assorted potentialities for the efficient utilization of language models in structured document retrieval are mentioned. A tree-based generative language model for ranking documents and parts has been used here. Nodes within the tree correspond to different document parts like titles, paragraphs and sections. At every node within the document tree, there's a well-defined language model. The language model for a leaf node is predictable directly from the text within the document part related to the node. Inner nodes within the tree are predictable employing a linear interpolation among the various youngster nodes. The paper additionally describes how some common structural queries would be satisfactorily described inside this model.