Methodical approach to the identification of duplicating topics of projects
The article considers the approach to identifying duplication of information, by comparison of matching collocations. The stability of the simultaneous use of two words (bigrams) in a certain semantic fragment is estimated. Text corpus of single project is used as a semantic fragment for general collocation. For private collocation within the text corpus of a single project, semantic fragments are selected in the form of separate sentences and the degree of approximation to the fulfillment of the properties of transitivity, symmetry in the collection of documents is estimated.