Natural language recognition in intelligent systems
This article deals with the problem of natural language recognition, namely, categorization of textual information. Presented one of the most widely used at present techniques for text categorization, such as Naive Bayes classifier, Latent Dirichlet allocation, Probabilistic latent semantic analysis, k-nearest neighbors and hidden Markov models. It is suggested that the algorithm Hidden Markov Models is more suitable for text categorization and studied ways pretreatment texts before categorization. Also shown in the result of running the code working with text normalization algorithm.