ALGORITHM FOR USING CROWDSOURCING TOOLS FOR COLLECTING AND ANALYSIS OF SCIENTIFIC RESEARCH DATA (BY THE EXAMPLE OF PREPARATION OF SYSTEMATIZED LITERATURE REVIEW)
The number of publications devoted to conducting a systematic literature review in recent years has a steady upward trend and is accompanied by a high citation rate of this type of publications in abstract databases. A survey of researchers with experience in compiling a systematic review of the literature made it possible to determine that the implementation of this laborious process is accompanied by the presence of a fairly large number of difficulties. The purpose of this article is to develop an algorithm for using crowdsourcing tools for collecting and analyzing scientific research (using the example of preparing a systematized literature review). Based on the developed and validated algorithm, a template was created for the crowdsourcing platform Yandex.Toloka. It includes the following stages: determination of selection criteria; definition of keywords for search; checking the correctness of the questions; selection of questions for crowd-sourcing; creation of instructions for performers; placement of instructions on a crowdsourcing platform; creation of a test / training pool of articles; rating of questions for crowdsourcing; determination of the cost of performers' work; creation of control elements; launch of crowdsourcing. Using a template to carry out a systematic review of literature using crowdsourcing tools on the platform Yandex.Toloka will significantly reduce the work of researchers aimed at selecting articles for further analysis.