Methods of working with “big data” based on the application of “m-tuple” theory.
Abstract
This article addresses the creation and application of mathematical methods to work with “big data”. This allows us to minimize the time and computational resources involved for a data organization structure “m-tuples based on ordered sets of arbitrary cardinality (OSAC)”. We reviewed and analysed mathematical methods used to solve problems of this class. We formulated several properties of this data organization structure which are a consequence of the logical rules for the formation of this structure. A set of functional dependencies between m-tuples is derived based on their location in the structure and is determined by a pair of indices (j, m) under particular initial conditions. It is also given the illustration of the Boolean graph. The outlined vertices of the graph are determined using the derived analytical dependencies as Boolean elements that include the same general element under particular initial conditions. We made a comparative evaluation between the execution time for the method to work with “big data” and the analogue methods described in the article. We obtained logical conclusions about the influence of the properties studied and methods to work with the structure “m-tuples based on OSAC” on the minimization of the computing resources involved.
References
Min Chen. Big Data. Related Technologies, Challenges, and Future Prospects / Min Chen, Shiwen Mao, Yin Zhang, Victor C.M. Leung. Spinger. – 2014. – 100 p.
MacGregor J. Monitoring, Fault Diagnosis, Fault-Tolerant Control and Optimization / J. MacGregor, A. Cinar // Data Driven Methods. Computers & Chemical Engineering. – 2012. – Vol. 47. – P. 111-120.
Syrotkina O. The Application of Specialized Data Structures for SCADA Diagnostics / O. Syrotkina. System technologies. Regional interuniversity collection of scientific papers. – 2015. – Vol. 4. – P. 72−81.
Syrotkina O. Graphical and Analytical Methods for Processing «Big Data» Based on the Analysis of Their Properties / O. Syrotkina, M. Alekseyev, I. Udovik . System technologies. Regional interuniversity collection of scientific papers. – 2019. – Vol. 4. – P. 78−90.
Syrotkina, O., Alekseyev, M., Asotskyi, V., Udovik I. Analysis of How the Properties of Structured Data Can Influence the Way These Data are Processed / O. Syrotkina, M. Alekseyev, V. Asotskyi, I. Udovik. Naukovyi Visnyk Natsionalnoho Hirnychoho Universytetu. – 2019. – 3(171). – P. 119−128.
Abstract views: 19 PDF Downloads: 4