导　　师： 张宇;郭炜强

学科专业： 0812

授予学位： 硕士

作　　者： ;

机构地区： 华南理工大学

摘　　要： 计算机技术在企业中的运用提高了企业运营和管理的效率，很多企业的业务也是基于计算机技术才能得以开展。在现代社会，任何一个企业，尤其是大型企业和互联网企业，会在经营过程中产生大量的、各种各样的数据，我们称之为大数据，大数据有几个典型特征：数据量大、数据类型复杂、处理速度要快。大数据里面包含企业运营的各种信息，如果能对这些信息进行及时有效充分地整理和分析，可以很好地、迅速地帮助企业进行业务决策，响应客户需求，提升企业的竞争力。然而，传统的使用关系数据库对数据进行处理和存储的方式已经很难满足现代企业对数据的处理要求，很多企业都在寻求更高效的数据解决方案。 复杂事件处理技术（complex event processing，CEP）是一种近年来兴起的用于处理复杂的事件逻辑的事件处理方法，复杂事件处理技术的核心思想是将查询条件进行存储和索引，让实时事件流经过这些查询条件，检测这些事件是否触发相应的查询条件。本文研究了复杂事件处理技术的实现机制和技术原理，并研究将复杂事件处理技术运用在企业数据处理中，解决企业系统在海量数据处理方面的问题。 本文基于某电信公司的测量报告（Measurement Report，MR）数据处理系统，引入复杂事件处理技术，改进了现网运行的MR数据处理系统的数据处理方法，利用复杂技术处理技术在海量数据处理方面的高效性来解决海量MR数据的处理问题，提高MR数据处理系统的执行效率。通过只存储有效数据的方式降低数据存储空间的消耗。本文采集了100万条MR数据作为样本数据，对系统的性能进行测试，并与现网运行的MR数据处理系统进行比较，基于复杂事件处理技术的MR数据处理系统改进了现网运行的MR数据处理系统的缺陷，在数据处理效率，数据存储空间的节省等方面均有很大的改进。测试得知，当数据量达到十五万条时，本系统数据处理效率比现网运行的MR数据处理系统提高了三倍以上，数据存储空间仅为现网运行的MR数据处理系统的0.1/%。 The application ofcomputertechnology improve the efficiencyofenterprise operation andmanagement, and a lot of enterprise business can only be carried out based on computertechnology. In the modern society，any enterprise/(especially large enterprise and the Internetenterprise/) will produce large and all kinds of data in business process, which is called thelarge data. Large data has a few typical characteristics: Alarge quantity of data, complex typesof data, and faster processing speed.since the large data contains all kinds of information ofenterprise operation, enterprise can make a business decision in time, response to thecustomer’s demanding, and increase the competition of enterprise by collecting and analyzingthese information timely and efficiently. However, it is difficult to meet the data processingrequirements by using the traditional relational database to process and store data in themodern enterprise. Many companies are looking for more efficient data solutions. Complex event processing /(CEP/) is a logic event handling method for dealing withcomplex event in recent years. The coreidea of it is to storage and index the inquired conditions,then let the real-time event flow through them and to check whether they are triggered by theseconditions. This paper studies the realization mechanism and principle of the complex eventprocessing technology, and how to put it into the enterprise data processing to solve the massdata processing problems in the enterprise system. This paper uses the Measurement Report /(MR/) data processing system of a telecomcompany, and improves the MR data processing system which being used by CEP. Inadditional, the great efficiency of data processing of CEP would help to solve MR’s dataprocessing problem, so that we can improve the execution efficiency of MR data processingsystem and reduce the cost of data storage in a certain extent by storing the valid data. Wecollected one million MR data as input data to conduct the performance testing, and comparewith the conventional MR data processing system. The MR data processing system based oncomplex event processing technology improve the defects of the MR data processing systemwhich being used, and have great improvement in the efficiency of data processing, datastorage space saving, etc. As the result show, when the data more than one hundred and fiftythousand, data processing efficient of our system increased more than three times than the MRdata processing system which being used, and data storage space for0.1/%of it.

关 键 词： 海量数据 复杂事件处理 测量报告

分 类 号： [TP311.52]

领　　域： [自动化与计算机技术] [自动化与计算机技术]