时序数据多维聚合查询服务的实现
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP311

基金项目:

国家自然科学基金面上资助项目(61672042)。


Implementation of multidimensional aggregate query service for time series data
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着电能质量监测点不断扩大,产生海量具有时序特性的多维电能质量数据,当前的诸多数据查询方法不能适应电网电能质量监测数据的交互式多维聚合查询需求。研究提出时序数据多维聚合服务的实现方法,为内存中预聚合后的任务结果建立哈希存储结构,对实时数据建立位图索引存储结构,将历史数据的预聚合数据尽量存储于内存中,改进随机读写的低性能问题,提升查询效率,解决交互式查询问题。同时运用最优聚合任务算法选择出尽量多的预聚合任务数,提高交互式查询命中率。实验验证了该算法的可行性,与分组二维背包算法相比,在预聚合任务数量选择方面具有一定优势。

    Abstract:

    With the continuous expansion of power quality monitoring points, a large number of multi-dimensional power quality data with time series characteristics have been generated. The existing data query methods can not meet the need of interactive multi-dimensional aggregation query of power quality monitoring data. This paper presents a method to implement multi-dimensional aggregation service for sequential data. It establishes a hash storage structure for pre-aggregated task results in memory, a bitmap index storage structure for real-time data, and stores pre-aggregated historical data in memory as much as possible thereby improving the performance of random reading and writing, and the efficiency of query, solving the problem of interactive query. At the same time, the optimal aggregation task selection algorithm is used to select as many pre-aggregation tasks as possible to improve the hit rate of interactive queries. Experiments verify the feasibility of the proposed algorithm. Compared with the grouped two-dimensional knapsack algorithm, it has certain advantages in the number of pre-aggregated tasks.

    参考文献
    相似文献
    引证文献
引用本文

盛家,房俊,郭晓乾,王承栋.时序数据多维聚合查询服务的实现[J].重庆大学学报,2020,43(7):121-128.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2020-01-20
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2020-07-18
  • 出版日期:
文章二维码