陆地和海洋站点网格数据融合与快速服务技术

作者：郭士鑫1,2, 张驰1, 蒋智浩3,4, 杨明2,5, 陈正旭1

单位：1. 浙江省气象数据中心, 浙江 杭州 310051; 2. 中国气象局气象软件重点开放实验室, 北京 100080; 3. 自然资源部第二海洋研究所, 浙江 杭州 311100; 4. 浙江大学, 浙江 杭州 310012; 5. 浙江省气象服务中心, 浙江 杭州 310051

关键词：海洋浮标;数据融合;串并联;容器;评估

分类号：P717

出版年·卷·期（页码）：2026·43·第3期(105-114)

摘要：

为解决陆地和海洋站点与网格数据融合及数据服务过程中存在的信息技术难题，以浙江省为例，对全省5 000余个地面自动站、2个海洋浮标站以及智能网格产品开展分析研究。梳理数据服务特征，将网格化融合算法分成36类；采用镜像容器技术，服务端根据负载情实现况自动弹性伸缩，快速读取站点和网格数据；基于多进程多线程混合编程，结合分块和K维树查询技术，实现站点数据快速质控，并完成与网格产品的数据融合；采用管道式设计异步事件响应流程，通过算法串并联自由编排形成新任务；构建算法准入评估模型，从算法处理能力、稳定性、资源利用率、耦合度等方面进行评估。

In order to solve the information technology problems existing in the process of data fusion and data service between land ocean stations and grids, taking Zhejiang Province as an example, data from more than 5 000 ground meteorological automatic stations, 2 ocean buoy stations and intelligent grid products are studied. The characteristics of data services are analyzed, and the grid fusion algorithm is divided into 36 categories; Using the image container technology, the server automatically scales the capacity according to the load usage, and quickly reads the site and grid data; Based on multi-process and multi-thread mixed programming, block and KDimensional Tree(KD tree) query technology, the site data is quickly quality controlled and fused with grid products; Based on the asynchronous event response flow route of pipeline design style, the algorithm is freely arranged in series and parallel to form a new task; An algorithm admission evaluation model is designed to evaluate the processing capacity, stability, resource utilization and coupling of the algorithm.

参考文献：

[1] 宋扬,王冀,冯璞玉,等.基于ETCCDI指数的京津冀地区极端气候事件特征及影响分析[J].气象与环境学报, 2024, 40(3):97-105.SONG Y, WANG J, FENG P Y, et al. Characteristics and impact analysis of extreme climate events in Beijing-Tianjin-Hebei region based on ETCCDI indices[J]. Journal of Meteorology and Environment, 2024, 40(3):97-105. [2] 李永生,曾沁,杨玉红,等.基于大数据技术的气象算法并行化研究[J].计算机技术与发展, 2016, 26(9):47-49.LI Y S, ZENG Q, YANG Y H, et al. Research on parallelism of typical meteorological algorithm based on big data technology[J].Computer Technology and Development, 2016, 26(9):47-49. [3] 霍庆,何文春,高峰,等.基于数据感知的气象算法调度框架设计与应用[J].应用气象学报, 2024, 35(4):502-512.HUO Q, HE W C, GAO F, et al. Design and application of meteorological algorithm scheduling framework based on data perception technology[J]. Journal of Applied Meteorological Science, 2024, 35(4):502-512. [4] 鲁岩.神州专车司机效率平台设计与实现[D].大连:大连理工大学, 2016.LU Y. Design and implementation of the Shenzhou ucar driver engagement platform[D]. Dalian:Dalian University of Technology,2016. [5] 韩毅,韩伟红,杨树强,等.面向OLAP的高效海量数据存储技术研究与实现[J].微电子学与计算机, 2006, 23(S1):154-156.HAN Y, HAN W H, YANG S Q, et al. The study and implementation of an effective massive data storage technique to OLAP[J]. Microelectronics&Computer, 2006, 23(S1):154-156. [6] 唐懿,蔡雯悦,翟建青,等. 2021年夏季中国气候异常特征及主要气象灾害[J].干旱气象, 2022, 40(2):179-186.TANG Y, CAI W Y, ZHAI J Q, et al. Climatic anomalous features and major meteorological disasters in China in summer of 2021[J].Journal of Arid Meteorology, 2022, 40(2):179-186. [7] 毛紫薇,章璇,唐加山.气象数据高精度融合技术研究[J].建模与仿真, 2024, 13(6):6283-6290.MAO Z W, ZHANG X, TANG J S. Research on high-precision fusion technology for precipitation observation[J]. Modeling and Simulation, 2024, 13(6):6283-6290. [8] 姚日升,涂小萍,徐蓉,等.基于浮标观测和ERA5资料的浙江沿海海浪特征分析[J].海洋预报, 2024, 41(5):34-43.YAO R S, TU X P, XU R, et al. Sea wave characteristics along Zhejiang coast based on buoy observations and ERA5 data[J].Marine Forecasts, 2024, 41(5):34-43. [9] 陈国军,李子祥,付云鹏,等.基于Delaunay三角网的克里金并行算法优化[J].计算机系统应用, 2024, 33(1):213-218.CHEN G J, LI Z X, FU Y P, et al. Optimization of Kriging parallel algorithm based on Delaunay triangulation network[J]. Computer Systems&Applications, 2024, 33(1):213-218. [10] 罗佳,李朝锋.基于残差图卷积网络与深度强化学习的需求可拆分车辆路径优化算法[J].控制理论与应用, 2024, 41(6):1123-1136.LUO J, LI C F. The split delivery vehicle routing optimization with the residual graph convolutional network and deep reinforcement learning[J]. Control Theory Applications, 2024, 41(6):1123-1136. [11] 吴鹏,韩同欣,陈士旺,等.气象大数据云平台仿真环境容器调度性能优化研究[J].气象科技, 2024, 52(3):340-346.WU P, HAN T X, CHEN S W, et al. Research on optimization of Docker scheduling performance for simulation environment of meteorological big data cloud platform[J]. Meteorological Science and Technology, 2024, 52(3):340-346. [12] 来志云,赵冰燕,郭彩莲.虚谷数据库应用于气象大数据云平台中[J].中国航班, 2021(14):52-53.LAI Z Y, ZHAO B Y, GUO C L. Application of virtual XUGU database in meteorological big data cloud platform[J]. China Flights, 2021(14):52-53. [13] 曾理,吕晓丹.面向微服务的容器伸缩策略[J].计算机应用与软件, 2023, 40(7):91-96.ZENG L, LYU X D. A container scaling strategy for microservices[J]. Computer Applications and Software, 2023, 40(7):91-96. [14] 吴昊亮,刘永宏,危建朋,等.异构体系结构下的混合负载数据库自适应并行技术[J].计算机应用, 2024, 44(S1):89-94.WU H L, LIU Y H, WEI J P, et al. Adaptive parallelism technology for mixed-load database in heterogeneous architecture[J]. Journal of Computer Applications, 2024, 44(S1):89-94. [15] Zhang F Q, et al. On the dynamics of hurricane intensity and structure under observation analysis nudging[J]. Journal of the Atmospheric Sciences,(2016), 73(3), 1105-1125. [16] 何浩.基于深度学习短视频智能审核API算法服务平台研究与实现[D].金华:浙江师范大学, 2020.HE H. Research and implementation of intelligent audit API algorithm service platform for short video based on deep learning[D]. Jinhua:Zhejiang Normal University, 2020. [17] 曾悠,封秀燕,杨明.一种微服务框架的浙江气象应用开放服务技术研究与实现[J].现代计算机, 2023, 29(24):112-116.ZENG Y, FENG X Y, YANG M. Research and implementation of Zhejiang open service technology for meteorological application based on microservice framework[J]. Modern Computer, 2023, 29(24):112-116. [18] 徐拥军,倪学磊,郑波,等.基于位置的天气实况数据服务接口设计与应用[J].计算机系统应用, 2023, 32(5):77-86.XU Y J, NI X L, ZHENG B, et al. Design and application of live weather data service interface based on user's location[J].Computer Systems&Applications, 2023, 32(5):77-86. [19] Yuan L H, Liu H X, Lu Y J, et al. Multi-objective integrated decision method of cascade hydropower stations based on optimization algorithm and evaluation model[J]. Journal of Hydrology, 2024, 638:131533. [20] Feng J, He Y J, Pan Y H, et al. Enhancing fitness evaluation in genetic algorithm-based architecture search for AI-aided financial regulation[J]. IEEE Transactions on Evolutionary Computation,2024, 28(3):623-637. [21] 程春蕊,刘万军.高内聚低耦合软件架构的构建[J].计算机系统应用,2009, 18(7):19-22.CHENG C R, LIU W J. Construction of high coheres and low coupling software architecture[J]. Computer Systems&Applications, 2009, 18(7):19-22.

服务与反馈：

【文章下载】【发表评论】【查看评论】【加入收藏】