JIANG Hua, HAN Fei, WANG Xin, WANG Hui-jiao. MapReduce-based ocean heterogeneous data integration and real-time query display[J]. Chinese Journal of MARINE ENVIRONMENTAL SCIENCE, 2019, 38(6): 963-967. DOI: 10.12111/j.mes20190621
Citation: JIANG Hua, HAN Fei, WANG Xin, WANG Hui-jiao. MapReduce-based ocean heterogeneous data integration and real-time query display[J]. Chinese Journal of MARINE ENVIRONMENTAL SCIENCE, 2019, 38(6): 963-967. DOI: 10.12111/j.mes20190621

MapReduce-based ocean heterogeneous data integration and real-time query display

  • With the development of information technology, the pace of diversified information systems construction in the marine sector has continued to accelerate.In the context of big data, the heterogeneous nature of ocean data makes it uneasy for ocean data to be shared and managed in a unified way, which leads to the phenomenon of data silos.Combining the MapReduce calculation model, and deeply studying in this issue, this paper proposes a heterogeneous data integration framework based on middleware architecture.The framework adopts the mediator mode for querying data, and uses the graph structure to search for nodes in the query process.Through the practical project experimental verification, the framework can provide an effective real-time data query solution and to a certain extent reduce the occurrence of data islanding.
  • loading

Catalog

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return