Big Data Tool

13 Feb,2020

In many applications, the volume of data in surveying, mapping, and other industries is large, and the single-threaded simple mode cannot meet the performance requirements for data storage. To solve the problem, the data storage can be completed through the big data tools provided by SuperMap iDesktopX. Based on the Spark distributed computing framework, the multi-core computing resources of the local machine can be used in the stand-alone mode. The data can be imported by the multi-node computing resources after the cluster is configured , which can greatly shorten the time of data storage. Also, there was a on-site testing by users, it takes only nine minutes to import the 40 million confirmed plots data into the Distributed Space File Engine (DSF), and the time consumption can significantly decrease with the increase of Spark computing nodes.

The high efficient data management

After completing the data import, in order to better support the management of distributed data, SuperMap iDesktopX 10i further provides the function of viewing distributed data, for example: viewing some basic information of distributed data, including meta-information, such as data connection information, spatial reference, the number of records, as well as the table structure and attribute values of the dataset. 


In addition, data query retrieval is also an important aspect of distributed data management. SuperMap iDesktopX 10i provides efficient spatial and attribute related query capabilities, it can quickly construct query statements in the CQL query dialog box to complete query operations.

 

SuperMap iDesktopX 10i also supports loading distributed data directly on the map. In order to ensure the display efficiency of massive spatial data, SuperMap iDesktopX 10i supports the performance of large-scale data display at small scales and even full frames through the technical solution of pyramid and multi-thread rendering. When using the big data tools in SuperMap iDesktopX 10i to import data, users can create pyramids for vector data, or can create vector pyramids for existing HBase data with special tools.

Convenient Mapping

Map is the most intuitive way to display GIS data and data processing and analysis results. SuperMap iDesktopX 10i fully supports distributed data mapping, including: layer symbolization, thematic map production, etc., and supports loading style templates for layout, so that existing map results can be reused for distributed data. The most typical application is that after importing a large amount of land map data in land industry into the distributed storage system, the original map template can be directly loaded to quickly obtain the distributed land-use thematic map.

 

SuperMap iDesktopX 10i not only has the ability of mapping in distributed vector data, but also provides practical mapping functions of distributed raster and image data, such as multi-band combination display of image data, raster data color table display, etc. It solves the problem of efficiency in making maps such as mountain shadows, slopes, and aspect maps in the case of massive data.

The direct map-publishing services

SuperMap iDesktopX 10i supports direct publishing of previously configured maps by workspace. With the support of high-performance slice-free distributed rendering technology, it implements large-scale data map-free publishing as an iServer map service and achieves the responsiveness in seconds to reach hundreds of millions of data.

 

Conclusion

SuperMap GIS 10i provides users with convenient and efficient distributed data storage, management, and mapping application tools, which meets the user's data storage requirements in multiple scenarios, which greatly improves user experience and work efficiency.


More Articles