High performance federated Geographic Information System Framework

ABSTRACT

Geographic information is critical for building disaster planning, crisis management and early-warning systems. Decision making in Geographic Information Systems (GIS) increasingly relies on analyses of spatial data in map-based formats. Maps are complex structures composed of layers created from distributed heterogeneous data belonging to the separate organizations. This thesis presents a distributed service architecture for managing the production of knowledge from distributed collections of archived observations and simulation data through integrated data-views. Integrated views are defined by a federation service (“federator”) located on top of the standard service components. Common GIS standards enable the construction of this system. However, compliance requirements for interoperability, such as XML-encoded data and domain specific data characteristics, have costs and performance overhead. We investigate issues of combining standard compliance with performance. Although our framework is designed for GIS, we extend the principles and requirements to general science domains and discuss how these may be applied.

http://complexity.ucs.indiana.edu/~asayar/thesis/presentation_drafts/asayar_federated_GIS.ppt

Status Report for 01/17/2008

Here is the outline of the document I had mentioned in my previous post. This is actually a thesis chapter titled "High-performance design features, measurements and analysis".

The chapter focuses on high-performance design features and analysis in map rendering from heterogeneous distributed scientific geo-data.

The chapter first presents the common performance issues in interoperable Service-oriented Geographic Information Systems (Chapter 6.1), and then provides baseline performance test results obtained from GIS systems developed with conventional approaches (Chapter 6.2).

The proposed performance design features and corresponding measurements/analysis (Chapter 6.3) are grouped into two. One is focusing on XML encoded (GML common data model) data transfer and rendering (Chapter 6.3.1), and other is focusing on design issues for implementing of caching and parallel processing techniques at federator (Chapter 6.3.2).

Here is the snapshot of outline of the chapter. Please click on it to get better view.

Status Report for 01/09/2008

1. I have improved the document titled "High-performance design features, performance and measurements". I have put more thought and more detailed performance analysing. I have also worked on coding in parallel to documenting.
I will be submitting the document soon.

2. I have installed multiple Web Feature Services, Databases and Naradabrokering nodes on gridfarm machines from gf12 to 19. I have redone all the tests given before in Chapter 1.3.2 in the document mentined in 1. Since they are machines of much better performance than the gf-1 to 8 machines, I got really good performance results.

3. I have developed a new algorithm for assigning the worker nodes for parallel processing. The partitiones coming from the query decomposition are assigned to the worker nodes in round-robin fashion.

According to algorithm:
PN: #of partitions
WN: #of worker nodes
share: base(PN/WN) :number of partition each worker node is supposed to get
rmg: WN-share : if there is no remaining coming from the devision it is 0.
first rmg #of WN are assigned share+1 number of partitions, and
remaining are assigned share number of partitions.