Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the...

27
Usage of Open Source GIS Software in the Usage of Open Source GIS Software in the Public Sector: Possibility and Public Sector: Possibility and Irrationality? Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS software? Sr Dr Zainal Bin A Majeed Sr Dr Zainal Bin A Majeed JUPEM JUPEM

Transcript of Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the...

Page 1: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Usage of Open Source GIS Software in the Public Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality?Sector: Possibility and Irrationality?

Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS software?

Sr Dr Zainal Bin A MajeedSr Dr Zainal Bin A MajeedJUPEMJUPEM

Page 2: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

CONTENTCONTENT

Page 3: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

What is open source GIS software?What is open source GIS software?

OSS – it’s free but does not mean free of charge, use freely OSS GIS is freely available software that can be used to

manage and create system development for geospatial data It is a free geospatial data open source software for

developing a GIS Available to develop a web based GIS application that

supports data request, retrieval, integration and presentation.

Free to use, copy, study, change and improve, and even distribute them freely

FOSS4G : Free Open Source Software for Geo-SpatialFOSS4G : Free Open Source Software for Geo-Spatial

GeoFOSS : Geo Free Open Source SoftwareGeoFOSS : Geo Free Open Source Software

Page 4: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

OSS FreedomsOSS Freedoms Freedom of UseFreedom of Use Freedom of SoftwareFreedom of Software Freedom of RedistributeFreedom of Redistribute Freedom of ModifyFreedom of Modify Freedom of CopyFreedom of Copy

Open Source SW Criteria by OSI (Open Source Initiative)

1. Free Redistribution1. Free Redistribution

2. Source Code2. Source Code

3. Derived Works3. Derived Works

4. Integrity of The Author's Source Code4. Integrity of The Author's Source Code

5. No Discrimination Against Persons or Groups5. No Discrimination Against Persons or Groups

6. No Discrimination Against Fields of Endeavor6. No Discrimination Against Fields of Endeavor

7. Distribution of License7. Distribution of License

8. License Must Not Be Specific to a Product8. License Must Not Be Specific to a Product

9. License Must Not Restrict Other Software9. License Must Not Restrict Other Software

10. License Must Be Technology-Neutral10. License Must Be Technology-Neutral

Page 5: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

FOSS4G as Substitute for Proprietary Software

ArcReader - viewing - uDig, GRASS, gvSIG, QGIS, OSSIM

ArcMap/ArcGIS – cartography - uDig, GRASS, gvSIG, QGIS, OSSIM

ArcINFO/ArcGRID – analysis - GRASS, OSSIM, SEXTANTE

ArcPad – devices - gvSIG mobile

ArcSDE – database - PostGIS

ArcIMS – web - Mapserver, GeoServer

ArcGIS Server – spatial server - GRASS, SEXTANTE

VB, Python – scripting - PHP, Python, Perl, C#.net, etc… (From Shin, Sanghee([email protected] )

Open Source GIS?Open Source GIS?

Page 6: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

OSS GIS local trendsOSS GIS local trends

Organisations begin to use OSS GIS from vendor who Organisations begin to use OSS GIS from vendor who do not use inherent and commercialised software do not use inherent and commercialised software

Many organisations in the public sector are Many organisations in the public sector are interested in commercialised GIS software which interested in commercialised GIS software which come with training and hands-on development by come with training and hands-on development by vendors (but expensive)vendors (but expensive)

The agony of using OSS GIS is affecting utmost The agony of using OSS GIS is affecting utmost mentalitymentality

Local authority are lacking of fund to spend RM10K Local authority are lacking of fund to spend RM10K to RM30K for vendor software, with no support but to RM30K for vendor software, with no support but ask to buy new versionask to buy new version

Small organisations require cheap, freely Small organisations require cheap, freely available, ease of support from OSS communityavailable, ease of support from OSS community

Page 7: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

OSS GIS local trendsOSS GIS local trends

Support from policy makers and management to use Support from policy makers and management to use OSS GIS is not goodOSS GIS is not good

Not many use OSS GIS within the desktop Not many use OSS GIS within the desktop environment. The approach may save government environment. The approach may save government allocation, either to do mapping and to develop GIS allocation, either to do mapping and to develop GIS within the organisation. within the organisation.

RM30K-60K vendor specific software were not fully RM30K-60K vendor specific software were not fully utilised in an overarching benefits utilised in an overarching benefits

Bugs and fault in the developed system tend to Bugs and fault in the developed system tend to demoralise the ideas. demoralise the ideas.

Installation, configuration and configuration are Installation, configuration and configuration are sometime problematicsometime problematic

Human capital are not fully ready to embark in this Human capital are not fully ready to embark in this genius notion and approachgenius notion and approach

Page 8: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Test Case of OSGIS Development Test Case of OSGIS Development for Possibility of Usage in for Possibility of Usage in Government OrganisationGovernment Organisation

Page 9: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

ObjectivesObjectives

To investigate the current open source software, standards, protocols To investigate the current open source software, standards, protocols and technologies capable of resolving the issue of data integration and and technologies capable of resolving the issue of data integration and dissemination.dissemination.

To investigate and test existing open geospatial web service e.g. To investigate and test existing open geospatial web service e.g. Minnesota WMS.Minnesota WMS.

To use GML for vector online data format.To use GML for vector online data format. To implement WFS for GML server to serve GML online.To implement WFS for GML server to serve GML online. To design a common To design a common ad hocad hoc database for data import/export in order database for data import/export in order

to manage the data before disseminationto manage the data before dissemination To develop intelligent middleware capable to get the user requests for To develop intelligent middleware capable to get the user requests for

query vector/raster data query vector/raster data To develop a web based GIS application that supports data request, To develop a web based GIS application that supports data request,

retrieval, integration and presentation.retrieval, integration and presentation.

Page 10: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

MethodologiesMethodologies A simple development of a web based GIS through A simple development of a web based GIS through

the construction of a 3-tier web service architecture, the construction of a 3-tier web service architecture, comprising a comprising a clientclient, , middlewaremiddleware and and server, as server, as followsfollows

Server – In order to serve raster and vector Server – In order to serve raster and vector geospatial data from multiple sources via the web we geospatial data from multiple sources via the web we have implemented the OGC WMS and WFS have implemented the OGC WMS and WFS specificationsspecifications

Middleware – The middleware enables the application Middleware – The middleware enables the application to retrieve the geospatial data from different serversto retrieve the geospatial data from different servers

Client – A client map viewer developed to render the Client – A client map viewer developed to render the data requested by the servlet. data requested by the servlet.

Page 11: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Geospatial data usedGeospatial data used

Cadastral data or land parcel data handled by the Cadastral data or land parcel data handled by the JUPEM states ( in local coordinate system)JUPEM states ( in local coordinate system)

Topographical mapping data developed in JUPEM (real Topographical mapping data developed in JUPEM (real world coordinates)world coordinates)

Aerial/Orthophoto images produced in JUPEM (real Aerial/Orthophoto images produced in JUPEM (real world coordinates)world coordinates)

Test area in the Wilayah Persekutuan Kuala LumpurTest area in the Wilayah Persekutuan Kuala Lumpur Data preparation involved tasks on image processing, Data preparation involved tasks on image processing,

vector data conversion and coordinates vector data conversion and coordinates transformation.transformation.

Data is prepared and integrated into one single viewData is prepared and integrated into one single view

Page 12: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The topographical data overlayed an The topographical data overlayed an aerial images of the test areaaerial images of the test area

Page 13: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The cadastral data overlayed on an aerial The cadastral data overlayed on an aerial images of the test area.images of the test area.

Page 14: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

polygonlinecoord

areachainpoint

ring

rwo

Spatial Relational Database (SRDB)Spatial Relational Database (SRDB) was utilised as an was utilised as an ad hocad hoc database database

Logical database model of SRDB Logical database model of SRDB

Page 15: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

<RealWorldFeature name="shop" desc="Shop"> <MetaData> <Data name="dateCreated" detail="2002-12-22"/> <Data name="numberFeatures" detail="1"/> </MetaData> <Properties> <Property name="gpoint" type="POINT_GEOM"/> <Property name="name" type="CHAR"/> </Properties> <Feature fid="1"> <gml:location> <gml:Point> <gml:coord> <gml:X>543761.3125</gml:X><gml:Y>263694.71875</gml:Y> </gml:coord> </gml:Point> </gml:location> <name type="CHAR">shop1</name> </Feature> ...</RealWorldFeature>

Implementing Feature Schema for Use with GML

Page 16: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Developing the Web Geospatial ServerDeveloping the Web Geospatial Server

Map of WP Kuala LumpurMap of WP Kuala Lumpur

WFS – GML server

WMS – freeware Mapserver

The administrative area of WPKL through GML server and Image Map ServerThe administrative area of WPKL through GML server and Image Map Server

Page 17: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Developing Middleware for the Geospatial Data ConnectorDeveloping Middleware for the Geospatial Data Connector

Internet

Http/ApplicationServer

raster/vector/projectrequest

GeoConnector

requestedobject

user request

requested objects

Server A

Server B

Server xxx

Project

Clients

ProjectProject

Internet

Internet

Shapefiles SRDBs

- get the user request through the CGI protocol;- get the user request through the CGI protocol;- connect to other data server and retrieve the data via - connect to other data server and retrieve the data via HTTP protocol as user required;HTTP protocol as user required;- integrate the requested data and generate the final - integrate the requested data and generate the final integrated objects;integrated objects;- deliver the required objects back to the client - deliver the required objects back to the client application.application.

Page 18: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The project request is encoded using XML

The sample of project is illustrated as follows.<project xmlns="http://jukn.gov.my/webgis/scn/"> <box minx="402250" miny="345972.47" maxx="408970.0" maxy="352473.62"/> <rwo_dataset>

<dataset protocol="http" type="gml" name="hospital_clinic" address= "http://survey1.org/wfs?VERSION=1.0.0&amp;SERVICE=wfs&amp; REQUEST=getFeature&amp;LAYERS=KL.hosp_clinic"/> <dataset protocol="http" type="gml" name="gov_office" address= "http://survey2.org/data/gov_office.gml"/> <dataset protocol="http" type="gml" name="education" address= "http://survey3.org/ducation.gml"/> <dataset protocol="http" type="image" name="canal" address= "http://survey4.org/wms?VERSION=1.0.0&amp;SERVICE=wfs&amp; REQUEST=getFeature&amp;LAYERS=KL.canel"/> <dataset protocol="file" type="image" name="river" address="river.png"/> </rwo_dataset></project>

Page 19: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Developing the Web Based GISDeveloping the Web Based GIS

The application GUIThe application GUI

Page 20: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Local and HTTP data open dialogLocal and HTTP data open dialog

Page 21: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The rendering toolThe rendering tool

Page 22: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The sample of project in Kuala Lumpur areaThe sample of project in Kuala Lumpur area

Page 23: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

The zoom-in area that contains lot parcel, topographical data and digital aerial photograph

Page 24: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

ResultsResults

This test case has achieved the objectives of implementing and This test case has achieved the objectives of implementing and utilising existing open source geospatial standards and utilising existing open source geospatial standards and technologies, e.g. OGC standards and specification (GML, WFS, technologies, e.g. OGC standards and specification (GML, WFS, WMS), HTTP, CGI, XML and RDB, to overcome the issue of data WMS), HTTP, CGI, XML and RDB, to overcome the issue of data integration and dissemination from multiple heterogeneous integration and dissemination from multiple heterogeneous systemssystems

The application has clearly shown the successes of the concept of The application has clearly shown the successes of the concept of data integration on-the-fly from multiple heterogeneous GIS data integration on-the-fly from multiple heterogeneous GIS servers which supply the spatial web service. The SRDB was servers which supply the spatial web service. The SRDB was implemented and utilised to enable the construction of an implemented and utilised to enable the construction of an ad hocad hoc database capable of providing a solution to some of the issues of database capable of providing a solution to some of the issues of data proprietary data proprietary

Page 25: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Way Way ForwardForward

Page 26: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

• OSSs are not freeware but much cheaper to OSSs are not freeware but much cheaper to develop, neither there are free of chargedevelop, neither there are free of charge

• Free to use, copy, study, change and improve, and Free to use, copy, study, change and improve, and even distribute them freelyeven distribute them freely

• Data integration through open source, Data integration through open source, standard and protocols and technologies is standard and protocols and technologies is possible (test case outcome)possible (test case outcome)

• Open source software and standard is Open source software and standard is significant to safe allocation, for significant to safe allocation, for interoperable system and integrated GIS interoperable system and integrated GIS datadata

• A small to medium to large scale authority A small to medium to large scale authority organisation capable with low cost to organisation capable with low cost to develop OS GISdevelop OS GIS

• Executive direction is crucial as OSSs are Executive direction is crucial as OSSs are the available, free and cheap software the available, free and cheap software development widely used nowadaysdevelopment widely used nowadays

• OSS GIS is possible in the public sector OSS GIS is possible in the public sector and can be are rationally proposed as one and can be are rationally proposed as one of any transformation programof any transformation program

CONCLUSIONCONCLUSION

Page 27: Usage of Open Source GIS Software in the Public Sector: Possibility and Irrationality? Is the GEO-ENABLED GOVERNMENT anxious about USING OPEN SOURCE GIS.

Thank you for listening