Post on 29-Dec-2015
Central Geological Survey (CGS), MOEA
Vito, KoGAIAS GIS Consultant Co., Ltd.
2009/1/23
集水區地形及地質資料庫建置計畫
資料庫系統 野外調查系統
資料庫維運管理(詳見第二節)
成果資料查詢系統建置(詳見第三節)
整合性野外調查電子表單系統建置(詳見第四節)
外業PDA填表與資料同步管理系統建置(詳見第五節)
應用系統教育訓練(詳見第六節)
Geological Map Database Development and Integrated Supply System Implement Program - Geological Data Warehouse Improvement Project(2/5 )
1.Introduction to project2. Data Warehouse System3.Comments on Previous Project4.Methodology and Procedures5.Progress and Manpower6.Expected Results7.Budget Allocation
2
Outline
Secondary-year work of NGIS Spatial Data Infrastructure Plan in Phase 3 (2008-2012)
Goals: Use advanced spatial information and
information management technology to expand the original data warehouse system
Digitize CGS geological data and improve processes of establishing databases and quality of data
Build up a framework for National Geological Data Service System
Assistance to CGS and other government agencies to use GIS geological data
Enhance government’s administrative efficiency and decision making to better integration and supply of NGIS
3
.Introduction to project
Introduction
Geological Data Warehouse System
4
Geological data exchange
Data inquiry and one-stop service system
Integration of databases
Digitization of field-surveyed
geological data
Data analysis
Physical environment Promotion and customer service
Geological Data Warehouse
Connection with service components
5
資料建置
資料管理
資料品質
資料查詢
資料流通
地質調查電子表單 Geo-tag 現地照片
Geo-tag 地質文件/ Geo-tag Hyperlink
簡易版詮釋資料建檔(PDF)
完整版詮釋資料建檔
收納檔案資料庫
(ORACLE)
調查成果資料庫
開放式XML資料庫
自動化合理性檢核
人工檢核
問題與回報管控系統
Tile加速2D平台地質整合查詢系統
WMS WFS FTP SQL WS
上架 申請 審核 下載
資料數化建檔
Google 3D平台地質整合查詢系統
Database establishment
Data Transfer/Circulation
DataInquiry
DataQA/QC
Datamanagement
Basic geological datacollecting systemFree GIS + PDF
E-forms for field survey data
Geo-tag Photos
Geo-tag text/file Geo-tag Hyperlink
Data digitization
Metadata(PDF version)Metadata
unabridged version)
Database
Open-GIS Database(ORACLE)
Database(survey results)
Open-XML Database
QC(automatic)
Problems & reporting control system
QC(manual)
Tile-acceleration 2D platformgeological data integrated
inquiry system
Google 3D platformgeological data integrated
inquiry system
SQLWMS WFSSOAWS
FTP
DownloadUpload ApplicationExamination
On-line Supply
Functions ofData Warehouse System
Concept of Data Warehouse
6
Basic Geological Database
Basic Geological Database
Regional Geology division
Database
Regional Geology division
Database
Structural Geology division
Database
Structural Geology division
Database
Environmentaland Engineering
Geology division Database
GeologicalResource division Database
Geological Knowledge
Website
Geological KnowledgeWeb-service
Environmentaland Engineering
Geology division Database
Core System
(internal service)
GeologicalResource division Database
Warehouse System
(external service)
Core System
SOA
WFS
WMS
SOA
Integrated Inquiry System
(Warehouse System)
Data Framework ofData Warehouse System
Concept of Data Warehouse
地調所防火牆
地調所高速區域網路
基本地質資料庫/各主題資料庫
外接儲存媒體
服務、主機偵測系統
異常警訊
網路流量監測主機
倉儲系統
弱點掃描主機
身分認證服務
網路負載平衡
網際網路各國土資訊系統加盟節點
暨相關網路服務節點
各單位防火牆
網際網路服務信任
一般使用者
應用服務主機1應用服務主機2
7
Hardware Framework of Data Warehouse System
Concept of Data Warehouse
General user
Web portals and service websites of NGIS
Firewalls of web portals &
websites
Internet traffic monitoring server
Warehouse SystemInternet service
C.G.S.Firewall
Detecting system
Abnormal conditions
Scanning server.
High-speed intranet of C.G.S.
External storage media
Basic Geological database
/thematic database
Server 1 for application service
Balanced web load
User identification
Server 2 fro application service
internet
8Planning of Project
Work Schedule for each Year
2008 2009 2010 2011 20121. Standards of Geological Data Formats
1.1Draft standards of basic geological data formats ---------
-
1.2Modification of CGS data standards ----------
----------
1.3Modification of standards of geological data formats ---------
----------
-1.4CGS-required work on standards of geological data formats
----------
----------
----------
----------
----------
2. Geological Data Warehouse System
2.1 Improvement in system framework ---------
-
2.2 Establishment of distributed databases ---------
----------
----------
-
2.3 One-stop web portal of geological data service ---------
----------
----------
- 2.4 Diversification of functions for different user groups
----------
----------
----------
2.5 On-line data analysis ----------
----------
2.6 Mechanism for data exchange ----------
----------
----------
2.7 Analysis of users’ using data ----------
----------
----------
2.8 Establishment of 3D geological databases ----------
----------
----------
2.9 Establishment of temporal geological databases ----------
----------
2.10 CGS-required work on geological data warehouse system
----------
----------
----------
----------
----------
3. Data Collection for Geological Maps
3.1 Establishment of mobile survey systems ----------
----------
3.2 Digitizing and updating of geological maps ---------
----------
----------
----------
----------
-
3.3 CGS-requires work ---------
----------
----------
----------
----------
-4. Supply of Geological Data
4.1 Establishment of a mechanism for automatically updating geological maps
----------
----------
4.2 Establishment of an SOA mechanism ---------
----------
----------
- 4.3 Establishment of a system to deliver geological information ---------
----------
----------
-
4.4 CGS-required work ---------
----------
----------
----------
----------
-5. NGIS Promotion and Customer Service
5.1 Participation in related promotional activities ---------
----------
----------
----------
----------
-
5.2 Publication of R&D results ---------
----------
----------
----------
----------
-
5.3 Posters and advertising printed materials---------
----------
----------
----------
----------
-
5.4 CGS-required work ---------
----------
----------
----------
----------
-6. Establishment of Physical Environment for Spatial Information
6.1 Planning ---------
-
6.2 Establishment ----------
6.3 Planning for expanding the physical environment ----------
----------
6.4 Expansion of the physical environment ----------
----------
----------
6.5 CGS-required work---------
----------
----------
----------
----------
-
Work Done in 2008
6 categories of work 22 items 55 sub-items 5 standards of geological data(drafts) 94 modules of service parts 300 WMS-related releases Digitization of 2 digital geological maps 3 exhibitions or seminars 3 papers 4 types of training 1 back-up server
9
10
5
4 3
2
16
.Methodology and Procedures
NGIS promotion and customer service
Establishment of
geological data supply
system
Expansion of integrated geological data warehouse system
Specification (or modification) of standards of geological data formats
Geological database management and updating
Establishment of physical environment for spatial information
Standard
System
Data
Promotion
Methodology and Procedures
1
Standards of Geological Data (Draft, 2009-2010)
Standards of Taiwan Stratigraphic names and usage (2009)
Digital Codes for Stratigraphy and Standards of Geological Map Legends (Draft, 2009)
Quality Control Standards for Geological Map Data (Draft, 2009-2010)
11
Specification (or Modification) of Standards of Geological Data Formats
Methodology and Procedures
Modification of standards of basic geological data (2008 v., draft)
Gaps between digital geological data and existing printed maps
Elimination of the gaps through establishing consistent standards of data formats
Standards and criteria for quality control of digital geological data
12Methodology and Procedures
Problems in Geological Maps
1. Existing Printed Geological Maps1) The same stratigraphic units are represented
in different legends(texture pattern ) on different area sheets
2) Contempary stratigraphic units are shown in different colors on different area sheets
3) Texture pattern representing a stratigraphic unit does not conform with lithology
4) The same stratigraphic unit has different names or codes on different area sheets
5) There is different spelling of English names for the same stratigraphic units
13Methodology and Procedures
14
Problems in Printed Geological Maps
Methodology and Procedures
Dayuan
TaoyuanChungliHsinchu
Linko BiSaTung
Miliao
Dayuan
TonShe NantoTaoyuan Miliao
Sand Dune
Area sheet
Stratigraphy
Area sheet
Stratigraphy
Chungli Formation
Jinshuei Shale
Area sheet
Stratigraphy
Problems in Geological Maps
2. Digital Geological Map1) Inconsistent map formats and data between digital
and existing printed geological maps2) Classified coding of digital data is not based on
a hierarchy of stratigraphic units 3) Textural patterns of stratigraphic units on
digital maps do not conform with conventional ones
4) Formats of digital geological data need to be standardized
15Methodology and Procedures
Legends of stratigraphic units do not conform with conventional ones for sedimentary rock type, e.g. the legend color of Shebachungci Formation is not conventional (yellowish is better than reddish), the code is not appropriate and there is not English abbreviation
16Methodology and Procedures
Current Standards of Digital Geological Data
Shebachungci Formation
Fig.ZA2BalewanFormation(Conglomerate)
Shuelian Conglomerate(Member)
Fig.C48
Fig.Z002
17Methodology and Procedures
Solutions 1. Based on fundamental principles of geology 2. Based on USGS standards system used by
system used by
Fundamental principles and application of geology
18Methodology and Procedures
Specification of Standards and Practice
Application
Practice
Design
Rationale
Stratigraphic legends
Stratigraphic coding
Practice of designing legends
Practice of designing codes
Prsentation of Stratigraphic data
design of stratigraphic database
Standard of basic geological data
Standard of geological map data
Standard of stratigraphic name and usage
Standard of digital stratigraphic codes and legends
Practice of Geological Map
QA/QC
Transform and circulation
refer
Down
Top
19Methodology and ProceduresAmendment of geological data standard
Flow chart of Geological Data StandardP
osit
ion
of
Sta
nd
ard
s
Modification of standards of the basic geological data (draft) assistance in modification
Standards of geological map data (draft) 1. The same map formats for printed and digital maps2. Set up basic geological database3. Complete standards of geological map data
Standards of Taiwan stratigraphic names and usage(draft)
1. Collect Taiwan stratigraphic names and examine scales and difference in classification of formations2. Standardize stratigraphic names, abbreviation, usage as well as legends3. Standards of Taiwan stratigraphic names and usage(draft)
20Methodology and Procedures
Goals for Modification of Standards in 2009
Digital codes for stratigraphy and standards of legends(draft)
1. Design a coding system for stratigraphic names at different scales as well as standard legends
2. Compile codes of Taiwan digital stratigraphic units and standards of legends(draft)
Standards of quality control for geological map data(draft)
1. Digital geological maps: Data formats should conform to the standards of ISO19113, ISO19114 and ISO19138 as well as those of ISO19139 or TWSMP1.0v
2. Geological data : Specify QA/QC criteria based on spatial characteristics of geological data (draft)
21
ISO 19113:2002 - Geographic information -- Quality principlesISO 19114:2003 - Geographic information -- Quality evaluation proceduresISO 19138:2006 - Geographic information -- Data quality measuresISO 19139:2007 - Geographic information -- Metadata -- XML schema implementationMethodology and Procedures
Goals for Modification of Standards in 2009
2
1. Collection, establishment and updating of geological map data(1)Establish 1/50000 regional geological profiles in KML interface and web pages(2)Set up a production system for vector KML(3)Fast production of image files(4)Quick processing of 1/25,000 topographic maps about Taiwan(5)Integrate electronic map data provided by I.O.T., MOTC with the platform (6)Complete digitization of geological map data in two months after CGS publishes regional geological map data(7)Integrate monitoring of map data service with the platform and set up a delivery system of WMS
2.Surveys for map data and establishment of metadata (1)In line with MOI announcement of WSMP, integrate MOI web version of metadata with warehouse system(2)Set up and publish metadata in compliance with ISO 19139 standards
3.QA/QC of map data (1)Set up a mechanism for disposing of platform problems(2)expand the QA mechanism for map data input
22
Establishment, Management and Updating
of Geological Map Data
Establishment, Management and Updating
of Geological Map Data Methodology and Procedures
Purpose 3D Presentation of geological profiles
Development of Service Component Modules Module for map data input to spatial
databases Module for positioning geological profiles Module for inquiry about geological profiles Module for displaying information on
geological profiles
23
Establishment, Management and Updating
of Geological Map Data Methodology and Procedures
Establishment of Production and Inquiry System of KML Geological Profiles
Purpose Production system of vector KML geological
maps which enables users to adjust legends
Development of Service Component Modules Module for map data input to spatial
databases Module for KML conversion of spatial
databases Module for setting KML legends Module for KMZ packaging
24
Establishment, Management and Updating
of Geological Map Data Methodology and Procedures
Establishment of Production System of Vector KML
Purpose Instant display of maps from the platform
Development of Service Component Modules Module for map data input to spatial
databases Module for map data QA/QC Module for setting display of legends Module for examining overlap of the maps Module for mosaic of image files Module for fast production of map layers Module for quickly setting map layers Module for quickly saving map layers Module for instant display of map layers
25
Establishment, Management and Updating
of Geological Map Data Methodology and Procedures
Establishment of Fast Production System of Map Layers
XMLvector map
XMLimage map
Tiled BaseImage MapOpen spatial
databasesORACLE
PlatformImprovement in mapping
Block maps
2D MapViewer
Dynamicmaps
Pre-download
3D MapViewer
Purpose Enable users to overlay road
network layers and geological map layers
Development of Service Component Modules Module for map data input to
spatial databases Module for map data QA/QC Module for setting display of
legends Module for classification of
road systems Module for examining overlap
of maps
26
Establishment, Management and Updating
of Geological Map Data Methodology and Procedures
Integration of Electronic Map Data Provided by I.O.T., MOTC
integrate the electronic map data of I.O.T., MOTC with the platform