FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

70
Mapserver technology supports the Data Warehouse of Actions and Investments of the Brazilian Ministry for Social Development and Fight Against Hunger FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006 Ministry of Social Development and Fight Against Hunger MDS

description

M inistry of Social Development and Fight Against Hunger MDS. Mapserver technology supports the Data Warehouse of Actions and Investments of the Brazilian Ministry for Social Development and Fight Against Hunger. FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima - PowerPoint PPT Presentation

Transcript of FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Page 1: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Mapserver technology supports the Data Warehouse of Actions and Investments of

the Brazilian Ministry for Social Development and Fight Against Hunger

FOSS4G2006 - Free And Open Source Software for Geoinformatics

Caio Nakashima

September - 2006

Ministry of Social Development and Fight Against Hunger

MDS

Page 2: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima2

Agenda

Introduction to the Problems

Chosen path

Developed products

Used Technologies

Details of the solutions

Future

Page 3: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima3

MDS Current Scenario

MDS is an almagamation of previous separated MinistriesLow interoperabilityMany stakeholders (banks, federation members, partners)Formal Links (by law, contracts, agreements)Need for na agile information to the publicDifferent paradigms (concepts, modus operandi)

Page 4: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima4

SAGI

Scenario: Organizacional Aspects (Aspecto Organizacional)

SENARC

CEF

SNAS

DATAPREV

IBGE

TSE

SESAN

CONAB ASA

SAIP

NI

NI NI

NI

NI

SECEX-SecAdj-Gabinete

CGI

CIf

Cadunico

Page 5: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima5

Social Information Matrix DATA FLOW

SIG SAGI

(M&A)

SIG SENARC

SIG SNAS

SIG SESAN

SIG SAIP

DW

SAGI

Social

MI

Gabinete

Sec Exec.

Page 6: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima6

Information Arquitecture

Beneficiary

Territory

Social Programs

B

P

T

P

P1

P2

Pn

T

B

Program: xxxxx

B1 nnnnnnnn add

B2 nnnnnnnn add

.............................

Bn nnnnnnnnn add

Page 7: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima7

Subsystem Integration

Beneficiary

Territory

Social Programs

B

P

T

P

P1

P2

Pn

T

B

Program: xxxxx

B1 nnnnnnnn add

B2 nnnnnnnn add

.............................

Bn nnnnnnnnn add

SOCIAL DATA

DICTIONARY

Page 8: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima8

Benefits

Reduced response time to queries from hours and days to minutes and seconds

Information access comprehensive to the whole MDS

Extracting Business Intelligence to help programs Managers

Recording the historical data from the programs

Registering knowledge to be used as information source

Page 9: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima9

Introduction to the Problems

The managers of the institution Ministry, Secretaries, Directors Majors, Congress people, Senators, Governors Press, Civil Society

The need for information from MDS (Ministry of Social Development and Fight Against Hunger)

About Social Programs, Beneficiaries, Investments, and so on.

Page 10: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima10

Problems

There was not a solid information structure

Each department manage their own data, in their own way.

There was not a regular information flow between those departments.

The urgently need for management reports.

Page 11: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima11

Scenario

Spreadsheet

DATAPREV

CONAB

TRE

Tesouro NacionalCaixa Econômica

Federal

REPORTS

PNUDIBGE

Page 12: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima12

Chosen path

After much pressure and work in manual reports.

We developed a private data warehouse only for internal use.

External Help Secretaries Support

Barriers Pressure against changes

Page 13: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima13

Social Information Data Warehouse

Allows to retrieve information about the investments on Social Programs in each city.

With the following dimensions: Search Items Geographic Units

Territorial Limits Population IDH (Human Development Index)

Time

Page 14: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

First Screen

Page 15: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima15

Select the desired period

Page 16: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima16

Select the variable and Indicators

Page 17: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima17

Select the territory and other filter as Population and HDI

Page 18: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima18

Result in spreadsheet form

Page 19: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima19

Result in card form.Each card per municipality

Page 20: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima20

Another Way to Search Data

Viewing data through social program

Georeferenced Data

Graphics

Page 21: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Bolsa Família coverage

Page 22: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima22

Page 23: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima23

Map Viewer Structure

Viewing Area(variable)

Title (variable)

Analysis Time (variable)

Title (variable)

Legend(variable)

Number of registers(variable)

Functionalities (invariable)

Page 24: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Selection of a special area of some social program (Bolsa Familia Program in the

area of Sao Francisco River)

Page 25: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima25

Page 26: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Some features of Map Engine

Page 27: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima27

Legend and Layer Control

Alow change the Interval

Turn on or Turn off the Interval

The Color of the Interval

Page 28: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima28

Example of some changes

Page 29: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima29

Page 30: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

The Color Pallete

Page 31: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima31

The Color Pallet

Map Color

Border Color

Label Color

Page 32: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima32

Page 33: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima33

Page 34: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Retrieve Spatial Information

Page 35: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima35

Box to bound the search

Page 36: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima36

Search Result

Show the selected geographic area All geographic regions that touch or are inside the

boundaries of the box.

It will open a window with all chosen geographic regions with: The values used to build the map. Link to details of the geographic information. Link to graphic when applied Link to find the location of the region in map.

Page 37: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima37

Page 38: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Search through the map

Page 39: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima39

Page 40: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima40

Result of the search through the map

The chosen region is highlighted It will open a link for the detail of the selected geographic region.Link for the graphics, where they show the evolution of the variable or indicator presented along the time.The values of the variable or indicator of all cities on the borders of the chosen geographic area.

Page 41: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Analysis through graphics

Example: Values of the financial help and the amount of beneficiaries

through the time of Bolsa Família

Page 42: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima42

List of all values that represented in map

Page 43: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima43

Amount of financialhelp.

Amount of families(beneficiaries) ofBolsa Familia

Page 44: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima44

Graphic of financial help foreach family

Combination of two graphics

Page 45: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima45

Comparing two or more geographic areas

This feature allows a comparative analysis between up to three geographic regions.

The selection can be done through geographic bound or close analysis values.

Page 46: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima46

Comparing the amount of financial help

Page 47: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima47

Comparing the financial help for each family

Page 48: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima48

HistogramFinancial Value Transferred to the cities of Bolsa Familia Program

Page 49: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima49

Histogram

Mean value transferred to each family of Bolsa Familia Program in august 2006.

Page 50: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima50

Pen Parade Graphic

Financial Value Transferred to the cities.

Graphic of 100% of the distribution

Page 51: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima51

Pen Parade Graphic

Financial Value Transferred to the cities.

Graphic of 90% of the distribution

Page 52: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima52

System Integration

From Georeferenced view is possible to access other information about cities in the data warehouse.

Example PETI Bolsa – Financial Help for the Cities in

October 2005. PETI – Program Against Child Labour

Page 53: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima53

Page 54: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima54

Page 55: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima55

Page 56: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima56

Data Source, Social Program

Variable or Indicator Choice

Period Choice

Data Searcher

Knowledge Base

Information OrganizerMap

Viewer Engine

User Interaction

Structure of the Solution

Page 57: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima57

Ways to feed the map engine

Build the query manually.

Read the structure of data from database and show the result of the query in a map.

User can build the query from available data in data warehouse.

Page 58: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima58

Map Engine Configuration

<? /****************************************************************************** Database conection *******************************************************************************/ // IBM Server $mapas_host = "10.68.12.245"; $mapas_port = "5432"; $mapas_dbname = "MI_2005_2006"; $mapas_user = "username"; $mapas_password = "password"; /****************************************************************************** Files path *******************************************************************************/ $mapas_imagePath = "/dados/guilherme/www/projetoMZ/tmp_img/"; $mapas_url = "tmp_img/"; $mapas_ajaxURL = "/mi/projetoMZ/ajaxBusca.php";?>

Page 59: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima59

Data Base of the Solution

Shape Files

DataSocial Programs

Data

Configuration

Files

Data Warehouse Viewer

Social Table

Information Request

SQL Text

Social Program

Table

Page 60: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima60

Data Base of the Solution

Shape Files

DataSocial Programs

Data

Configuration

Files

Information Request

Social Map Viewer

Engine

SQL Spatial

Social Program Table

and Spatial Table

Page 61: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima61

Data Base of the Solution

Shape Files

DataSocial Programs

Data

Configuration

Files

Data Warehouse Viewer

Social Table

Information Request

SQL Text

Social Program

Table

Social Map Viewer

Engine

SQL Spatial

Social Program Table

and Spatial Table

Page 62: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima62

Build the Query Manually

Page 63: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima63

Read the structure of data

Page 64: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima64

Page 65: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima65

User building the query

Page 66: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

Used Technologies

Page 67: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima67

PostGreSQLPostGis

Aplication ServerApache (WEB Server)

PHP (4.x)MN MapserverPHP MapScript

ClientBrowser

IExplorer, Firefox, Mozilla

Jbox (Java)JavaScript

Technologies

Page 68: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima68

Development

Browser used for the tests IExplorer and FireFox.

It is required the installation of Java Virtual Machine in the client browser. JBox requires JVM.

Development Language PHP 4.x PHP MapScript until 2005 June was not compiled to PHP

version 5

MN MapServer does not require PHP MapScript It was used to give more flexibility to the application.

Page 69: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima69

Future tasks

Tuning the database retrieve time for each queries.

Create new user maps

Develop a Graphic Interface to insert new maps

Improve the user interface

CD with the solutio

Page 70: FOSS4G2006 - Free And Open Source Software for Geoinformatics Caio Nakashima September - 2006

September 2006 Caio Nakashima70

Questions

Thank You Very Much

Caio Nakashima [email protected] [email protected] www.mds.gov.br

Staff Caio Nakashima (Map Viewer) Carlos Eduardo de Andrade Brasileiro (DBA) Marcelo Gomes Gadelha (Data Warehouse Viewer)