Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North

http://www.52north.org/wpsFOSS4G 2009

Geoprocessing in the Clouds

FOSS4G 2009

Bastian Schäffer52°North


Agenda

Cloud Computing SDI to Cloud Transition The 52North WPS in the Clouds


Cloud Computing


Cloud Hype


Characteristics

• Efficiency Resource Pooling

• Outtasking

• On-demand

no-long term contracts

• Scalability

• Cost


IaaS

PaaS

dSaaSSaaS


Technology

• Hardware Cluster

• Virtualization

• Grid Computing

• Application Framework

• etc.


IT investments & maintenance


Cloud Types


Provider

• Amazon Web Services– Virtual (Machine) Computing Environment– Simple Storage Service (Amazon S3), SimpleDB,

Elastic Compute Cloud (Amazon EC2), Elastic MapReduce, etc.

– „0,10$ / hour“ for an running virtual system• Google App Engine

– Web applications written in Java and Python– Storage Service, Google Applications (Mail, Account)– „0,10$ / hour“ for real CPU usage

• Microsoft, Apple, SUN, IBM, Salesforce, etc.


Projects

• DMTF Open Cloud Standards Incubator

• The Open Cloud Consortium (OCC)

• Open Cirrus - Open Cloud Computing Research Testbed

• Open Cloud Manifesto


SDI to Cloud Transition


SDI to Cloud Transition

• CloudSDI vs. SDICloud


SDI concepts

• Technical / Service Perspective

SDI provides georesources through standardized interfaces over a service infrastructure


Processing (WPS)

Data Provision(WFS, WCS, SOS)

Portrayal (WMS)

Discovery (CSW)


IaaS

PaaS

dSaaSSaaS

Processing (WPS)

Data Provision(WFS, WCS, SOS)

Portrayal (WMS)

Discovery (CSW)


Major Obstacles

• IT investments & maintenance

• Mass market

• Legally Binding Performance



• High investments

<hardware, software, humans>

(for seldomly used tasks)outtasking & on demand use

e.g. Taiwan Debris Flow, French SDI Portal



time

requ

ests



time

requ

ests

20.000$



time

requ

ests

20.000$

40.000$



time

requ

ests

20.000$

40.000$

80.000$

Taifun?



time

requ

ests

20.000$

40.000$

80.000$

120.000$


Mass market

• Mass Market Application many requestsScaleability


Mass market


Legally Binding Performance

• INSPIRE– Search Queries

• Maximum 3 sec response time*

• Handle 30 parallel requests per second

– Image Download• Maximum 5 sec response time*

• Handle 20 parallel requests per second

– Overall 99% service availability (362 days/year uptime)

* During normal traffic (90% of uptime).


SDI Role Model


publish

publish

find

bind

bind

Georesource owner/provider

Georesource owner/provider

Publish-Find-Bind


publishpublishfind

bind

bindGeoresource owner

Georesource owner

Georesource provider



The 52°North WPS in the Clouds


WPS 101

What is a WPS?

Web Based Processing

WPS

WPS


SDI Integration

• Processing


SDI Integration

• Processing Service


Amazon EC2


Amazon EC2

MasterImage„ami“

CloudWatch

AutoScale


Amazon EC2

SaaS

PaaS

IaaS


Amazon EC2


Google Apps Engine


Google Apps Engine

101010010101


Google Apps Engine


Conclusion


Conclusion

• SDI services can be deployed in cloud environments Change in role model (P-F-B)


publishpublishfind

bind

bindGeoresource owner

Georesource owner




Conclusion

• Google Cloud easy to use good for light-weight applicationGood integration with other google apps

• Amazon cloudMore complicated to useFull-scale solutionFlexible

Scaleability provided


Conclusion

• External Interoperability (Open Standards)

• NO internal interoperabilityVendor lock-in

Proposal:


Abstraction Layer

Abstraction Layer

SaaS


Abstraction Layer

Abstraction Layer

Geospatial Layerin the cloud

SaaSPaaS


Conclusion

Future:

Impact on GIS Business Models– Selling of full GIS packages SaaS


Thank You

[email protected]

Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North

Documents

Transcript of Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North