Post on 19-Jul-2015
Roundtable 5
Harnessing Innovation Opportunities fromOpen Data and Big Data
Co-Chairs:Roger Longhorn
Secretary-General, Global Spatial Data Infrastructure (GSDI) Association www.gsdi.org
Contact: rlonghorn@gsdi.org / ral@alum.mit.edu
Gabor Remetey-FülöppSecretary General, Hungarian Association for Geo-information (HUNAGI)
www.hunagi.huContact: gabor.remetey@gmail.com
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
QEEII Conference Center
London, 20 January 20151
Relevances from the keynotes
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference2
• Neil Thompson: Data availability is an issue: 60% vs 38% in previous year
• Jane Dickerson: Content, Context, Conveience, Consequences Principles of Robert Cardello (NGI). Flexible sharing, full interoperability, timely service and multi-national partnership– Stuart Blundel’ intervention (Exelis, based on ad hoc discussion with the next sittings): agencies
should not compete with private sector but leveraging their services
• Éric Laliberté: clear vision and strategy is prepequisite for successful implementation (the case of CSA)
• Dan Jablonsky (DigitalGlobe): set up some dedicated homeland security areas where also Open and Big Data play important role
• Robert B, Murett (INSCT): expanded range of sensors and data management are needed to handle the global commons: air, space, high seas and cyber. Challanges include how to get more with less, commin/data transfer, data sharing
• Craig Clarke: OSINT Impact of the social media: smart phones 2005 – 2014
• Anne Cathrine Frostrup (Kartverk) importance of availability, accessibility and usability of reliable geospatial data
Agenda
• Introduction
• Open Data Issues and Challenges
• Open Data Discussion – Key Issues
• Big Data Issues and Challenges
• Big Data Discussion – Key Issues
• Research needs and programmes
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
QEEII Conference Center
London, 20 January 20153
Introduction
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference4
• What is Open Data?Open Definition from the Open Knowledge Foundation:
– defines “openness” in relation to data and content,
– precisely defines “open” in the terms “open data” and “open
content”,
– ensures interoperability (shared access) between different
collections of open material.
“A piece of data or content is open if anyone is free to use, reuse,
and redistribute it — subject only, at most, to the requirement to
attribute and/or share-alike.”
http://opendefinition.org/okd/ http://okfn.org/
Introduction
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference5
• What Open Data definition covers?• Access
• Redistribution
• Reuse
• Absence of Technological Restriction
• Attribution
• Integrity
• No Discrimination Against Persons or Groups
• Distribution of License
• License Must Not Be Specific to a Package
• License Must http://opendefinition.org/okd/ http://okfn.org/
Open Data Policies
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference6
The G8 Open Data Charter
• Principle 1 – Open Data by default
• Principle 2: Quality and Quantity
• Principle 3: Usable by All
• Principle 4: Releasing Data for Improved Governance
• Principle 5: Releasing Data for Innovation
GEO/GEOSS Data Sharing Principles
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference7
• GEO – mandate for the 2nd decade to implement GEOSS, a global, coordinated, comprehensive and sustained System of Observation Systems providing information for the benefit of the society (9 dedicated Society Benefit Areas)
• Implementation requirement: setting up Data Sharing Principles– Recognizing Relevant International and National Policies and Legislation
• Data and Products (space based and in situ) at minimum time delay and minimum cost
• Free of Charge or Cost of reproduction for research and edu
Objective: improve coordination, avoid duplication, provide easier and more open data access, foster use, building capacity and identify gaps
Source: Douglas Cripe (PhD), Group on Earth Observations (GEO) Secretariat at IGIT2015, 16 January, 2015 Székesfehérvár, Hungary www.earthobservations.org
GSDI involvement in GEO activities
Integrated Geo-spatial Information and Interoperable Services supported by Global Spatial Data Infrastructure Association (GSDI) www.gsdi.org, www.igs.orgGSDI delegates since 2007 (FGDC, CIESIN, Esri, HUNAGI)active in
Data Sharig PrinciplesArchitecture and Data ComUser Interface ComGEO Common InfrastructurePlenariesMinisterial Summits (*)
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference
GSDI World ConferencelRotterdam CEOS WGISS
CODATA, GEO_OGC
(*) GSDI Statement toCape Town Declaration
GSDI Statement toAt GEO V Bucarest
GSDI contribution at GEO VIII Istanbul
GSDI Statementat GEO X Foz Do Iguazu
(*) GSDI Statementat GEO X Geneva
GSDI delegateat GEO IV 2007
GSDI delegateat GEO IX 2012
GSDI delegateat GEO VIII 2011
GSDI delegateat GEO VII 2010
GSDI delegateat GEO X 2014
GSDI delegateat GEO V 2008
(*) GSDI Statement at GEO VII Beijing
Regiona/cross borderlEURISY, DanubeRegStrategy
QEEII Conference Center
London, 20 January 2015
GSDI World ConferenceSingapore
GSDI World ConferenceQuebec City
GSDI World ConferenceAddis Ababa
The European Open Data Policy
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference9
Roberto Viola of DG Connect said in an interview to EUROGI in Ocober 2014
– It is anticipated, that the opportunity to innovate with GI will largerly increased thanks to the revision of PSI directive the legal cornerstone of the Open Data Initiative
– The new rules to be implemented by July 2015
– All the public data should become re-usable as default at no or much less costs
– Expected impact on the governmental agencies such as cadastre
The European Open Data Policy
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference10
Open data and its economic impacts
Authentic overview made by the representative of the DG CNECT Dr.Márta Nagy-Rothengass atOpen Data Open Source for GI Session, EUROGI Imagine Conference in October 2014
• EU is towards a data-driven economy. Open data is significant part of it. The big data market rises from 10 bn € to 50 bn € between 2011-2015 and revolutionises the decision making
• Open data offers opportunities for growth, jobs, better quality, better efficiency and innovative services and develops ecosystems across the economy and society
• Open govt’l data: an untapped business est. 140 bn € in the former EU28, Better governance, empower citizens, address societal challenges and accelerate scientific progress
• Industry involvement is a key (PPP is open – join it!)
• The EU Open Data Strategy – milestones incude: EC Communicationon Open Data (2011), Revision of PSI Directive (2013) Guidelines on PSI re-use (July 2014).
• Now we are speaking on EU open data infrastructure
• Research and Innovation funding available to foster cross-sectral re-use with merging different types of data
Open Data Issues and ChallengesWhat data should be made public?
1. Economic drivers
– Recent studies reveal the value to economies of opening up public datasets for unrestricted use, including commercially.
2. Principles for governance of society
– Reactive versus proactive release of government data?
– Privacy concerns
– Existing regulations
How to make data publicly ‘open’? Lessons learned by the EU PSI Directive
How to efficiently implement and monitor Open Data policy?
– Voluntary v mandatory? Regulations? Infringements to be applied?
How to judge the effectiveness of an Open Data policy?
– Defining effectiveness benefits for Gov, Society and business? Cost-Benefit Analysis
– What indicators? Some will be financial but many difficult to measure
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference11
Open Data Issues and Challenges
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference12
Some academic viewpoints
Open Source, Open Data and Content are foundations for Open Educational Resources (Prof. J. Strobl, Salzburg Uni):
Open educational resources are considered as a transformational and potentially disruptive game changerStages are: spatial literacy, spatial awareness and spatial thinkingOpen educational resources not equal open educationNeed to share a higher level: not only data but knowledge as well
Open data and content(Prof. P.Baumann Jacobs Uni):Outreach to science, communities and citizens. New, advanced technical solutions helps database visualization, parallel/distributed query processing, secured archive integration ISO standard for multi-dimensional spatio-temporal arrays has been approved
Note: Open Source Open Data at the FOSS4G (Seoul) & FOSS4G-Europe (PoliMi Como, July, 2015)with the 3rd NASA WWEC
Big Data Issues and Challenges
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference13
Big Data Issues and ChallengesIntergeo 2015 Berlin 17,000 professionals
• In focus: UAVs,/UASs
• Still lack of legislation
keeping privacy
ESA Big Data Conference
Frascati, November 2014
ISDE and ICSU CODATA
Conference in Beijing
July, 2014 (Science related)
GEO-OGC Think Tank in Frascati, Sept 2013, wGISS-37,38, 2014
EUROGI policy paper on Big and Linked Data (GI-related)
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference14
Big Data Issues and Challenges
Data acqusition, Data from positioning, Earth observation, imaging, social networks, citizen science
Processing and AnalysisFacebook 300 petabytes of data (daily increase: 600 TB)Google web index: 100 PB , 600 queries/s) Data Torrent can process 1.5 bn events per second
Use of extremely large and realistcally complex datasets, real-time cross-stream analysis
Management and ServiceLegal framework,Interoperability, Data sharing, Capacity building, Collaboration, Usability: timely, reliable, ready to support in temporaly critical decision (eg. Disaster response or other homeland security measures)
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference15
Big Data Discussion – Key Issues• Homeland security (disaster management, rescue and mitigation critical
infrastructures, land, water, etc) supporting solutions):• Dynamic real-time location- and object to object communication–based services
Sensor webs, RFIDs, IoTs (enabling traceabilitiy) in transportation, logistics,, animal and plant health, food security, human health monitoring – unique digital identifiers
• Integrated and interoperable indoor-outdoor positioning and navigation (for orientation support, rescue operation)
• Mobile GI, crowdsourcing, VGI, social networks, autonomous data collection, UAVs,/UUVs, real-time data flows from ubiquitous sensors
• Need for Strategy, (Coordination, Implementation, Collaborationfor major Societal Benefit Areas)
• Need for appropriate legislation (e.g. UAVs keeping privacy as much as possible)
• Need for awareness raising (role of NGOs, e.g. EUROGI policy paper) and PPPs.
• Need for Capacity Building in Big Data Analitycs• Need for Research and Innovation
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference16
Research needs and programmesBackground on the EU Horizon 2020 RTD Programme
Topic ICT-16 2015 "Big Data: Research”
• Scope
• Expected impact
• Challenges and issues to be addressed
• The Horizon 2020 Big Data ‘Action’ (Budget: 561 M EUR)
• Research and Innovation actions
• Big Data Processing Examples and Benchmarking Environment
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference17
References
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference18
Background on the EU Horizon 2020 RTD Programme. Topic ICT-16 2015 "Big Data: Research" Handout. Please ask copy by email from the moderators.
Additional references from the moderators incl.:
Shared and Open Data – European efforts
23rd ICSU CODATA Conference, Taipei Oct 27-31, 2012
(with K.Janssen KU.Leuven and C. Bamps EUROGI
Roger LonghornOpen Data Meets Big Data
Open Data Forum 2014, Taipei July 9, 2014
Thank you for your participation!
QEEII Conference Center
London, 20 January 2015
Roundtable 5 on Open Data and Big Data
Defense Geospatial Intelligence Conference19
Dr Gábor Remetey-Fülöpp,Secretary General, Hungarian Association
for Geo-information (HUNAGI) – www.hunagi.hu
Contact: gabor.remetey@gmail.com
Roger Longhorn
Secretary-General, Global Spatial Data Infrastructure (GSDI) Association – www.gsdi.org
Contact: rlonghorn@gsdi.org / ral@alum.mit.edu