Big Data and The Cloud

Assoc.Prof.Dr. Tiranee Achalakul

Government Big Data Institute

Data and More Data

• Data is over 40 times greater in 2020 than it was in 2009 and more than 1/3 will live in or pass through cloud. (www.csc.com)

• Now, most people are using the Internet-based applications on mobile or desktop.

• The mobile cloud market has registered a value of USD 30.71 billion in 2019, and it is expected to reach USD 118.70 billion by 2025 (www.mordorintelligence.com)

• The explosive growth of data brings about the need for Cloud.

• A place to store those data securely

• A mechanism for those data to be access efficiently

• A facility to compute and analyze those data effectively

Technologies that are needed for big data

• Personalized, value-added insurance packages

• Premiums based on habits• Regular exam/consultations based on

past data

Insurance

Autonomous Car and Drone

Enhancing Citizen Experience

Sentiment Analysis

• Use text analytics to gather citizen concerns and sentiments

• Assess current situations to create a set of keywords to gather social media post related to topics of interest

• Determine the sentiment with respect to topics or the overall contextual polarity of a post/comment

The rapid development of technology led to the explosive growth of data in almost

every industry and business area.

Big Data, the Tech Hype of The Last 10 Years

Data with Volume, Variety, Velocity, and Veracity

ประมวลปัญหา

AI

Social Media

Chatbot

Call Center

Mobile Application

Other Databases

Analytics and Statistics

Text Samples

Business Decisions

IT Infrastructure

Data Services

Business Applications

Digital Transformation

Data

Warehouse

หน่วยงานภายใน

DataCatalog

Data Service (Internal and External Users)

AnalyticsStudio

หน่วยงานภ

ายนอก

Analytics with

Dashboards

Data Lake

Google Trends

Location

Data

Telematics

10

11

We don’t want to

procure computing

infrastructure

without prior

knowledge on

usage

Using the Cloud is

like using electricity

• Don’t have to

know where the

services come

from

• Just pay-as-you-

go

• And NO

infrastructure

maintenance

ประโยชน์ของการใช้ระบบคลาวด์

•Anytime-Anywhere access

•Pay Per Use

• Extend or reduce capacity rapidly

•No hardware dependency

Virtual

Machine

พรอ้มเดอืน ก.ย.

Data center Install HypervisorSoftware

Storage or Compute

Service Provisioning

ดาต้าเซนเตอรแ์ละการท าระบบคลาวด์

Data center

Traditional IT Infrastructure

Public Cloud

ความคล่องตวัของการใช้ระบบคลาวด์

Extend the Data Center to the Cloud for Backup and DR

Data Center หน่วยงานคลาวดก์ลางภาครฐั

GDCC

VMs

GDCC

Storage

GDCC

Storage

GDCC

VMs

GDCC

Storage

• ประเมนิ ทรพัยากรประมวลผล เครอืขา่ย และ Datacenter ส าหรบัรองรบัการขยายงาน

• พจิารณาใชร้ะบบคลาวด์(Cloud-First Policy)

A CLOUD APPROACH

• Converged infrastructure : Implementing pools of computers, storage and networking resources that can be • Shared by multiple

applications • Managed in a collective

manner using policy-driven processes.

Services and assets tied

together in complex

vertical stacks

Service components are

abstracted and sourced

from dynamic resource

pools.

Business Decisions

IT Infrastructure

Data Services

Business Applications

Digital Transformation

21

Specific Business Applications

• First step: Internal digitalization • Process re-engineering • legal alignment• Digitization• Electronic signature

• Then, cross-governmental digitalization though data sharing services and digital journey design

Customized Software

• Change is hard to implement

• Maintenance is difficult

• Vendor locked-in is unavoidable

• Time to deployment is long

• Data integration is hard

Platform

Micro Services

Platform

• A platform provides the building block called, “Micro services”.

• Process owners can design and develop user interfaces and process flows. Then use these “services” as building block to build software.

• Cheaper in long term, But that is not the main issues

• Standard services will yield similar software behaviors

• Scalability: Many department can implement software quicker, in the same way, at the same time

• Change Management: When standard services change, we don’t have re-implement everything

• Data: We can finally be in a single pot for service improvement and analytics

KYC, eKYC, and Wallet Platform by KTC

G-wallet

For all government agencies to use

• Create questions quickly

• Provide various types of questions

• Compatible with various devices

• Can easily export data for analytics

• Can use AI to select the next question from previous answers

Consent Acquiring and Management Platform

PDPA

Central Platform

User Interface

Consent Database

Analytics

• Identification, Authentication

• Digital ID, Digital Signature

• E-licensing

• E-Payment, E-receipt

• E-voting

• E-proxy (มอบอ านาจ)• Citizen Consent (E-consent)

• Citizen Registration (Tell-us-once)

• Survey form (Data Collection, Aggregation, Storage)

• Data Catalog

• ERP (Accounting, Project Management, HR)

• Wallet

• Analytics

• Gov Document Linkage

Centralized Services

S/PAAS

Business Decisions

IT Infrastructure

Data Services

Business Applications

Digital Transformation

Data Governance : ธรรมาภิบาลข้อมูล

Accuracy Completeness Timeliness Security Privacy Connectedness WorthinessData management

Policy

Organization &Stewardship Audit

Building Knowledge &Awareness

• Data Lifecycle• Data Security & Privacy

• Data Quality Assurance• Data Exchange

Function of• DG Committee• Steward team• Data

Controller/Processor/User

• Data Risk Management • Law & Regulation

Compliance• Data Quality Audit

• Program Coverage• Measurement• Ongoing

Data Management Policy : นโยบายการบริหารจดัการข้อมลู

Create Store Use Archive Destroy

DataLifecycle

Data Catalog Data Security & Privacy Data Quality

Fou

nd

atio

n

• What data ?• Who’s the

owner ?

• Search Tags• Data sources

• Confidentiality• Integrity

• Availability• Accuracy• Validity• Timeliness

• Completeness• Uniqueness• Consistency

Dat

a Ex

chan

ge

Quality Control Access ControlSecurity Control

Data GovernanceWhat data ?Who owns it ?How often is it updated? Where’s it from ?

• The more people who share data via unofficial methods, the higher the risk that it’s not compliant with governance and legal or policy regulations.

• We need systematic data sharing service with well-defined access rules and clear data handling/transfer protocols

Data Sharing

Who and What Can Use the Data.

• Define Users and employee roles map to data sensitivity rules

• Review and update the map regularly

Profile Type-1

Profile Type-4

Profile Type-3

Profile Type-2

Profile Type 1, 2, 3, 4

Profile Type 1, 2, 3

Profile Type 1, 2

Profile Type 1 and Top Management

Access Profile

Business Decisions

IT Infrastructure

Data Services

Business Applications

Digital Transformation

GMAIL

การใช้ประโยชน์จากระบบคลาวด์

GET READY FOR THE WORLD OF DATA