Cloud Computing as Innovation Hub - Mohammad Fairus Khalid
-
Upload
opennebula-project -
Category
Software
-
view
829 -
download
0
Transcript of Cloud Computing as Innovation Hub - Mohammad Fairus Khalid
Mohammad Fairus Khalid
Cloud Computing as
Innovation Hub
Agenda
• Motivation
• Technology
• Paradigm Shift
• Use Cases
The First pay-per-use Cloud Computing
Traditionally Why People Move to Cloud
• Moving away from the hardware silo
• Optimized use of resources
• Pay as you use
• Fast deployment and ease of maintenance
…but World has Changed…
MOBILITY
SOCIAL MEDIA
The Internet of Things – infographic The Connectivist based on Cisco data
INTERCONNECTED
INSIGHTS
The World Changed
• Access from anywhere at anytime with any devices
• Employing more sensors to collect more data and employing more controllable devices
• Collaborative in term of application, data and people efforts
• Greater Intelligence – better decision making for – health, safety, business, sports and etc
How Cloud Get Impacted
• No longer just a platform to provide
computing power
• No longer just about cost saving
• Moving away from application and data
silo
• Platform to collaborate – application, data
and people
• Platform to analyze and that help to
prescribe better decision making
Big Data Landscape
Service Stacks
Infrastructure Fabric
Data Collection Fabric
Data Fabric
Analytics Fabric
Applications Fabric
Layer of Complexity
Compute
Storage
Network
CPU
GPU
Virtual Machine
Container
Operating System
Platform
Application
File system
Small Devices
Agent Big Data
Database
Load balance
People Crowd Sourcing
Device Crowd Sourcing
Physical Layer Physical Abstraction Layer
Service Abstraction Layer
Give me ubuntu. I want to Install my own app
I already have nodejs app. I just want run the app
My business is expending. I need crm system.
I want to store a file
What is the relationship between weather and
durian
I want database size can grow from 10GB to 100 GB
I want to scale the web server
Send me pictures of sea games event
Tell me the bandwidth consumption pattern in
Puchong
User Stories
Technology
• IT Resource Abstraction
• Minimal Operating System
• Collaborative Tools
• GPU/Multi Core processing
• Distributed Storage
IT Resource Abstraction
• Hypervisor Virtualization Challenges
– Significant overhead
– Significant repetitive work – OS deployment,
configuration
• Container is the answer to this.
• There are 2 types of container
– Application Container
– System Container
Application Container - Docker
• Docker containers wrap up a piece of
software in a complete filesystem that
contains everything it needs to run: code,
runtime, system tools, system libraries –
anything you can install on a server. This
guarantees that it will always run the
same, regardless of the environment it is
running in.
Application Container - Docker
Server
Host OS
Docker Engine
bins/libs bins/libs
Ap
p 1
Ap
p 2
Ap
p 3
Ap
p 4
Ap
p 5
Ap
p 6
Server
Host OS
Hypervisor
Guest OS
bins/ libs
App 1
Guest OS
bins/ libs
App 1
Guest OS
bins/ libs
App 1
Virtual Machine
Container
Containers have similar resource isolation and allocation benefits as virtual machines but a different architectural approach allows them to be much more portable and efficient.
Application Container – Image Layer
Debian
nodejs
node-telegram-bot-api
nedb
gbsbot
IMAGE CREATED CREATED BY SIZE
52fde796cb83 24 hours ago /bin/sh -c #(nop) ENTRYPOINT &{["node" "./myb 0 B
f82158577794 24 hours ago /bin/sh -c #(nop) COPY multi:3b93737c8a69ee5b 39.11 kB
20bcf94ccdf9 24 hours ago /bin/sh -c #(nop) COPY file:d1ca5732ca7afe9b4 19.49 kB
0c9042ee2f2c 24 hours ago /bin/sh -c npm --unsafe-perm install node-tel 9.798 MB
db1e2a0888ac 24 hours ago /bin/sh -c npm --unsafe-perm install nedb 4.649 MB
46ff394d3bd9 9 days ago /bin/sh -c #(nop) ENV PATH=/usr/local/sbin:/u 0 B
85db46af09e1 9 days ago /bin/sh -c mkdir /nodejs && curl http://nodej 17.51 MB
ed701745dfc9 9 days ago /bin/sh -c apt-get update -y && apt-get insta 184.4 MB
e9e824eeee9d 2 weeks ago /bin/sh -c #(nop) CMD ["/bin/bash"] 0 B
cba48ac2c991 2 weeks ago /bin/sh -c #(nop) ADD file:41fbf9f100beb80549 84.89 MB
System Container - LXD
• Full operating system functionality within containers, not
just single processes
• Maximum density of guests per host, providing a cost
benefit when running in a public cloud
• Rapid provisioning, instant guest boot
http://www.ubuntu.com/cloud/lxd
Boot Time
0.39
3.39
9.99
11.11
0.00
2.00
4.00
6.00
8.00
10.00
12.00
Avg Application Ready
Bo
ot
Tim
e (
seco
nd
s)
Docker LXD wo Copy LXD KVM
Density
69.53
30.64
2.45
70.65
6.83 6.41
84.59
53.67
0.00
10.00
20.00
30.00
40.00
50.00
60.00
70.00
80.00
90.00
100.00
1 51 101 151 201 251 301 351 401 451 501 551 601 651 701 751 801 851 901 951 1001
Mem
roy
(%)
Number of Guests
Free Memory (KVM) Free Memory (Docker) Free Memory (LXD)
IT Resource Abstraction Use Cases
KVM LXD Docker
Use Case To run mixture of different kernel operating systems of guest machines on the same host.
To run full linux operating system functionality with the same kernel version of the host
To run linux applications which don’t have dependency on the linux kernel version
Examples Windows 7, Ubuntu 10.04, Ubuntu 14.04
Busybox, ubuntu same kernel version
nodejs, tomcat, postgres
Minimal Operating System
• Improved stability and security
• Minimize the overhead of tools
Minimal OS
• lightweight, immutable platform • boot extremely quickly • designed for security, consistency, and reliability
Benefit of Min OS
• minimize the need for frequent patching
• minimize vulnerability and attack space
• Use less resources CPU, RAM and storage
• Increase stability
• Fast to boot 5 – 10 seconds
• Read only ensuring system integrity
• Transactional/atomic update – guaranteed update/rollback
Minimal OS Comparison
Photon OS Snappy Ubuntu Core
Atomic Host CoreOS Rancher OS
Initiated by Vmware open source
Ubuntu open source
Red Hat open source
CoreOS open source
Rancher open source
Why extend the security, identity and resource management to containerized workloads.
to ensure a carrier-grade update experience
To provide secure and reliable foundation to orchestrate multi-container based applications at scale
To provide capability as large web companies like Google
build a minimalist Linux distribution that was perfect for running Docker containers
Supported Framework
Docker, rkt, Pivotal Garden
Open Docker Docker, rkt Docker
Size ~300 MB ~110 MB ~400 MB ~220 MB ~30 MB
Collaborative Tools
• Static
– Marketplace
– Repositories
• Dynamic
– API to services
– Social Media
– Mobile messaging
– Software code management
Paradigm Shift
• Application Programming Interface
– Open, enable collaboration
• Application Architecture - microservices
– Realtime scalability
– Mobility
• Application Design atomic/transactional
– Atomic update
Automation - API
• APIs are sets of requirements that
govern how one application can talk to
one and another.
Application Design- Transactional
• Separation between stateful and
stateless portion of the application.
• The stateless portion will keep as read-
only, which means they cannot be
tampered with and can be updated
perfectly and predictably every time.
• Delta management keeps the size of
downloads to the bare minimum.
• Transactional, image-based delta
updates for the system and applications
that can always be rolled back.
• Signatures and fingerprints ensure we
are running exactly what was published
by the developer.
Debian
nodejs
node-telegram-bot-api
nedb
gbsbot
data config
Application Architecture – Microservices
• developing a single
application as a suite
of small services
• runs in its own
process
• lightweight
communication
mechanisms, often an
HTTP resource API.
http://martinfowler.com/articles/microservices.html
Application Architecture – Microservices
• Strong Module Boundaries: Microservices
reinforce modular structure, which is particularly
important for larger teams.
• Independent Deployment: Simple services are
easier to deploy, and since they are
autonomous, are less likely to cause system
failures when they go wrong.
• Technology Diversity: With microservices you
can mix multiple languages, development
frameworks and data-storage technologies.
http://martinfowler.com/articles/microservice-trade-offs.html
Use Cases
Use Cases
https://www.hitrecord.org/
https://www.tm.com.my/securitysurveillance/Pages/index.html
https://www.data.gov/
Neighborhood Watch - challenge
1. To monitor real-time video 2. To recall event trigged video or
images
1. Emergency alert, panic button
1. Incident alerts
recap
• World changed
• Cloud computing provide opportunity
beyond cost confinement
• Using different technologies to cater for
new business need
• The way applications are architect,
implement and deployed need to change
• We should look cloud as innovation
platform