A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A...
Transcript of A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A...
![Page 1: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/1.jpg)
A Filesystem Layer Data Replication Method
for Cloud Computing
World Telecom Congress 2012
Workshop on “Cloud Computing in the Telecom Environment, Bridging the Gap”
Masanori Itoh, Kei-ichi Yuyama, Kenjirou Yamanaka
March 4, 2012
NTT DATA CORPORATION
![Page 2: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/2.jpg)
Agenda
01 Background, Motivation and Goal
02 Overall Considerations and Related Works
03 Problem Analysis and Basic Ideas03 Problem Analysis and Basic Ideas
04 Design and Implementation
05 Evaluation
06 Future Works
07 Summary
Copyright © 2012 NTT DATA CORPORATION 1
![Page 3: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/3.jpg)
Background, Motivation and Goal
1111
Copyright © 2012 NTT DATA CORPORATION 2
![Page 4: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/4.jpg)
1. Background
� Social Background
� Eastern Japan Disaster (‘東日本大震災’) on March 11, 2011
� Strong Needs for Disaster Recovery
� Un-predictable Computing / Networking Resource Demand
� e.g., Systems for Checking People’s Safety� e.g., Systems for Checking People’s Safety
Copyright © 2012 NTT DATA CORPORATION 3
![Page 5: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/5.jpg)
� Technical Background
� Demand for Inter-Cloud Federation Technology
� Aggregating Resources of Multiple Cloud Systems
� Inter-Cloud Scale-Out
�Inter-Cloud Disaster Recovery
1. Background
Inter-Cloud
Disaster Recovery
Inter-Cloud
Scale-Out
�Inter-Cloud Disaster Recovery
Service X
Service 2
Service Y
Service A
Service X
Service 1
Disaster !!!
Service Y
Service 1
Service 2
Cloud A Cloud B Cloud A Cloud B
Cloud C
4
![Page 6: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/6.jpg)
1. Motivation
� Motivation
� A National R&D Project Shooting for Inter-Cloud Scale-Out and
Disaster Recovery in terms of Resource Control
� The Project Achieved Enabling Computing / Networking
Resource Federation among Heterogeneous Multiple Cloud Resource Federation among Heterogeneous Multiple Cloud
Systems
• Standardization Effort : GICTF (http://gitctf.jp)
� But, we needed to address the Tenant Data Replication Issue in a
Suitable Way for Inter-Cloud Computing Environment.
Copyright © 2012 NTT DATA CORPORATION 5
![Page 7: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/7.jpg)
1. Goal
� Goal
� An Efficient Mechanism Enabling Tenant Data Replication (e.g.,
Database, various Log Files, etc.) with Reasonable Trade Offs under
Inter-Cloud Computing Environment
� Need to Keep Replica(s) of Data as Up-to-Date as Possible� Need to Keep Replica(s) of Data as Up-to-Date as Possible
� Immediate, Synchronous, … Replication Mechanism
Copyright © 2012 NTT DATA CORPORATION 6
![Page 8: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/8.jpg)
1. Goal
� Requirements
1. Performance
1. Better Than Existing Solutions
2. Sufficient Replication Throughput even for Geologically Distributed
Environment (e.g., Tokyo - Osaka)
2. Minimum Impact to Wide Variety of (New/Existing) Systems2. Minimum Impact to Wide Variety of (New/Existing) Systems
1. Minimum Software (esp. Application) Modifications
2. Reasonable Operation Impact
3. Cost Efficiency
1. No Expensive Special Hardware
Copyright © 2012 NTT DATA CORPORATION 7
![Page 9: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/9.jpg)
Overall Considerations and Related Works
2
Copyright © 2012 NTT DATA CORPORATION 8
![Page 10: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/10.jpg)
2. Possible Layers
� Possible Layers (Existing Solutions)
� Application Layer
� User Application Dependent Implementations
� Middleware Layer
� MySQL Cluster, PostgreSQL Streaming Replication, etc.
� Block Device Layer� Block Device Layer
� drbd
� Hardware Layer
� EMC SRDF, etc.
Copyright © 2012 NTT DATA CORPORATION 9
![Page 11: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/11.jpg)
2. Related Works – An Overview
� Overview of Possible Layers
Application
User Space
Kernel Space
Middleware
Example 1: Application Layer
Implemented by Application Developers
Example 2: Middleware Layer
MySQL Cluster,
PostgreSQL Streaming Replication, etc.
Need to Trap Data Issued by Applications Somewhere
Copyright © 2012 NTT DATA CORPORATION 10
Filesystem
Block Device
Driver
Storage Device
Kernel Space
Hardware
I/O Fabric
Software
Example 3: Block Device Layer
drbd (distributed redundant block device)
Example 4: Hardware Layer
EMC SRDF, etc.
Need to Trap Data Issued by Applications Somewhere
and Transfer to Geologically Distant Place(s)
![Page 12: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/12.jpg)
2. Related Works – Pros/Cons Analysis
• Example 1/2 : Application/Middleware Layer : (e.g., MySQL Cluster)
• Pros Easy to Keep Consistency, Reasonable Performance
• Cons Application/Middleware Dependent
• Example 3 : Block Device Layer : (e.g., drbd)
• Pros Application/Middleware/File System Neutral <- Good !
• Cons Poor Performance, Small Room to Optimize
Copyright © 2010 NTT DATA CORPORATION
• Cons Poor Performance, Small Room to Optimize
• Example 4 : Hardware Layer
• Pros Software Neutral
• Cons Hardware Dependent, (Very Much) Expensive,
Poor Performance, Very Small Room to Optimize
11
![Page 13: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/13.jpg)
2. Related Works – Yet Another Layer
� Overview of Possible Layers
Application
User Space
Kernel Space
Middleware
Example 1: Application Layer
Implemented by Application Devlopers
Example 2: Middleware Layer
MySQL Cluster,
PostgreSQL Streaming Replication, etc.
Example 5 : Filesystem Layer
Copyright © 2012 NTT DATA CORPORATION 12
Filesystem
Block Device
Driver
Storage Device
Kernel Space
Hardware
I/O Fabric
Software
Example 3: Block Device Layer
drbd (distributed redundant block device)
Example 4: Hardware Layer
EMC SRDF, etc.
Example 5 : Filesystem Layer
‘zfs send/recv‘ ?
Here is a room to do something…
![Page 14: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/14.jpg)
2. Related Works – Pros/Cons Analysis
• Example 1/2 : Application/Middleware Layer : (e.g., MySQL Cluster)
• Pros Easy to Keep Consistency, Reasonable Performance
• Cons Application/Middleware Dependent
• Example 3 : Block Device Layer : drbd
• Pros Application/Middleware/File System Neutral <- Good !
• Cons Poor Performance, Small Room to Optimize
Copyright © 2010 NTT DATA CORPORATION
• Cons Poor Performance, Small Room to Optimize
• Example 4 : Hardware Layer
• Pros Software Neutral
• Cons Hardware Dependent, (Very Much) Expensive,
Poor Performance, Very Small Room to Optimize
• Example 5 : File System Layer
• Pros Application/Middleware Neutral, Large Room to Optimize
• Cons Needs Kernel Level Programming
13
![Page 15: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/15.jpg)
Problem Analysis and Basic Ideas
3
Copyright © 2012 NTT DATA CORPORATION 14
![Page 16: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/16.jpg)
3. Problem Statement
� Poor Performance
• The Lower Layer a Replication Mechanism is Implemented, the More
Sensitively its Throughput is Affected Under Geologically Distributed
Environment (LFP).
• Find Out the Best Place / Way to do Replication Work in terms of
Copyright © 2010 NTT DATA CORPORATION
• Find Out the Best Place / Way to do Replication Work in terms of
Performance.
• Not Sufficient Tenant Data Replication Performance against
Network Line Investment
15
![Page 17: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/17.jpg)
3. Problem Analysis and Basic Ideas
� drbd Replication
�Transmits each (Random) Write I/O Request to the Remote Site
• Inherently Uses Short Packets – Poor Throughput
�Secure Replication is Provided by only Protocol C, which waits for I/O
Completions at the Remote Site
• Affects the Source Side I/O Requests Latency• Affects the Source Side I/O Requests Latency
� Idea
�Make Use of Filesystem Journal
• Naturally Converts Random (Write) I/Os into Sequential I/Os
• Aggregates Multiple (Random) I/O Payloads
�Good Place to Implement Tenant Data Replication
16Copyright © 2012 NTT DATA CORPORATION
![Page 18: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/18.jpg)
Design and Implementation
4
Copyright © 2012 NTT DATA CORPORATION 17
![Page 19: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/19.jpg)
Design -- Overall Architecture
� Overall Architecture
Application
User Space
Kernel Space
Middleware
I/O Requests (system calls)
Journal Data
Receiver
Wide Area
Network
(Internet/
Dedicated…)
Recovery
Tool
Primary Site
(e.g., Tokyo)
Backup Site
(e.g., Osaka)
Setup
Utility
Middleware
Copyright © 2012 NTT DATA CORPORATION 18
Journal Based FS
block Device
driver
Storage Device
Kernel Space
Journal
Subsystem
Memory
Management
Block I/O
Scheduler
I/O reqs.
Payload
Journal Data
SnapshotJournal Data
Trapper
Accumulate
Journal Data
Apply Journal
Data on Recovery
![Page 20: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/20.jpg)
4. Design and Implementation
� Principles of Operation : Source Side
1. Take a Snapshot of the Source File System (Partition Image (e.g.,
sdb1)) and Transfer it to the Remote Site
2. Mount the Source File System
• Establish (a) Connection(s) with the Remote Site
3. Begin Journal Data Transfer (Both Meta Data and Filesystem3. Begin Journal Data Transfer (Both Meta Data and Filesystem
Payload )
� Principles of Operation : Receiver Side
1. Receive Journal Data and Store them Locally/Sequentially
� Principles of Operation : On Recovery
1. Apply the Journal Data to the Snapshot
Copyright © 2012 NTT DATA CORPORATION 19
![Page 21: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/21.jpg)
4. Design and Implementation
� Prototype Implementation
� Base Platform
� Fedora 14 (x86_64) + Fedora15 kernel (linux-2.6.37-2.fc15)
� Base Filesystem
� ext4 + jbd2
� Souce Lines� Souce Lines
� Trapper (Modified jbd2 driver) 4Ks
� Setup Utility (user land) : 1Ks
� Receiver (user land) : 4Ks
� Recovery Tool (user land) : 1Ks
� c.f. drbd source lines: kernel 30Ks + user land 30Ks
Copyright © 2012 NTT DATA CORPORATION 20
In Total, 10Ksteps(Including bunch of
debug codes)
![Page 22: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/22.jpg)
4. Design and Implementation
� Optimizations in Prototype Implementation
1. Use Multiple TCP Connections per Mount
� Avoid Modification to TCP/IP Protocol Stack
2. Overlapping Local Journal I/O and Transmission over TCP
connections
� Make Use of Parallelism and Issue Transmissions Frequently� Make Use of Parallelism and Issue Transmissions Frequently
3. ext4 Mount Options with respect to Journaling
data=ordered(default), data= journal, data=writeback
� Created a Combined Mode of data=ordered and data=journal,
and on the Source side:
• Write metadata only
• Transfer both metadata and data to the receiver side.
Copyright © 2012 NTT DATA CORPORATION 21
![Page 23: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/23.jpg)
Evaluation
5
Copyright © 2012 NTT DATA CORPORATION 22
![Page 24: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/24.jpg)
5. Evaluation
Features Test
� Content of Files and Meta-data of them are Restored Correctly
Performance Measurement
� Hardware/Software
• Xeon L5520 2P4C, 32GB, 146G SAS HDD (RAID 1) x 2, GbE NIC
• 2Gbps FC RAID, 146GB Volume (RAID10)• 2Gbps FC RAID, 146GB Volume (RAID10)
• Fedora14 (x86_64) + Modified Fedora 15 kernel (2.6.37-2.fc15)
� Network Delay Generator
• Linux netem (i.e., ‘tc’ command)
� Benchmark
• bonnie++ : 1.96
• pgbench (Postgresql 9.1.0) , scaling factor= 256, clients=64
Copyright © 2012 NTT DATA CORPORATION 23
![Page 25: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/25.jpg)
5. Evaluation
Emulated Geologically Distributed Environment
�One-Way Latency : 10ms via netem
~ Tokyo - Osaka
I/O Pattern (Benchmark)
�bonnie++, pgbench RouterReceiver
Delay
(10ms)
Source
Journal Data ->
�bonnie++, pgbench
Receiver Side Behavior
�Receiver Sends Back ACKs
after I/O Completion
(Equivalent to drbd protocol C)
RouterReceiver
Node
Delay
(10ms)Journal Data ->
Source
Node
Copyright © 2012 NTT DATA CORPORATION
SnapshotJournal
DataSource
24
![Page 26: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/26.jpg)
5. Evaluation Results : bonnie++
Sequential Write (block)
without Overlap, 1 connection 0.19 MB/s
without Overlap,10 connections 1.77MB/s
Performance Impact
• 10 Times Faster than Compared to DRBD Protocol C
without Overlap,10 connections 1.77MB/s
without Overlap, 500 connections 26MB/s
with Overlap, 500 connections 33MB/s
DRBD (Protocol C) 3.3 MB/s
Copyright © 2012 NTT DATA CORPORATION 25
10 Times
Better !
10 Times
Better !
![Page 27: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/27.jpg)
5. Evaluation Results : bonnie++
Sequential Write (block)
without Overlap, 1 connection 0.19 MB/s
without Overlap, 10 connections 1.77MB/s
Performance Impact
• 10 Times Faster than Compared to DRBD Protocol C
without Overlap, 10 connections 1.77MB/s
without Overlap, 500 connections 26MB/s
with Overlap, 500 connections 33MB/s
DRBD (Protocol C) 3.3 MB/s
Upper Limit (GbE = 125MB/s)
No Replication (Base) 158 MB/s
Copyright © 2012 NTT DATA CORPORATION 26
Need to
Investigate…
Need to
Investigate…
![Page 28: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/28.jpg)
Future Works
6
Copyright © 2012 NTT DATA CORPORATION 27
![Page 29: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/29.jpg)
6. Future Works
• More Detailed Analysis (Especially, Performance)
• Packet Level Analysis, etc.
• Further Evaluation
• Try Other Application Level Benchmarks
• Further Optimization
• Optimizing Journal Data Transmission Timing
• Use SSD on the Receiver Side
• Multiple-Tier Replication Data Chaining
• Use Secure Communication Channel (SSL?)
• Integration with the Inter-Cloud Federation Manager
• Other File Systems (e.g., jfs2, zfs?)
Copyright © 2012 NTT DATA CORPORATION 28
![Page 30: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/30.jpg)
Summary
7
29Copyright © 2012 NTT DATA CORPORATION
![Page 31: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/31.jpg)
7. Summary
• Proposed Technique
• A Journal Based File System Layer Tenant Data Replication Method
• Features
� Application/Middleware Transparent
• Suitable for Inter-Cloud Computing Environment
� High Performance � High Performance
• 10 Times better than drbd
• Lots of Room for Further Optimization
� Generically Applicable to Any Journal Based File Systems
� Minimum Implementation Impact
30Copyright © 2012 NTT DATA CORPORATION 30
![Page 32: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/32.jpg)
Acknowledgement
� This work is funded by the Ministry of Internal Affairs and
Communications (総務省), Japan.
� 平成22年度 情報通信技術の研究開発
(FY2010 R&D of Information Communication Technologies)
http://www.soumu.go.jp/menu_news/s-news/02tsushin03_000024.htmlhttp://www.soumu.go.jp/menu_news/s-news/02tsushin03_000024.html
III クラウドサービスを支える高信頼・省電力ネットワーク制御技術の研究開発
(R&D of Highly Available and Green Network Control Technology for Cloud Services)
III-1 高信頼クラウドサービス制御基盤技術
(Technologies for Highly Available Cloud Service Control Foundation )
Copyright © 2012 NTT DATA CORPORATION 31
![Page 33: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/33.jpg)
Thank You !
32
Thank You !
Copyright © 2012 NTT DATA CORPORATION
![Page 34: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/34.jpg)
Copyright © 2012 NTT DATA CORPORATION 33
![Page 35: A Filesystem Layer Data Replication Method for Cloud Computingwtc2012/Slides/Workshops/WS... · A Filesystem Layer Data Replication Method for Cloud Computing World Telecom Congress](https://reader033.fdocuments.in/reader033/viewer/2022060407/5f0f90347e708231d444c847/html5/thumbnails/35.jpg)
Q&A
34
Q&A
Copyright © 2012 NTT DATA CORPORATION