1 Mining Test Oracles for Search Engines Wujie Zheng [email protected].
A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang,...
-
Upload
ella-hoover -
Category
Documents
-
view
217 -
download
0
Transcript of A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang,...
![Page 1: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/1.jpg)
A MULTI CLOUD SERVICE CO-
DEPLOYMENT MECHANISM
Yu Kang, Zibin Zheng, and Michael R. Lyu{ykang, zbzheng, lyu}@cse.cuhk.edu.hk
Department of Computer Science & EngineeringThe Chinese University of Hong Kong
Hong Kong, China
![Page 2: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/2.jpg)
Back Ground
Independent Deployment of Single Service
Co-deployment of Multi-service
Experiment and Discussion
Conclusion and Future Work
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
2
![Page 3: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/3.jpg)
BACK GROUND
Rapid growing of cloud-based services
Different cloud-based services may cooperate YouTube & Facebook Google Doc & Gmail Taobao & Alipay
Necessary to deploy together Interactions between services Independent deployment is not enough Critical to make global decisionCLOUD 2012, Hawaii, USA, June 24 - 29, 2012
3
![Page 4: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/4.jpg)
MOTIVATION EXAMPLE
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
4
![Page 5: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/5.jpg)
MULTI-SERVICE CO-DEPLOYMENT PROBLEM
Independent services with different target users (may overlap)
Interactions between services Deployed in different data centers even
different clouds for users One company to host and deploy
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
5
![Page 6: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/6.jpg)
Back Ground
Independent Deployment of Single Service
Co-deployment of Multi-service
Experiment and Discussion
Conclusion and Future Work
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
6
![Page 7: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/7.jpg)
INDEPENDENT DEPLOYMENT OF SINGLE SERVICE
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
7
![Page 8: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/8.jpg)
SINGLE SERVICE DEPLOYMENT
Indicator whether VM j is used
Indicator whether user i is
connected to VM j
Times of user i call service
Distance between user i
and VM j
Minimize total distance for all user requests
Every user i can only connect to
one VM
Can only connect to open VMs
Open at most k VMs
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
8
![Page 9: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/9.jpg)
INDEPENDENT DEPLOYMENT OF SINGLE SERVICE
yj = 1
xij = 1
Every user i can only connect to
one VM
×
Can only connect to open VMs
×
Open at most k VMs
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
9
![Page 10: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/10.jpg)
Back Ground
Independent Deployment of Single Service
Co-deployment of Multi-service
Experiment and Discussion
Conclusion and Future Work
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
10
![Page 11: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/11.jpg)
MULTI CLOUD SERVICE CO-DEPLOYMENT
Times of user i call service h
connect at most one VM
Times of interaction between service q
service s for request of user i
Limit number of instances every
serviceboth VMs should be selected
at most one connection
indicator whether interaction between services q and s go
through VM p to r for requests of user i
indicator whether VM j
for service h is used
indicator whether user i would use VM j
for service h
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
11
![Page 12: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/12.jpg)
MULTI CLOUD SERVICE CO-DEPLOYMENT
Open at most kh VMs for service h
xhij = 1
yipqrs = 1
zhj = 1
connect at most one VM
Can only connect to open VMs
×
First VM is chosen by user i
for service h, next is open
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
12
![Page 13: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/13.jpg)
ITERATIVE SEQUENTIAL CO-DEPLOYMENT ALGORITHM
First Generate Random
Deployment
Sequentially improve the deployment of
each service
Treat requests from other services the same
as these from users
Record the best till now
Disturb and do local search
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
13
![Page 14: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/14.jpg)
Back Ground
Independent Deployment of Single Service
Co-deployment of Multi-service
Experiment and Discussion
Conclusion and Future Work
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
14
![Page 15: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/15.jpg)
OBTAIN THE DATASET
1. Conduct the experiment on 597 planetlab instances
2. Ping 2,213 web-services and all other planetlab peers in random order
3. Delete records of several instances and web-services to obtain two non-negative matrices, finally 307 * 1,881 remains
4. Mapping: Planetlab nodes -> available data centers Web-services -> users
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
15
![Page 16: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/16.jpg)
DATASET STATISTICS
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
16
![Page 17: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/17.jpg)
EXPERIMENT SETTING
Above 106 decision variables Use the tool Ilog CPLEX to solve the MIP
problems Randomly generate user log and calling
sequences as: User id -> service si1 -> service si2 -> … ->
service sim
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
17
![Page 18: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/18.jpg)
DEFAULT EXPERIMENT SETTING
1881 users 10 services Deploy10 service VMs among a candidate set
in 100 data centers A user of service would have 5 request logs𝑠 One request of a service would involve on
average 5 requests of other services
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
18
![Page 19: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/19.jpg)
EXPERIMENT (ALGORITHM SPECIFICS)
Convergence of Iterative Sequential Procedure
Number of Disturbs
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
19
![Page 20: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/20.jpg)
EXPERIMENT (NUMBER OF SERVICES)
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
20
![Page 21: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/21.jpg)
EXPERIMENT (NUMBER OF SERVICE VMS)
Size of Candidate Set of Service VMs
Number of Service VMs to Deploy
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
21
![Page 22: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/22.jpg)
EXPERIMENT (SERVICES LOGS)
Number of Service Users
Average Call Length of Service
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
22
![Page 23: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/23.jpg)
EXPERIMENT (SERVICES LOGS)
Number of Logs
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
23
![Page 24: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/24.jpg)
Back Ground
Independent Deployment of Single Service
Co-deployment of Multi-service
Experiment and Discussion
Conclusion and Future Work
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
24
![Page 25: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/25.jpg)
CONCLUSION AND FUTURE WORK
Conclusion Model the latency-aware cloud-based multiple
services co-deployment problem Give a new iterative algorithm to solve the
problem Conduct experiments on real world data set
Limitation of model No limitation on requests to one service VM Computation time is not constant in real world Possible solution: add a term of computational
time in the model
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
25
![Page 26: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.](https://reader035.fdocuments.in/reader035/viewer/2022062423/56649f3e5503460f94c5ee43/html5/thumbnails/26.jpg)
Q & A
CLOUD 2012, Hawaii, USA, June 24 - 29, 2012
26