Gluster Cloud Night in Tokyo 2013 -- Tips for getting started
-
Upload
keisuke-takahashi -
Category
Technology
-
view
6.076 -
download
2
description
Transcript of Gluster Cloud Night in Tokyo 2013 -- Tips for getting started
![Page 1: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/1.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 1
![Page 2: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/2.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 2
Agenda
! About me ! Tips 1: Installation ! Tips 2: NFS Workloads ! Tips 3: Logging ! Conclusion
![Page 3: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/3.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 3
About Me
![Page 4: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/4.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 4
About me
! Work at as a ... ! Programmer
! (Most recently)
! Also Interested in
! Software Engineer ! Cloud Computing ! Big Data ! Something new technologies ! Supporting GlusterFS/Red Hat Storage Introduction
with Red Hat K.K.
![Page 5: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/5.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 5
About me
! GlusterFS since 2007 (v1.3.7) ! for my internet crawler at first.
! Love Gluster because of the ... ! Potential ! Performance ! Code ! Community
! Introduced or introducing it into ... ! Printer and scanner solution (field trial) ! Email services ! File storage services (WebDAV, NFS) ! Backup services ! Shared storage platform
! A board member of the Gluster Community
![Page 6: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/6.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 6
Getting started today!
See http://www.gluster.org/community/documentation/index.php/QuickStart
![Page 7: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/7.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 7
Tips 1 Installation
![Page 8: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/8.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 8
Tips 1: Installation
! Question 1: Have you installed GlusterFS?
![Page 9: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/9.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 9
Tips 1: Installation
! Question 1: Have you installed GlusterFS? ! Question 2: Did you find it easy?
![Page 10: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/10.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 10
Tips 1: Installation
! Question 1: Have you installed GlusterFS? ! Question 2: Did you find it easy? ! Question 3: Did you do it on each single node?
![Page 11: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/11.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 11
Tips 1: Installation
! Question 1: Have you installed GlusterFS? ! Question 2: Did you find it easy? ! Question 3: Did you do it on each single node? ! Question 4: Don't you think you should take easier way?
![Page 12: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/12.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 12
Tips 1: Installation
! Question 1: Have you installed GlusterFS? ! Question 2: Did you find it easy? ! Question 3: Did you do it on each single node? ! Question 4: Don't you think you should take easier way? ! Question 5: Do you use deployment automation tools?
![Page 13: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/13.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 13
Tips 1: Installation
Development team says that hand-to-hand construction of systems is inefficient so they want to show an installation way with a deployment tool in the documents for installation.
![Page 14: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/14.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 14
Tips 1: Installation
Operational team says that they never want to learn the usage of deployment tools and never trust them so they don't accept such a document and they will install the system by hand work.
![Page 15: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/15.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 15
Tips 1: Installation
https://twitter.com/keithseahus/status/398453753352691714
My offer is that what development team should do is only copy the commands that the deployment tool write on your stdout and paste them into the documents for operational team.
![Page 16: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/16.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 16
Tips 1: Installation
Deployment Automation
Tools
![Page 17: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/17.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 17
Tips 1: Installation
peer 1 peer 2 3 4 N
...
A node for automated deployment
deployment automation
tool
shell
sshd
shell
sshd
![Page 18: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/18.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 18
Tips 1: Installation
peer 1 peer 2 3 4 N
...
A node for automated deployment
deployment automation
tool
shell
sshd
shell
sshd
![Page 19: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/19.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 19
Tips 1: Installation
peer 1 peer 2 3 4 N
...
A node for automated deployment
deployment automation
tool
shell
sshd
glusterfs
shell
sshd
glusterfs
![Page 20: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/20.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 20
Tips 1: Installation
peer 1 peer 2 3 4 N
...
A node for automated deployment
deployment automation
tool
shell
sshd
glusterfs
shell
sshd
glusterfs
![Page 21: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/21.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 21
Tips 1: Installation
peer 1 peer 2 3 4 N
...
A node for automated deployment
deployment automation
tool
shell
sshd
glusterfs
shell
sshd
glusterfs
![Page 22: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/22.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 22
Tips 1: Installation
![Page 23: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/23.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 23
Tips 1: Installation
I use this mainly in my projects written in Ruby so am used to it.
![Page 24: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/24.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 24
Capistrano
![Page 25: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/25.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 25
Capistrano
$ gem install capistrano $ cap install mkdir -p config/deploy create config/deploy.rb create config/deploy/staging.rb create config/deploy/production.rb mkdir -p lib/capistrano/tasks Capified $ tree . . ├── Capfile ├── config │ ├── deploy │ │ ├── production.rb │ │ └── staging.rb │ └── deploy.rb └── lib └── capistrano └── tasks
![Page 26: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/26.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 26
capistrano-glusterfs
![Page 27: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/27.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 27
capistrano-glusterfs
$ tree capistrano-glusterfs capistrano-glusterfs ├── Capfile ├── Gemfile ├── Gemfile.lock ├── LICENSE ├── README.md ├── config │ ├── deploy │ │ ├── production.rb │ │ ├── production.rb.example │ │ ├── staging.rb │ │ └── staging.rb.example │ ├── deploy.rb │ └── deploy.rb.example └── lib └── capistrano └── tasks ├── gluster.cap ├── glusterd.cap └── glusterfs.cap
![Page 28: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/28.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 28
capistrano-glusterfs
$ tree capistrano-glusterfs capistrano-glusterfs ├── Capfile ├── Gemfile ├── Gemfile.lock ├── LICENSE ├── README.md ├── config │ ├── deploy │ │ ├── production.rb ... settings for production environment │ │ ├── production.rb.example │ │ ├── staging.rb ... settings for staging environment │ │ └── staging.rb.example │ ├── deploy.rb ... global settings and main sequences │ └── deploy.rb.example └── lib └── capistrano └── tasks ├── gluster.cap ... tasks to execute gluster command remotely ├── glusterd.cap ... tasks to start/stop all remote glusterd └── glusterfs.cap ... tasks for deploying GlusterFS
![Page 29: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/29.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 29
capistrano-glusterfs
$ cat capistrano-glusterfs/config/deploy/staging.rb set :stage, :staging set :branch, "master" server '192.168.200.100', roles: %w(glusterfs glusterd gluster), user: 'deploy' server '192.168.200.101', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.102', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.103', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.104', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.105', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.106', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.107', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.108', roles: %w(glusterfs glusterd), user: 'deploy' server '192.168.200.109', roles: %w(glusterfs glusterd), user: 'deploy'
![Page 30: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/30.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 30
capistrano-glusterfs
$ bundle exec cap -vT | grep -i "glusterfs:" cap glusterfs:build # Starting installation cap glusterfs:compile # Compile GlusterFS cap glusterfs:configuration # GlusterFS related configurations cap glusterfs:dependancies # Install GlusterFS dependancies cap glusterfs:make_install # Install GlusterFS cap glusterfs:preparation # Prepare installing GlusterFS $ bundle exec cap -vT | grep -i "glusterd:" cap glusterd:restart # Restart glusterd cap glusterd:start # Start glusterd cap glusterd:status # Get the status of glusterd cap glusterd:stop # Stop glusterd $ bundle exec cap -vT | grep -i "gluster:" cap gluster:peer:help # Help command for peer cap gluster:peer:status # list status of peers cap gluster:pool:list # list all the nodes in the pool cap gluster:volume:help # display help for the volume command cap gluster:volume:info # list information of all volumes cap gluster:volume:list # list all volumes in cluster cap gluster:volume:status # display status of all volume(s)/brick
![Page 31: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/31.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 31
capistrano-glusterfs
http://www.capistranorb.com/documentation/getting-started/flow/
![Page 32: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/32.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 32
capistrano-glusterfs
http://www.capistranorb.com/documentation/getting-started/flow/
prepare and install dependancies before starting
build GlusterFS from source and install it
after published
![Page 33: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/33.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 33
capistrano-glusterfs
task :preparation do .... execute "sudo -i yum install -y wget git yum-priorities" .... end
![Page 34: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/34.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 34
capistrano-glusterfs
task :dependancies do .... dependancies = %w[ openssh-clients make rpm-build bison flex automake libtool ncurses-devel readline-devel openssl-devel libxml2-devel libibverbs-devel libacl-devel libattr-devel python-devel python-setuptools lvm2-devel systemtap-sdt-devel libaio-devel xfsprogs ]
![Page 35: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/35.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 35
capistrano-glusterfs
task :compile do on roles(:glusterfs), in: :sequence, wait: 5 do execute "cd #{DIR}; sh ./autogen.sh" execute "cd #{DIR}; sh ./configure \ --prefix=#{INSTALL_PATH} \ --enable-bd-xlator \ --enable-fusermount \ --enable-systemtap \ --enable-debug" execute "cd #{DIR}; make" end end
![Page 36: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/36.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 36
capistrano-glusterfs
task :make_install do on roles(:glusterfs), in: :sequence, wait: 5 do execute "cd #{DIR}; sudo make install" symlink = "/usr/local/glusterfs" execute "sudo -i rm -f #{symlink}" if test("[ -L #{symlink} ]") execute "sudo -i ln -snf #{INSTALL_PATH} #{symlink}" end end
![Page 37: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/37.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 37
capistrano-glusterfs
$ git clone [email protected]:keithseahus/capistrano-glusterfs.git $ cd capistrano-glusterfs $ bundle exec cap staging deploy
![Page 38: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/38.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 38
capistrano-glusterfs
$ git clone [email protected]:keithseahus/capistrano-glusterfs.git $ cd capistrano-glusterfs $ bundle exec cap staging deploy DEBUG [e5bdd4a7] Running /usr/bin/env /bin/egrep '/bin' ~/.bashrc > /dev/null; exit $? on 192.168.200.101 DEBUG [e5bdd4a7] Command: /bin/egrep '/bin' ~/.bashrc > /dev/null; exit $? DEBUG [e5bdd4a7] Finished in 0.096 seconds with exit status 0 (successful). INFO [a54cf65d] Running /usr/bin/env sudo -i yum install -y wget git yum-priorities on 192.168.200.101 DEBUG [a54cf65d] Command: sudo -i yum install -y wget git yum-priorities DEBUG [a54cf65d] Loaded plugins: fastestmirror, priorities DEBUG [a54cf65d] Loading mirror speeds from cached hostfile epel/metalink | 6.4 kB 00:00 DEBUG [a54cf65d] * base: ftp.tsukuba.wide.ad.jp DEBUG [a54cf65d] * epel: ftp.kddilabs.jp DEBUG [a54cf65d] * extras: ftp.tsukuba.wide.ad.jp DEBUG [a54cf65d] * remi: rpms.famillecollet.com DEBUG [a54cf65d] * remi-php55: rpms.famillecollet.com DEBUG [a54cf65d] * remi-test: rpms.famillecollet.com DEBUG [a54cf65d] * rpmforge: ftp.kddilabs.jp DEBUG [a54cf65d] * updates: mirrors.tuna.tsinghua.edu.cn ...
![Page 39: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/39.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 39
capistrano-glusterfs
... DEBUG [80062be9] GlusterFS configure summary DEBUG [80062be9] =========================== DEBUG [80062be9] FUSE client : yes DEBUG [80062be9] Infiniband verbs : no DEBUG [80062be9] epoll IO multiplex : yes DEBUG [80062be9] argp-standalone : no DEBUG [80062be9] fusermount : yes DEBUG [80062be9] readline : yes DEBUG [80062be9] georeplication : yes DEBUG [80062be9] Linux-AIO : yes DEBUG [80062be9] Enable Debug : yes DEBUG [80062be9] systemtap : yes DEBUG [80062be9] Block Device backend : yes DEBUG [80062be9] glupy : yes DEBUG [80062be9] Use syslog : yes DEBUG [80062be9] XML output : yes DEBUG [80062be9] QEMU Block formats : no ... INFO [a9e8de7e] Finished in 0.015 seconds with exit status 0 (successful).
![Page 40: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/40.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 40
capistrano-glusterfs
$ bundle exec cap staging gluster:pool:list INFO [201946fe] Running /usr/bin/env sudo -i gluster pool list on 192.168.200.101 DEBUG [201946fe] Command: sudo -i gluster pool list DEBUG [201946fe] UUID Hostname State DEBUG [201946fe] d185fa19-d1a1-489c-a653-4510122f5278 localhost Connected INFO [201946fe] Finished in 0.294 seconds with exit status 0 (successful). $ bundle exec cap staging glusterd:status INFO [cb482772] Running /usr/bin/env sudo -i /sbin/service glusterd status on 192.168.200.101 DEBUG [cb482772] Command: sudo -i /sbin/service glusterd status INFO [cb482772] Finished in 0.151 seconds with exit status 0 (successful). DEBUG [cb482772] glusterd (pid 25855) is running... INFO [cb482772] Finished in 0.151 seconds with exit status 0 (successful).
![Page 41: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/41.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 41
capistrano-glusterfs
$ bundle exec cap staging gluster:volume:help INFO [4628fd38] Running /usr/bin/env sudo -i gluster volume help on 192.168.200.101 DEBUG [4628fd38] Command: sudo -i gluster volume help DEBUG [4628fd38] volume info [all|<VOLNAME>] - list information of all volumes DEBUG [4628fd38] volume create <NEW-VOLNAME> [stripe <COUNT>] [replica <COUNT>] [device vg] [transport <tcp|rdma|tcp,rdma>] <NEW-BRICK> ... [force] - create a new volume of specified type with mentioned bricks DEBUG [4628fd38] volume delete <VOLNAME> - delete volume specified by <VOLNAME> DEBUG [4628fd38] volume start <VOLNAME> [force] - start volume specified by <VOLNAME> DEBUG [4628fd38] volume stop <VOLNAME> [force] - stop volume specified by <VOLNAME> DEBUG [4628fd38] volume add-brick <VOLNAME> [<stripe|replica> <COUNT>] <NEW-BRICK> ... [force] - add brick to volume <VOLNAME> DEBUG [4628fd38] volume remove-brick <VOLNAME> [replica <COUNT>] <BRICK> ... {start|stop|status|commit|force} - remove brick from volume <VOLNAME> DEBUG [4628fd38] volume rebalance <VOLNAME> [fix-layout] {start|stop|status} [force] - rebalance operations DEBUG [4628fd38] volume replace-brick <VOLNAME> <BRICK> <NEW-BRICK> {start [force]|pause|abort|status|commit [force]} - replace-brick operations DEBUG [4628fd38] volume set <VOLNAME> <KEY> <VALUE> - set options for volume <VOLNAME> ...
![Page 42: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/42.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 42
capistrano-glusterfs
capistrano-glusterfs is available here: https://github.com/keithseahus/capistrano-glusterfs
![Page 43: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/43.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 43
Tips 2 NFS Workloads
![Page 44: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/44.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 44
Tips 2: NFS Workloads
! Question 1: Do you mount GlusterFS in NFS?
![Page 45: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/45.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 45
Tips 2: NFS Workloads
! Question 1: Do you mount GlusterFS in NFS? ! Question 2: Which is your main workload, write or read?
![Page 46: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/46.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 46
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
![Page 47: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/47.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 47
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
TCP connection in gluster protocol
![Page 48: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/48.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 48
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache
![Page 49: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/49.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 49
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache
TCP connection in NFS v3
![Page 50: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/50.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 50
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache
read access to a file
![Page 51: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/51.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 51
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache
performance/io-cache
![Page 52: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/52.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 52
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscacheactivate cachefilesd
![Page 53: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/53.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 53
Tips 2: NFS Workloads
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
read files from its own RAM!
![Page 54: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/54.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 54
Tips 2: NFS Workloads
# NFS_SERVER=192.168.200.101 # MOUNT_POINT=/mnt/nfs
![Page 55: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/55.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 55
Tips 2: NFS Workloads
# NFS_SERVER=192.168.200.101 # MOUNT_POINT=/mnt/nfs # yum install -y cachefilesd
![Page 56: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/56.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 56
Tips 2: NFS Workloads
# NFS_SERVER=192.168.200.101 # MOUNT_POINT=/mnt/nfs # yum install -y cachefilesd # if test `grep 'SELINUX=disabled' /etc/selinux/config > /dev/null; echo $?` -ne 0; then sed -i 's/^secctx/#secctx/g' /etc/cachefilesd.conf fi
![Page 57: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/57.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 57
Tips 2: NFS Workloads
# NFS_SERVER=192.168.200.101 # MOUNT_POINT=/mnt/nfs # yum install -y cachefilesd # if test `grep 'SELINUX=disabled' /etc/selinux/config > /dev/null; echo $?` -ne 0; then sed -i 's/^secctx/#secctx/g' /etc/cachefilesd.conf fi # chkconfig cachefilesd on # service cachefilesd start
![Page 58: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/58.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 58
Tips 2: NFS Workloads
# NFS_SERVER=192.168.200.101 # MOUNT_POINT=/mnt/nfs # yum install -y cachefilesd # if test `grep 'SELINUX=disabled' /etc/selinux/config > /dev/null; echo $?` -ne 0; then sed -i 's/^secctx/#secctx/g' /etc/cachefilesd.conf fi # chkconfig cachefilesd on # service cachefilesd start # mount -t nfs -o fsc,vers=3 $NFS_SERVER $MOUNT_POINT
![Page 59: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/59.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 59
Tips 2: NFS Workloads
# free -m root@dev-centos:/root total used free shared buffers cached Mem: 996 926 69 0 32 579 -/+ buffers/cache: 314 682 Swap: 2015 0 2015 # ls /var/cache/fscache/cache/@4a/I03nfs/@7f/Jc0000000000000cG0I00/@8d/J1100000000000QFi24tY1EH900000000000M000000g00000100Kb000wFe000jt000oG3000000040000g000000000/ @01 @0d @13 @1b @22 @35 @40 @50 @58 @61 @6e @78 @87 @a7 @b3 @b9 @d1 @d7 @e6 @06 @10 @17 @1e @25 @3c @4d @52 @5d @63 @6f @81 @97 @a9 @b6 @c1 @d3 @dc @f1 @0a @11 @1a @21 @2b @3d @4f @57 @5f @66 @73 @82 @9a @ae @b7 @cc @d4 @de @fe # du -h /var/cache/fscache/cache/@4a/I03nfs/@7f/Jc0000000000000cG0I00/@8d/J1100000000000QFi24tY1EH900000000000M000000g00000100Kb000wFe000jt000oG3000000040000g000000000/ 186M /var/cache/fscache/cache/@4a/I03nfs/@7f/Jc0000000000000cG0I00/@8d/J1100000000000QFi24tY1EH900000000000M000000g00000100Kb000wFe000jt000oG3000000040000g000000000/
![Page 60: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/60.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 60
Tips 2: NFS Workloads
nodes: VirtualBox CentOS 6.4 x86_64 4 vCPUs, Core i7 2.4GHz 2GB RAM Striped SSDs
![Page 61: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/61.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 61
Tips 2: NFS Workloads
postmark 1.51 set size 1048576 10485760 set number 500 set transactions 1000 set location /mnt/nfs/rep2 set subdirectories 100 set read 8192 set write 8192 set buffering true
nodes: VirtualBox CentOS 6.4 x86_64 4 vCPUs, Core i7 2.4GHz 2GB RAM Striped SSDs
![Page 62: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/62.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 62
Tips 2: NFS Workloads
MB/sec (read)postmark 1.51 set size 1048576 10485760 set number 500 set transactions 1000 set location /mnt/nfs/rep2 set subdirectories 100 set read 8192 set write 8192 set buffering true
nodes: VirtualBox CentOS 6.4 x86_64 4 vCPUs, Core i7 2.4GHz 2GB RAM Striped SSDs
↓Oops...
![Page 63: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/63.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 63
Tips 2: NFS Workloads
Okay... but this is still a hypothesis. We need your feedback!
![Page 64: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/64.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 64
Tips 3 Logging
![Page 65: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/65.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 65
Tips 3: Logging
! Question 1: Do you monitor GlusterFS logs?
![Page 66: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/66.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 66
Tips 3: Logging
! Question 1: Do you monitor GlusterFS logs? ! Question 2: Do you utilize the logs?
![Page 67: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/67.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 67
Tips 3: Logging
! Question 1: Do you monitor GlusterFS logs? ! Question 2: Do you utilize the logs? ! Question 3: Do you use a log collector or aggregator?
![Page 68: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/68.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 68
Tips 3: Logging
![Page 69: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/69.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 69
Tips 3: Logging
I pick it up because: • easy to install • easy to configure • make unstructured logs structured • collect logs from multiple resources • output aggregated and structured
logs into a target as you prefer • easy to create a module • high performance • well maintained
![Page 70: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/70.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 70
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
![Page 71: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/71.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 71
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
Log server
![Page 72: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/72.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 72
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
Log server
![Page 73: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/73.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 73
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
Log server
![Page 74: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/74.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 74
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
Log server
![Page 75: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/75.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 75
Tips 3: Logging
peer 1
glusterfsd
brick brick brick brick
glusterd glustershd glusterfs
peer 2
d shd fs
fsd
b b b b
3 4 N
...
NFS Client
kernel
vfs/mnt/nfs
user app
page cache cachefilesd
/var/cache/fscache
Log server
![Page 76: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/76.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 76
Tips 3: Logging/etc/td-agent/td-agent.conf (on the log server)
<source> type forward port 24224 bind 0.0.0.0 </source> <match filtered.glusterd.**> type file path /home/keith/var/log/fluent/glusterd </match>
Today I will get the td-agent output the logs into a file.
![Page 77: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/77.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 77
Tips 3: Logging
<source> type tail path /var/log/glusterfs/usr-local-glusterfs-3.4.0beta2-etc-glusterfs-glusterd.vol.log pos_file /var/log/td-agent/usr-local-glusterfs-3.4.0beta2-etc-glusterfs-glusterd.vol.log.pos tag glusterd format /^(?:\[(?<date_ymd>[0-9]{4}-[01][0-9]-[0-3][0-9]) (?<time_hms>[0-2][0-9]\:[0-5][0-9]\:[0-6][0-9])\.(?<time_usec>[0-9]{6})\]) (?<log_level>[TDINWECA]) (?:\[(?<source_file_name>[^\[\]:/ ]*):(?<source_line>[0-9]*):(?<function_name>[^\[\]:/ ]*)\]) (?<component>[^\[\]:/ ]*)\: *(?<message>.*)$/ rotate_wait 5 </source> <match glusterd.**> type hostname key_name host add_prefix filtered </match> <match filtered.glusterd.**> type forward send_timeout 60s recover_wait 10s heartbeat_interval 1s phi_threshold 8 hard_timeout 60s <server> …
/etc/td-agent/td-agent.conf (on the GlusterFS peers)
Too complex to input and maintain!
![Page 78: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/78.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 78
Tips 3: Logging
![Page 79: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/79.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 79
Tips 3: Logging
You can specify log levels to forward.
![Page 80: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/80.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 80
Tips 3: Logging
You can specify each field name to output in JSON.
Comment out if you don't need the fields.
![Page 81: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/81.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 81
Tips 3: Logging
Parse error should be treated as a failure of fluent-plugin-glusterfs.
![Page 82: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/82.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 82
Tips 3: Logging
[root@glusterfs-unstable-01 plugin]# tail -3 /var/log/glusterfs/usr-local-glusterfs-3.4.0beta2-etc-glusterfs-glusterd.vol.log [2013-07-07 15:52:43.778961] I [socket.c:3495:socket_init] 0-management: using system polling thread [2013-07-07 15:52:43.779397] W [socket.c:514:__socket_rwv] 0-management: readv failed (No data available) [2013-07-07 15:52:43.779668] I [socket.c:2236:socket_event_handler] 0-transport: disconnecting now
[root@dev-centos ~]# grep glusterfs-unstable-01 /home/keith/var/log/fluent/glusterd.20130708.b4e0ed6e32655d35f | tail -3 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"778961","log_level":"I","source_file_name":"socket.c","source_line":"3495","function_name":"socket_init","component":"0-management","message":"using system polling thread","host":"glusterfs-unstable-01.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"779397","log_level":"W","source_file_name":"socket.c","source_line":"514","function_name":"__socket_rwv","component":"0-management","message":"readv failed (No data available)","host":"glusterfs-unstable-01.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"779668","log_level":"I","source_file_name":"socket.c","source_line":"2236","function_name":"socket_event_handler","component":"0-transport","message":"disconnecting now","host":"glusterfs-unstable-01.localdomain"}
It makes the logs structured in JSON.
![Page 83: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/83.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 83
Tips 3: Logging
[root@dev-centos ~]# grep glusterfs-unstable-01 /home/keith/var/log/fluent/glusterd.20130708.b4e0ed6e32655d35f | tail -3 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"778961","log_level":"I","source_file_name":"socket.c","source_line":"3495","function_name":"socket_init","component":"0-management","message":"using system polling thread","host":"glusterfs-unstable-01.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"779397","log_level":"W","source_file_name":"socket.c","source_line":"514","function_name":"__socket_rwv","component":"0-management","message":"readv failed (No data available)","host":"glusterfs-unstable-01.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"779668","log_level":"I","source_file_name":"socket.c","source_line":"2236","function_name":"socket_event_handler","component":"0-transport","message":"disconnecting now","host":"glusterfs-unstable-01.localdomain"}
[root@dev-centos ~]# grep glusterfs-unstable-02 /home/keith/var/log/fluent/glusterd.20130708.b4e0ed6e32655d35f | tail -3 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"759502","log_level":"I","source_file_name":"socket.c","source_line":"3495","function_name":"socket_init","component":"0-management","message":"using system polling thread","host":"glusterfs-unstable-02.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"759838","log_level":"W","source_file_name":"socket.c","source_line":"514","function_name":"__socket_rwv","component":"0-management","message":"readv failed (No data available)","host":"glusterfs-unstable-02.localdomain"} 2013-07-08T00:52:43+09:00 filtered.glusterd {"date_ymd":"2013-07-07","time_hms":"15:52:43","time_usec":"760057","log_level":"I","source_file_name":"socket.c","source_line":"2236","function_name":"socket_event_handler","component":"0-transport","message":"disconnecting now","host":"glusterfs-unstable-02.localdomain"}
The logs on each peer could be output in a single log file.
![Page 84: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/84.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 84
Tips 3: Logging
Also available on Gluster Forge: https://forge.gluster.org/fluent-plugin-glusterfs
![Page 85: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/85.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 85
Tips 3: Logging
More detailed explanation in Japanese is here!: http://www.nttpc.co.jp/company/r_and_d/technology/gluster_fs_fluentd.html
![Page 86: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/86.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 86
Conclusion
![Page 87: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/87.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 87
Conclusion
! Deployment automation tools are useful to install and operate GlusterFS on multiple nodes.
! With cachefilesd, NFS can might be more efficient under heavy read workload.
! Aggregating GlusterFS logs is easy enough and you can utilize them.
![Page 88: Gluster Cloud Night in Tokyo 2013 -- Tips for getting started](https://reader034.fdocuments.in/reader034/viewer/2022052620/55781353d8b42ab40c8b47e2/html5/thumbnails/88.jpg)
Copyright (C) 2013, NTTPC Communications, Inc. All Rights Reserved. 88 To contact us, e-mail here -> [email protected]