NUS-ISS Learning Day 2016 - Big Data Analytics
-
Upload
institute-of-systems-science-national-university-of-singapore -
Category
Data & Analytics
-
view
159 -
download
0
Transcript of NUS-ISS Learning Day 2016 - Big Data Analytics
![Page 1: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/1.jpg)
#ISSlearn
REAL-TIME ANALYTICS USING COUCHBASE + ELASTIC STACK
15 July 2016 / Francisco Liwa
1(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 2: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/2.jpg)
#ISSlearn
Real Time Analytics Using Couchbase + Elastic Stack
• What is Couchbase• What is Elastic Stack
- ElasticSearch- Kibana
2(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 3: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/3.jpg)
#ISSlearn
What is Couchbase
• A NoSQL DataBase• In-Memory• Scalable• Distributed System• Document-Store• Key-Value Store• JSON Format
3(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 4: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/4.jpg)
#ISSlearn
What is Elastic Stack
• Group of Application Software for Search and Analytics from the Elastic Company • Elastic Search• Logstash• Kibana• Filebeat• PacketBeat• Etc.
4(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 5: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/5.jpg)
#ISSlearn
What is ElasticSearch
• Multi-tenant , realtime and distributed search and analytics engine.• Opensource , Apache license 2• Unstructured search• Structured Search• Analytics• Full text search (lucene-based)
5(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 6: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/6.jpg)
#ISSlearn
What is Kibana
• Kibana is an open source analytics and visualization platform
• Designed for ElasticSearch
• Search, view, and interact with data stored in Elasticsearch indices
• Perform advanced data analysis and visualize your data in a variety of charts, tables, and maps.
6(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 7: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/7.jpg)
#ISSlearn
DEMO
SUBTITLE
7(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 8: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/8.jpg)
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• Hardware:2 Machines - 16 GB Memory / 160 GB Disk / SGP1 - CentOS 6.8
• prereq: Java: yum install java-1.8.0-openjdk.x86_64
8(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 9: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/9.jpg)
#ISSlearn
Real time Analytics Using Couchbase and Elastic Stack
• A. Setup NoSQL DB Cluster 1. setup Couchbase - http://www.couchbase.com/ 3.x Community edition - 128.199.86.160:8091 (password1.)• B. Setup Elastic Stack 2. setup Elasticsearch - https://www.elastic.co/
* https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3 3. setup Elasticsearch-head plugin - elasticsearch plugin for web front end (
https://github.com/mobz/elasticsearch-head ) http://localhost:9200/_plugin/head/http://188.166.214.126/ 4. setup KIbana - a web visualization tool from Elastic ( https://www.elastic.co/products/kibana )
Kibana 4.5 5 setup elasticsearch-couchbase transport plugin - couchbase transport plugin for elasticsearch
( https://github.com/couchbaselabs/elasticsearch-transport-couchbase) 6. INGEST DATA• (
https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-1-7-logstash-1-5-and-kibana-4-1-elk-stack-on-centos-7)
9(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved
![Page 10: NUS-ISS Learning Day 2016 - Big Data Analytics](https://reader031.fdocuments.in/reader031/viewer/2022022200/58aca89c1a28ab08588b4e27/html5/thumbnails/10.jpg)
#ISSlearn
THANK YOU [email protected]/[email protected]
10(Total Slides=8) T:\S-ITSM-F\OM\Module 1 v3.pptx © 2016 National University of Singapore. All Rights Reserved