Using Improved Communication to Overcome Data Management ...
How to overcome data silos to achieve Big Data business transformation
-
Upload
ashnikbiz -
Category
Technology
-
view
164 -
download
1
Transcript of How to overcome data silos to achieve Big Data business transformation
![Page 1: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/1.jpg)
![Page 2: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/2.jpg)
![Page 3: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/3.jpg)
Agenda
• 4 Vs of Big Data and their impact
• Typical ‘Big Data’ landscape
• Considerations for tools
• How to start talking Big?
• How can Ashnik help?
![Page 4: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/4.jpg)
4 Vs of Big Data equation
• Velocity
• Volume
• Variety
• Veracity
![Page 5: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/5.jpg)
Impact of 4 Vs on technology
• Database
• Scale out architecture
• Data integration and enrichment
• Different shades of grey
![Page 6: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/6.jpg)
Typical Big Data Landscape
![Page 7: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/7.jpg)
Which tools can help you?
• Data Store – Postgres, MongoDB, Elastic, Couchbase, Hadoop
• Data Integration – Pentaho, Foreign Data Wrapper, Logstash
• Data Enrichment – Pentaho, Beats, Logstash
• Data Accuracy – Natural Language Processing (Python, R etc)
![Page 8: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/8.jpg)
Considerations for Data Store
• What data model?• Nature of queries - Correlation, Aggregation or more?• How Big is your Big Data?• Linking or embedding?• Real Time or Batch?• Cost per GB Vs Business Value?
![Page 9: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/9.jpg)
Considerations for Data Integration tools
• What are your data sources? - REST, RDBMS, noSQL, RSS...
• What connectors are available? - API call, ODBC, JDBC...
• Do you need much custom routines? - cleansing, filtering, modelingetc...
• What Data formats? - XML, JSON, Relational etc
![Page 10: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/10.jpg)
Considerations for Data Enrichment tools
• Final and intermediate data formats?
• Do you need to normalize/de-normalize?
• Do you need to add additional info? e.g. timestamp, user, sensor-id etc
• Do you need to change the format? e.g. XML to JSON
![Page 11: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/11.jpg)
Learnings from Early Failures
• Choose the right data-store
• Don’t build another Data warehouse - only larger
• Don’t end up with more Data Silos - only put together in one store
• Data must correlate and make business sense
![Page 12: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/12.jpg)
How to get you talking Big?
• Identifying business problem
• Overcoming data silos
• Integrating and co-relating the data from different sources
• Identify the queries - Analytics
![Page 13: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/13.jpg)
How can Ashnik Help you?
• We partner with different technologies• Vendor-independent consulting
• Bring the experience to your team• Database• Data Modelling• Integration
• End-to-end engagements• Consulting• Services• Training
![Page 14: How to overcome data silos to achieve Big Data business transformation](https://reader031.fdocuments.in/reader031/viewer/2022021923/5a648bae7f8b9a82568b49f9/html5/thumbnails/14.jpg)