THE MAKING OF ANON TRADITIONAL
BUSINESS INTELLIGENCE SUITE
Andrea Alberici, Tea Tavanxhiu
Studio Synthesis Srl
Data Smiths
Business Process Analysts
CRM consultants
IT - Legal consultants
Data Scientist? It’s a mindset, not a name
DATA SMITH
For me being a scientist is a mindset, not a qualification. It’s the mental attitude and aptitude to take on and solve problems through a process of hypothesis and experimentation. […]
What matters is the desire for knowledge and understanding, even better if you’re of the mindset that you want to share it with everyone afterwards
Paul Banoub - Vizninja
DATA SMITH
CREATE TOOLS
Red line: Business
needs
Revenues
N. companie
s
Standard software(consumerization)
Big System Integrators
Filling the gaps
Blue line: N. of companies
SETTING THE STAGE
DATA SMITH
For me being a scientist is a mindset, not a qualification. It’s the mental attitude and aptitude to take on and solve problems through a process of hypothesis and experimentation. […]
What matters is the desire for knowledge and understanding, even better if you’re of the mindset that you want to share it with everyone afterwards
Paul Banoub - Vizninja
New trends in BI
Tableau Software, 2014http://www.slideshare.net/TableauSoftware/top-ten-bi-trends-for-2014
New trends in BI
Big data finally goes to the sky
Predictive analytics, once the realm of advanced and specialized systems, will move into the mainstream
Agile business intelligence extends its lead
The end of data scientists
Cloud business intelligence goes mainstream
Embedded business intelligence begins to emerge in an attempt to put analytics in the path of everyday business activities
Storytelling becomes a priority
Mobile business intelligence becomes the primary experience for leading-edge organizations
Organizations begin to analyze social data in earnest
NoSQL is the new Hadoop
What we «realized» on our experience
Agile business intelligence extends its lead. Self-service analytics becomes the norm at fast-moving companies. Business people begin to expect flexibility and usability from their dashboards. And the monolithic infrastructure stack finally crumbles in favor of solutions that can work with new data sources
The end of data scientists. Data science moves from the specialist to the everyman. Familiarity with data analysis becomes part of the skill set of ordinary business
users, not experts with “analyst” in their titles.
Embedded business intelligence in the path of everyday business activities, begins to emerge in an attempt to put analytics in them. Analytics start to live inside of transactional systems. Scenarios like customer relationship management will lead the way with analytics providing support for the many small decisions salespeople make in a day.
Storytelling becomes a priority as people realize that a dashboard deluge without context is not helpful. Stories become a way to communicate ideas and insights using data. They also help people gain meaning from an overwhelming mass of big and disparate data
BI ARCHITECTURE
TRADITIONAL BI
ETL
DWH
REPORTING
HIGH COSTS – MONOLITHIC INFRASTRUCTURE
PROBLEMS OF TRADITIONAL BI
Applying a new perspective• The Metadata Layer is the application
itself• An innovative approach to ETL• Agile BI using a flat table• Queries in the hands of business
users• Embedded presentation layer• Reporting in the hands of business
users
ANOTHER APPROACH
The chosen application is a CRM System in its origins: coreBOS (fork of vtigerCRM, Sugar CRM)
WHY?
FLEXIBLE BY NATURE
METADATA LAYER
The transformations are mainly done at application level
HOW?
EASY (FLAT) IMPORTMASSIVE ACTIONS ON ENTITIESTRIGGERS FOR FINE GRANULARITY
LOOK MA, NO ETL!
We normalize data on single flat views (or we use OLTP Data directly)
HOW?
NEW TECHNOLOGIES (specifically columnar databases)
(BIG) FLAT TABLES vs STAR SCHEMA
NO SQL IN A SQL DATABASE (!)
HOW?
FILTERS AND QUERY BUILDERS EMBEDDED IN THE APPLICATION
QUERIES IN THE HANDS OF BUSINESS USERS
The Presentation Layer LIVE in the application itself
It was born to satisfy the need for CRM Operative analytics
PRESENTATION LAYER – EMBEDDED BI
In turn, also the Adhoc reporting is part of the Presentation Layer
HOW?
We created a portal that «lives» upon queries created by users in order to create self service data analysis tools
REPORT CREATION IN THE HANDS OF BUSINESS USERS
ARCHITECTURE
NON TRADITIONAL BI
Evolutivo Analytics: the family
• CoreBOS (Linux, Php, Apache, MySQL)• Jquery – Kendo UI – dhtmlx• Node.js – REST webservices• TokuDB, InfiniDB• Memcached, APC• Respond CMS• toolbox.evolutivo.it
TOOLS THAT MAKE IT HAPPEN
Metadata- ive Modularity- Master-detail structure
NO-ETL Approach- Import wizard- Entity management framework:
Data cleaning Massive editingMassive Actions
Technical Side - columnar database
- Materialized Views
- continuous data change
- custom script reports
Presentation LayervtApps
report/listviews
Drill down
query builder interni e on-demand- Query Builder
- Persistent Views
AD HOC Reporting- Materialized View Creator
- Vtapp Creator
- BI Server (Toolbox Companion)
- Vtapp Form Creator
- Mail report engine
Top Related