Smart Data HubOverview of service catalogue offer

Ali Belcaid © AB Advisory & Consulting 2014

Smart Data Hub

Data Subscription

What :

Regular scheduled custom data provision for a monthly fee with a setup charge.

This might include pricing data, lead generation data, research data. Monitoring

services for social media and websites. Market data collection.

How :

Scraping /parsing data, Vertical search and workflow setup for Data flow

Solutions :

Nutch, Scrapy, Solr, Elastic search… + Hadoop/Hbase/Mongodb/MySQL… for storage

Data Hub

What :

A collaborative platform for sharing, managing and analyzing your data. This might

be a standalone product where you carry out provision and analysis data

yourselves, or a joint endeavor where we source and analyze data with you.

How :

Single repository to manage data (external & internal)

Solution :

CKAN open source data repository.

Data Collection

What :

Data collection at scale through scraping external or internal resources with

transformation to formats for reuse.

How :

Scraping /parsing data and storage on targeted format

Solution :

Nutch, Scrapy, Solr, Elastic search… + Hadoop/Hbase/Mongodb/MySQL… for storage

Data Analysis

What :

Analysis, visualization and interpretation of data, either acquired through scraping

or ingested via more conventional means.

How :

Machine learning, NLP, custom models, statistics, algorithms, visualization, stories

telling…

Solution :

Knime, R, python, SQL, Hive, Pig, Spark, BI software (BO, Tableau, Qlikview),

Visual JS libraries (D3.js…)

Data Consulting

What :

sessions to help businesses understand methods in data collection, analysis and

management.

How :

Consulting services @ customer site or online

Solution :

Methodologies and best practices on how to gather, transform, analyze, visualize

data and interpret results and findings.