zauberAgile Software Boutique + Social Media Products

5045DEVS+5DESIGNERS

PEOPLE

12COUNTRIES

CLIENTS FROM

INCLUDING: USA, BRAZIL, QATAR, MEXICO AND ARGENTINA

PALO ALTO OFFICE364 UNIVERSITY AV.

BUENOS AIRES OFFICECOSTA RICA 5546

GMT -3

GMT -8

BUILDW E

INTERNETAPPLICATIONS

CONSUMERWEBSOCKETS

TOUCH INTERFACES

COMPLEX ARCHITECTURES

BIG DATACOFFEESCRIPT

WEB JAVASCRIPTHIGH SCALABILITY

HTML5RUBY

CRAWLING APIS

TABLETS

MOBILE APPLE HIGs

APPS IOSANDROID JAVATESTFLIGHT

INFRASTRUCTURE AS CODEREAL TIME COMMUNICATION

NO SQL DATABASESSCALADEPLOY AUTOMATION

METRICS DRIVEN DESIGN

USEREXPERIENCE

USER TESTING PERSONASWIREFRAMING WEB DESIGN

SOLUTIONS

CREATORSPROUD

OF

BIG DATACASES

Online AdvertisingCASE I

Optimize revenue & eCPM

in realtime

Goal

Facts

✤ Increase CTR without losing revenue✤ Complex rules for serving ads✤ Response time < 50ms✤ 50GB+ worth of data per day✤ 500M+ impressions per day

Solution

✤ Hive✤ R and Python for data analysis✤ Analysis is done offline

Modeling:

Solution

✤ Highly Scalable✤ 500+ request/second on comodity

virtualized hardware✤ In memory data✤ Real time event processing and model

updating

Online Server:

Solution

✤ Java and Ruby✤ Redis✤ Voldemort✤ Kafka✤ Hadoop + Hive

Technology Stack:

Social Media AnalyticsCASE II

Goal

Monitor BrandsMonitor Public Opinion

Measure TV RatingPerform Market Research

Facts

✤ Data sources: Twitter, Facebook, RSS✤ 20GB+ processed / day (Twitter)✤ 180M+ Twitter profiles analyzed✤ Scales elastically✤ Real time analysis + Batch Analysis

Solution

DataGathering

Real TimeProcessing

BatchProcessing

DataAugmentation

Solution

✤ Acquires data from different sources✤ Fault tolerant✤ Uses Zookeeper for management✤ Stores raw data in S3✤ Queues data for real time analysis

Data Collection cluster:

Solution

✤ Powered by a Storm cluster✤ RabbitMQ as Input Bus✤ Augments data using AI cluster✤ Calculates statistics✤ Stores stats on MongoDB

Real Time Processing:

Solution

✤ Powered by a Hadoop Cluster✤ Calculates detailed statistics✤ Managed using Apache Oozie✤ Native MR jobs and Pig scripts✤ Augments data using AI cluster

Batch Processing:

Solution

✤ Performs language, location, gender, age detection

✤ Performs sentiment analysis✤ Uses NLP, IR and ML techniques✤ Exposed as a Rest API behind a load

balancer

Data Augmentation cluster:

Gracias!