Adding Intelligence to Crowdsourced Estimate Data

7
Estimize Select Consensus Adding intelligence to crowdsourced data

description

Slides from the DataDrivenNYC presentation given on 9/18/13

Transcript of Adding Intelligence to Crowdsourced Estimate Data

Page 1: Adding Intelligence to Crowdsourced Estimate Data

Estimize Select ConsensusAdding intelligence to crowdsourced data

Page 2: Adding Intelligence to Crowdsourced Estimate Data

What is Estimize.com

Crowdsource fundamental estimates (EPS/Revenue)

Over 3,000 contributing analysts, 16,000 registered members, coverage of 930 stocks

Free open platform, we don’t use a give to get model

Sell full feed of data via API to quantitative hedge funds

Stack: MongoDB, Ruby, Backbone, Javascript

Page 3: Adding Intelligence to Crowdsourced Estimate Data

Crowdsourcing Is Scary

Agnostic regarding identity of contributors

Agnostic regarding contributor’s methodology

Reliability algorithm keeps bad data out of consensus

Estimate confidence scores weight select consensus

Page 4: Adding Intelligence to Crowdsourced Estimate Data

Demo

Page 5: Adding Intelligence to Crowdsourced Estimate Data

Estimate ReliabilityAll estimates go through a 3 step flagging process

Start by building an “error range” for each earnings report

Users are then warned when publishing estimates outside of range that estimate will be flagged

After estimate is submitted we build a flagging range for each user

Flagged estimates are not included in consensus, reviewed manually

Page 6: Adding Intelligence to Crowdsourced Estimate Data

Select ConsensusRun linear regression between accuracy and various attributes of an analyst and the estimate

Highest correlated: accuracy, difficulty, history, recency, bias

Normalized confidence score for each estimate is used to weight Select Consensus

Research done by Vinesh Jha using SAS, production implementation done by Brian Smith using Go