Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

12
Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014

Transcript of Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Page 1: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Rake’s Progress Revisited

Nada Ganesh and Fritz ScheurenWSS

September 24, 2014

Page 2: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Snacks and Knacks• About the Talk Title?• Application History First!• Information Theory too?• Raking’s Roles in Surveys?• Some Examples (Handout)?• More Snacks and Knacks?• Wraps and Conjectures!

Page 3: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Why Call Algorithm Raking?

• Maybe a Lofty Origin?• Perhaps a 1951 opera by

Stravinsky inspired by 1733-5 engravings by Hogarth• Or maybe a Humbler Origin!• The Dairy Farm Rake?• What is Your Guess?

Page 4: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Basic Raking Algorithm

• Repeated Ratio-ing “r’ of a (Weighted) sample total “t” to a control total “T as in “r=T/t”• Total by Total repeatedly until all

the adjusted sample totals “t” were as close as wanted to “T”

Page 5: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Application History First!

• The Pre-1940 Period• The 1940 Deming-Stephan AMS

Paper to align Survey/Census• Not Widely used in 1940 Census?

Because of WWII!• Regularly Forgotten/Recovered

Page 6: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Information Theory too?

• Kullback “Kully” and Ireland “Terry’s”Proof of Convergence• From Calculus a Bounded

Monotonic Series Converges• Information Theory Affirms this• When Constraints are Consistent

Page 7: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Raking’s Roles in Surveys?

• Aligning to Agreed upon Control totals – aka Calibration

-- Variance reduction -- Bias Correction MSE?• Hand-waving but Maybe harmful

Sometimes because unit based

Page 8: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

More Snacks and Knacks?

• Convergence Practices and Possible Improvements• Variable Bounds on Dimensions• Iterating Worst Dimensions First• Early/Differential Stopping Rules• “Family” Harmonic Adjustments

Page 9: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

More Application Settings • Chip Alexander and CPS/ACS• Survey and Administrative Linked

Files (CPS/IRS/SSA)• File Alignment before Raking?• Reducing Impact on Linkage Errors

(Maybe both Variance/Bias)

Page 10: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Two Examples

• Geometric Family Weight Example (Ganish)• Changing Convergence

Algorithm to Quicken Speed (Ganish)• Role for Synthetic Estimation

(Phil?)

Page 11: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Wraps and Conjectures!

• A Multi-Use Tool, Like Pliers• Computational Barriers long

since gone • More work on Diagnostics

needed though• More work on multiple weights

Page 12: Rake’s Progress Revisited Nada Ganesh and Fritz Scheuren WSS September 24, 2014.

Many, Many, Many Thanks