EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin...

23
EXPLORING THE DATA Alfatihah Reno Maulani - Statistics Indonesia STATISTICS INDONESIA

Transcript of EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin...

Page 1: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

EXPLORING THE DATA

Alfatihah Reno Maulani - Statistics Indonesia

STATISTICS INDONESIA

Page 2: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

IT DIVISION

Alfatihah Reno MNSPM

Amanda PratamaPutra

Ignatius Aditya Setyadi

Amin Rois SinungNugroho

Wa Ode ZuhayeniMadjida

Page 3: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

SUBJECT MATTER

Hamim TsalisSoblia Agus Ruslani

Panca DwiPrabawa

Dini Arifatin

MOBILITY STATISTICS

TOURISMSTATISTICS

Page 4: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

WHY BIG DATA

1.916 million km²; 264 million people; 16000 BPS’s staffs; >200 surveys per year

Page 5: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

INDONESIAN LOCAL ADMINISTRATIVE UNIT (LAU)

1.916.862,20 km²

Page 6: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

INDONESIAN LOCAL ADMINISTRATIVE UNIT (LAU 1)

34 Provinces16.056 islands

Page 7: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

INDONESIAN LOCAL ADMINISTRATIVE UNIT (LAU 2)

514 Kabupatens7.230 Kecamatans83.438 Kelurahans

Page 8: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

WHY TELKOMSEL

• ±140 million customers with identified home locations• Staypoint data• ±1,4 Terabyte/year• ± 60 billion rows of data

Page 9: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

MOBILE PHONE DATA SAMPLE

x_1

• Hashed MSISDN

Datetime

• Transaction timestamp

Source

• Type of data stored (CDR, signalling)

Lat & Long

• The BTS Coordinates

Page 10: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

LAU MATCHING

Page 11: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

DATA CLEANING

Using latitude longitude data, we can measure distances of origin and

destination

Using date and time, we can measure duration of the movements.

1. Fast Movers2. Overlapping stays 3. Resetting stays at

midnight4. Faulty stay locations

Page 12: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

PATTERN OF MOBILITY

Using local administrative units (LAU), we can know the movements between regions.

• Travel refers to the activity of someone who moves between different geographic locations for any purpose and any duration.

• Group of travel to various places produce a trip.

• A trip is defined as the travel by a person from the time of departure from his usual environment until he returns.

(United Nations, 2010)

Page 13: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

ORIGIN DESTINATION MODEL

Page 14: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

HOME AND OFFICE DETERMINATION

Select the maximum duration from subscriber’s work

candidates as “OFFICE LOCATION”

S T A R T

09.00 – 16.59Weekday only

Sum the duration of subscriber’s work candidates

(6 months data)

E N D

Select the maximum duration from subscriber’s home

candidates as “HOME LOCATION”

S T A R T

17.00 – 08.59 Weekday + Weekend

Sum the duration of subscriber’s home candidates

(6 months data)

E N D

Page 15: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

HOME DETERMINATION EXAMPLE

Home: 17.00 – 08.59 weekday + weekend

Work: 09.00 – 16.59 weekday only

Select the maximum duration from subscriber’s home

candidates as “HOME LOCATION”

S T A R T

17.00 – 08.59 Weekday + Weekend

Sum the duration of subscriber’s home candidates

(6 months data)

E N D

Page 16: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

COMMUTER AND CIRCULAR

Commuter Circular (monthly)

Circular (weekly)

Page 17: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

RESULT

Page 18: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

TRIP DETERMINATION

Page 19: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

TRIP DETERMINATIONFOR TOURISM

Page 20: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

TOURISM

Page 21: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

TOURISM

Page 22: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

TOURISM

When using MPD, you also have to recognize common habits in using the mobile phone that applies in your country, so you can get the best parameters to design the algorithm to be used.

Page 23: EXPLORING THE DATA - ESCAP...Alfatihah Reno MNSPM Amanda Pratama Putra Ignatius Aditya Setyadi Amin RoisSinung Nugroho WaOde Zuhayeni Madjida SUBJECT MATTER HamimTsalis Soblia Agus

Thank you

[email protected]