1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi...

41

Transcript of 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi...

Page 1: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 2: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004

2 KAREN KANGAROO 5865 W OHIO AVE LAKEWOOD CO 80226

Page 3: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 4: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 5: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004

2 KAREN KANGAROO 5865 W OHIO AVE LAKEWOOD CO 80226

MARCIA K MARSUPIAL

9170 W 14TH AVE LAKEWOO

D CO 80226

KANGAROO

K

KAREN MARCIA KANGAROO 5865 W OHIO AVE LAKEWOO

D CO 80226

Page 6: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Page 7: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 8: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 9: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 10: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 11: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 12: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The
Page 13: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

MACHINE LEARNING

Introduction to HPCC Systems 13

Page 14: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 14

Page 15: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Machine Learning in Daily Life

Introduction to HPCC Systems 15

Page 16: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

HPCC SYSTEMS MACHINE LEARNING

Introduction to HPCC Systems 16

Page 18: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Using Machine Learning in HPCC Systems

Introduction to HPCC Systems 18

Page 19: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 19New York City Taxi Trips

Page 20: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 20

Had I known, I would book a cab earlier

Page 21: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Prediction

Introduction to HPCC Systems 21

NYC Taxi Data48 GB241M RECORDSJAN 2015 – JUN 201616 MONTHW/ WEATHER INFO

NOTE: The slides introduce you to a sample of the original dataset to keep the instructions simple and precise. The instructions to use the complete dataset is listed in the Appendix.

Page 22: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Data Ingestion

Introduction to HPCC Systems 22

Page 23: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Data Validation

Introduction to HPCC Systems 23

Page 24: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Data Profiling

Profile Result Example

Introduction to HPCC Systems 24

Page 25: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Data Enhancement

Introduction to HPCC Systems 25

Page 26: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Linear Regression

Introduction to HPCC Systems 26

Page 27: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 27

Linear Regression

Page 28: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 28

Linear Regression

Page 29: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 29

Linear Regression

Page 30: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Linear Regression

Introduction to HPCC Systems 30

Page 31: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 31

Page 32: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 32

Page 33: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 33

Page 34: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 34

Page 35: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 35

Page 36: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Logistic Regression

Introduction to HPCC Systems 36

Page 37: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

HPCC Systems KSU Hackathon 2019

Introduction to HPCC Systems 37

https://hpccsystems.com/hpccsummit2019

Page 38: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Before Hackathon

1. Register ECL Cloud IDE on Campus https://ide.hpccsystems.com/auth/login

2. Try the NY Taxi Trip Tutorial in ECL Cloud IDEhttps://github.com/lilyclemson/KSU_Hachathon2019

Introduction to HPCC Systems 38

Page 39: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

More Information

1. Introduction of HPCC Systems Machine Learning Library

2. HPCC Systems Machine Learning Library on Github

3. Myriad Interface Tutorial

4. HPCC-Systems-Summit-2019

Introduction to HPCC Systems 39

Page 40: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The

Introduction to HPCC Systems 40

Appendix

This tutorial is based on a sample set of the original data. For the complete information about the original tutorial, please see details in

below Github Repository

https://github.com/lilyclemson/Solutions-ECL-Training/tree/master/Taxi_Tutorial

Page 41: 1 MARCIA MARSUPIAL 6035 JONES ST ARVADA CO 80004 2 … · Introduction to HPCC Systems 21 NYC Taxi Data 48 GB 241M RECORDS JAN 2015 –JUN 2016 16 MONTH W/ WEATHER INFO NOTE: The