02 Connecting Your Business With AI And Big...
Transcript of 02 Connecting Your Business With AI And Big...
![Page 1: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/1.jpg)
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Connecting your Business with AI and Big Data
Thomas Reske, [email protected]
![Page 2: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/2.jpg)
Why?
![Page 3: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/3.jpg)
Machine Learning &
Artificial Intelligence
Big Data
More Users Better Products
More Data Better Analytics
A Flywheel For Data
![Page 4: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/4.jpg)
How?
![Page 5: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/5.jpg)
Who are internal stakeholders?
![Page 6: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/6.jpg)
Interests
Data Architect Data Scientist Data Engineer
• Data quality• Structure• Governance• Data discovery• Security• Compliance• Long-term platform• …
• Data discovery• Data quality• Exploratory Analysis• Visualization• Building models• Scalability• Model discovery• …
• Integration• ETL• Scalability• Robustness• Delivery + Pipeline• Data platform• SDKs + APIs• Service endpoints• …
![Page 7: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/7.jpg)
Interests
Analyst Product/Program Owner Executive Management
• Discovery• Business models• Processes• Metrics + KPI• Monitoring• Reporting• Visualisation• …
• Cycle times• Flow and delivery• Roadmap• Learning• Costs• Friction• …
• Vision• Strategy• Innovation + Ideation• Time to Value• (R)Evolution• HRM + Talent• Collaboration• Costs• ...
![Page 8: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/8.jpg)
Challenges and Goals
Executive Management Harness artificial intelligence and machine learning to take and gain
(competitive) advantage
Data Architect Shape a compliant, secure data solution from which the firm benefits over the long term
Data Scientist Minimize plumbing and clean-up work and maximize value creationvia analyzing, building and evaluating models
Data Engineer Provide secure access to clean, easy-to-use data for a variety of consumers and building robust, scalable data pipelines
Analyst Dissect complex business problems and creatively identify use cases
for machine learning and artificial intelligence
Product/Program Owner Describe requirements and vision of the product and manage its complete lifecycle from inception to operations
![Page 9: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/9.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
![Page 10: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/10.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• ingestion and/or acquisition of data
• manage data storage, e.g. lifecycle policies
• data governance, e.g. ACLs or licensing
• …
![Page 11: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/11.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• scenario definition and problem formulation
• cast business problem as data science problem
• identify key metrics • discovery of data sources• …
![Page 12: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/12.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• assess strengths and limitations, e.g. reliability
• estimate “cost” of data• arrange data collection and
acquisition• initial cleaning and
matching data sources• surface and uncover
relation of data to business problem
• …
![Page 13: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/13.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• data manipulation and conversion, e.g. formatting
• infer missing values• normalization of data• addressing leakage issues• …
![Page 14: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/14.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• formulate, create and build model
• apply machine learning and data mining techniques and algorithms
• …
![Page 15: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/15.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• assessment of results and practicability
• test model and gain confidence
• review match with business needs
• “in vivo” evaluation and experiments
• sign-off• …
![Page 16: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/16.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• re-code for production• deployment of systems,
processes or procedures• monitor KPIs• ...
![Page 17: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/17.jpg)
Process
Business
Understanding
Data
Preparation
ModelingDeployment
Evaluation
Data
Understanding
Key Activities
• manage and optimize process lifecycle, e.g. reduce friction, cycle times and facilitate collaboration
![Page 18: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/18.jpg)
Key Points
• focus on common understanding of end-to-end
process, adjust appropriately• use model to gauge and assess maturity
• model serves well to describe vision (not mature) or to structure concerns and issues (very mature)
• not (necessarily) those that have the “smartest” people or algorithm succeed, but those that master the cycle
and process flow
![Page 19: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/19.jpg)
Technology
https://www.slideshare.net/AmazonWebServices/big-ddata-architectural-patterns-and-best-practices-on-aws
![Page 20: 02 Connecting Your Business With AI And Big Dataaws-de-media.s3-eu-west-1.amazonaws.com/images... · Data Preparation Deployment Modeling Evaluation Data Understanding Key Activities](https://reader034.fdocuments.in/reader034/viewer/2022042407/5f21f4e7494575295e14cc86/html5/thumbnails/20.jpg)
What will you build?