Ibm welcome and cognitive 20161020 v4
Transcript of Ibm welcome and cognitive 20161020 v4
05/03/2023 1
Jim Spohrer (IBM)San Jose, CA
Thursday October 20, 2016http://www.slideshare.net/spohrer/ibm-welcome-and-cognitive-20161020-v4
IBM Welcome & Cognitive Future
05/03/2023 2
IBM Research, Patents, Data, Cognitive
© IBM UPWard 2016
05/03/2023 3© IBM UPWard 2016
MachineLearning
NaturalLanguageProcessing
HighPerformanceComputing
KnowledgeRepresentationand Reasoning
QuestionAnswering
UnstructuredInformation
05/03/2023 Understanding Cognitive Systems 5
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
6
Brief History of AI
• 1956 – Dartmouth Conference• 1956 – 1981 Micro-Worlds• 1981 – Japanese 5th Generation• 1988 – Expert Systems Peak• 1990 – AI Winter• 1997 – Deep Blue• 1997 – 2011 Real-World• 2011 – Jeopardy! & SIRI• 2013 – Cognitive Systems Institute• 2014 – Watson Business Unit &• True North Brain Chip• 2015 – “Cognition as a Service”
on IBM Bluemix
Definitions: AI vs IA
05/03/2023 © IBM UPWard 2016 7
AI is Artificial Intelligence, orintelligence in machines (smart machines)
IA is Intelligence Augmentation, orpeople thinking and working together with smart machines.
IA is what IBM calls “Cognitive Computing” andthe smart machines are called “Watson Solutions” or
more generally “Digital Cognitive Systems (Cogs)”
Cognition as a Service (CaaS): AI building blocks for IA solutions
Augmenting Workers
05/03/2023 Understanding Cognitive Systems 8
05/03/2023 Understanding Cognitive Systems 9
Startup Companies
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
10
Cognitive Mediatorsfor all people in all roles
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
11
Occupations = Many Tasks
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
12
Watson Discovery Advisor
Simonite, T. 2014. Software Mines Science Papers to Make New Discoveries. MIT. November 25, 2014.URL: http://m.technologyreview.com/news/520461/software-mines-science-papers-to-make-new-discoveries/
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
13
User Models
05/03/2023 14
$5M Prize
© IBM UPWard 2016
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
15
I have…
Have you noticed how the building blocks just keep getting better?
05/03/2023 16
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access
05/03/2023 17
Societal Grand Challenges
© IBM UPWard 2016
Solving these would mean we are smarter, but would they mean we are wiser?
05/03/2023 18© IBM UPWard 2016
05/03/2023 19
High School Senior: Anish Krishnan
© IBM UPWard 2016
IBM in Silicon Valley:From Punch Cards….
05/03/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
20
On August 22, 1943, 105 men, women and children, among them 43 IBM employees, alighted from a special train that carried them across the continent to establish new homes and the new IBM Card Manufacturing Plant Number 5 at 16th and St. John Streets, San Jose, CA.
05/03/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
21
IBM in Silicon Valley:To Brain Chips….
05/03/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
22
23
Cognitive Build
What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)• Imagine a digital cognitive system to help you do
something important in your personal or professional lives• Team to design it and advocate for it, and then everyone
votes• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
05/03/2023 Understanding Cognitive Systems 24
Types
• Tool• Assistant• Collaborator• Coach• Mediator
05/03/2023 Understanding Cognitive Systems 25
Types: Progression of models and capabilities
05/03/2023 Understanding Cognitive Systems 26
Task & World Model/Planning & Decisions
Self Model/Capacity & Limits
User Model/Episodic Memory
Institutions Model/Trust & Social Acts
Tool + - - -
Assistant ++ + - -
Collaborator +++ ++ + -
Coach ++++ +++ ++ +
Mediator +++++ ++++ +++ ++
tool assistant collaborator coach mediator
Build: 10 million minutes of experience
05/03/2023 Understanding Cognitive Systems 27
Build: 2 million minutes of experience
05/03/2023 Understanding Cognitive Systems 28
Build: Hardware < Software < Data < Experience < Transformation
05/03/2023 Understanding Cognitive Systems 29
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
30
I have…
Have you noticed how the building blocks just keep getting better?
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
31
Learning to program:My first program
Early Computer Science Class:Watson Center at Columbia 1945
Jim Spohrer’s First Program 1972
05/03/2023 32© IBM UPWard 2016
Fast Forward 2016:Consider this…
05/03/2023 33
Microsoft CaptionBot June 19, 2016
© IBM UPWard 2016
05/03/2023 34
Microsoft CaptionBot June 20, 2016
© IBM UPWard 2016
05/03/2023 35
IBM Image Tagging
© IBM UPWard 2016
05/03/2023 36
Courses• 2015
– “How to build a cognitive system for Q&A task.”– 9 months to 40% question answering accuracy– 1-2 years for 90% accuracy, which questions to reject
• 2025– “How to use a cognitive system to be a better professional X.”– Tools to build a student level Q&A from textbook in 1 week
• 2035– “How to use your cognitive mediator to build a startup.”– Tools to build faculty level Q&A for textbook in one day– Cognitive mediator knows a person better than they know themselves
• 2055– “How to manage your workforce of digital workers.”– Most people have 100 digital workers.
05/03/2023 37
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
38
What exists in 2016?
360,000 100,000 120,000 60,000 150,000
05/03/2023 Understanding Cognitive Systems 39
Partnership for AI formed
05/03/2023 40© IBM UPWard 2016
05/03/2023 41© IBM UPWard 2016
What might Reality 2.0 look like?
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
42
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
43
05/03/2023 44
How fast is Reality 2.0 approaching?
What might it look like?
45
Computing: Then, Now, Projected
05/03/2023
2035
2055
“The best way to predict the future is to inspire the next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
05/03/2023 47
By 2035, T-Shaped Makers with great Building Blocks and Cognitive Mediators
Empathy & Teamwork
sectorregion/culture
discipline Dept
h
Breadth
STEM
Liberal Arts
05/03/2023 48
Reality 2.0 Service Platform:polite cognitive mediators (CM1,CM2)
do not interrupt people (P1,P2)
© IBM UPWard 2016
Service Platform
CM2
P2
CM1
P1
100x
100x 100x
05/03/2023© IBM 2015, IBM Upward University
Programs Worldwide accelerating regional development
49
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
50
Wise Service System:All entities’ in networkuse cognitive mediatorsto enhance value co-creation interactions
Cognitive Mediators:Cognitive systems with deep knowledge of both customer (user) and provider (expert)as co-creators of win-win value
Entity augmentation boosts both creativity and productivity of interactions
05/03/2023 51
Two assertions
• Machines seem to be getting smarter fast.
– Agree/disagree?
• People do not seem to be getting wiser fast.
– Agree/disagree?
© IBM UPWard 2016
Homo Sapiens means Wise Man: True/False?
05/03/2023 52
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access
05/03/2023 53
What is Industry 4.0?
© IBM UPWard 2016
05/03/2023 54
History of the idea: Mirror Worlds
© IBM UPWard 2016
05/03/2023 55© IBM UPWard 2016
Why is this relevant?
05/03/2023 56
I am still very skeptical… but tell me more….
© IBM UPWard 2016
05/03/2023 57© IBM UPWard 2016
05/03/2023 58
Managers: Courage Required….
© IBM UPWard 2016
05/03/2023 59
Talent required, but…
© IBM UPWard 2016
05/03/2023 60
Industry 4.0
© IBM UPWard 2016
05/03/2023 61
CyberPhysical Systems?
© IBM UPWard 2016
05/03/2023 62
Industry 4.0
© IBM UPWard 2016
05/03/2023 63© IBM UPWard 2016
05/03/2023 64© IBM UPWard 2016
Yesterday: Servitization
• Rolls Royce: “Power By The Hour”
Tomorrow: Servitization• Start with any traditional product that is sold to customers• Make the product part of a smart/wise service system
– Instrument it (sensors) – Internet of Things/Everything– Set-up an intelligent operation center to monitor all products’ performance
across their life-cycles– Use big data analytics to determine how to improve product performance,
efficiency, maintenance, etc.– Offer customer the “product-performance-as-a-service” with
financing/Internet of Service– Customer benefits from cost-savings, predictability– Provider benefits margin-improvements, predictability
• Every product becomes a platform technology (a vehicle for service innovation) for innovative university startups
Vision: MMaaRRSS
• Modular Manufacturing as a Regional Recirculation Service System– “I am the stuff that will be made into product X for
customer Y.”– Stuff = Material, Energy, and Information Flows – Minimize transport costs (for products and waste)
• The Vision: Circular Economy (~4 minutes)
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
68
In Summary
“A service scienceperspective considersthe evolving ecology of service system entities, their value co-creation andcapability co-elevationinteractions, and their capabilities, constraints,rights, and responsibilities.”
Cognitive SystemsEntities
Service SystemsEntities With
CognitiveMediators
Add Rights &Responsibilities
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
69
Explain external phenomena
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
70
Explain internal phenomena
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
71
Explainvalue co-creationphenomena
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
72
Physics Chemistry Biology
Neuroscience Psychology ArtificialIntelligence
Engineering Management PublicPolicy
Education Design Humanities
Natural Systems
Cognitive Systems
Service Systems
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
73
Sciences provide…• Frameworks for people to ask and answer
questions systematically• Explanations with instructions on “how to re-do”
Kline: Conceptual Foundation of Multidisciplinary Thinking -“To our children and children’s children, to whom we elders owe an explanation of the worldthat is understandable, realistic, forward-looking, and whole.”
Proenneke:Alone in the Wilderness -To do a thorough testing, should each generationbe required to rapidly rebuildfrom scratch? A re-makers movement?
Some paths to becoming 64x smarter:Improving learning and performance
• 2x from Learning sciences (methods)– Better models of concepts – Better models of learners
• 2x from Learning technology (tools)– Guided learning paths– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)– More you know, faster you go– Advanced organizers
• 2x from Lifelong learning (time)– Longer lives and longer careers– Keeps “learning-mode” activated
• 2x from Early learning (time)– Start earlier: Challenged-based approach– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)– Technology & Infrastructure Interactions– Organizations & Others Interactions
Next Generation:Future-Ready T-Shaped Adaptive Innovators
Many disciplinesMany sectors
Many regions/cultures(understanding & communications)
Deep in one sector
Deep in one region/culture
Deep in one discipline
05/03/2023 76
Future-Ready T-Shapes
© IBM UPWard 2016
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
77
Brief History of AI
• 1956 – Dartmouth Conference• 1956 – 1981 Micro-Worlds• 1981 – Japanese 5th Generation• 1988 – Expert Systems Peak• 1990 – AI Winter• 1997 – Deep Blue• 1997 – 2011 Real-World• 2011 – Jeopardy! & SIRI• 2013 – Cognitive Systems Institute• 2014 – Watson Business Unit &• True North Brain Chip• 2015 – “Cognition as a Service”
on IBM Bluemix
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
78
Cognitive Assistants for all occupations are beginning to appear
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
79
The Maker Movement & Open Source Ecology
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
80
Future of Skills
05/03/2023 81
T-Shaped “Future Ready” Talent
© IBM UPWard 2016
05/03/2023 82© IBM UPWard 2016
CSIG
Assisting individuals and organizations to close their service innovation skills gap
and co-create wiser service systems empowering employees, customers, citizens
with cognitive mediatorsin the collaborative service economy
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
84
Dedication: Doug EngelbartFather of the mouse and
augmentation theory
05/03/2023 85
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
05/03/2023 86
But this stuff is still really hard…
© IBM UPWard 2016
“The best way to predict the future is to inspire the next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
88
05/03/2023 Understanding Cognitive Systems 89
Cyber-Social-Learning-Systems
Jim Spohrer (IBM)August 29, 2016
http://www.slideshare.net/spohrer/csls-20160821-v1
05/03/2023 Understanding Cognitive Systems 90
Today’s Talk: Cyber-Social-Learning-Systems• What is the impact of Artificial Intelligence (AI) on CSLS?– Augmented Intelligence (IA) via digital cognitive systems– White House OSTP Response(s)
• Other topics to think about:– What are more of the implications of digital cognitive systems?
• Tool > Assistant > Collaborator > Coach > Mediator• Transformation > Experience > Data > Software > Hardware
– What does social intelligence require? Episodic Memory?– What is the impact of augmented reality on CSLS?– What are possible connections to service systems science
(SSME+DAPP)?– What type of adaptive innovator with growth mindset needed (T-
shapes)?
05/03/2023 Understanding Cognitive Systems 91
Augmented Intelligence
• Tool• Assistant•
Collaborator
• Coach• Mediator
05/03/2023 Understanding Cognitive Systems 92
White House OSTP Response(s)
• AI for public good• Social & economic implications• Education to harness AI• Research questions and gaps• Data sets and model sets• Multidisciplinary research• Role of incentives and prizes• Safety and control protocols• Legal and governance issues
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
93
In Summary
“A service scienceperspective considersthe evolving ecology of service system entities, their value co-creation andcapability co-elevationinteractions, and their capabilities, constraints,rights, and responsibilities.”
Cognitive SystemsEntities
Service SystemsEntities With
CognitiveMediators
Add Rights &Responsibilities
05/03/2023 Understanding Cognitive Systems 94
Backup Slides
• Understanding Cognitive Systems
05/03/2023 Understanding Cognitive Systems 95
Understanding Cognitive SystemsJim Spohrer (IBM), August 25, 2016
CSIG (Cognitive Systems Institute Group) Speaker Serieshttp://www.slideshare.net/spohrer/
understanding_20160825_v3
05/03/2023 Understanding Cognitive Systems 96
Today’s Talk: Understanding Cognitive Systems• What is a cognitive system (entity)?– biological– technological– types of digital cognitive systems
• How to…– build them?– understand them?– work with them?
• Steps toward a next generation cognitive curriculum…
05/03/2023 Understanding Cognitive Systems 97
But first…. Cognitive Science, a young field
• Society– cognitivesciencesociety.org
• People– Founders: Roger Schank, Donald Norman,
Allan Collins– Others: David Rumelhart, Herbert Simon, Allen
Newell– Today: Patrick Langley, Wayne Gray, Kenneth
Forbus, Ashok Goel, Paul Maglio, etc.• Systems Conference
– cogsys.org– (JCS wishes this was part of HICSS)
05/03/2023 Understanding Cognitive Systems 98
Advances in Cognitive Systems - cogsys.org
05/03/2023 Understanding Cognitive Systems 99
Google Search: August 26, 2016
05/03/2023 Understanding Cognitive Systems 100
Today’s Talk: Understanding Cognitive Systems• What is a cognitive system (entity)?– biological– technological– types of digital cognitive systems
• How to…– build them?– understand them?– work with them?
• Steps toward a next generation cognitive curriculum…
05/03/2023 Understanding Cognitive Systems 101
What is a cognitive system (entity)?
05/03/2023 Understanding Cognitive Systems 102
What is a digital cognitive system (entity)?
05/03/2023 Understanding Cognitive Systems 103
What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)– Imagine a digital cognitive system to help you do something
important in your personal or professional lives– Team to design it and advocate for it, and then everyone
votes– Winners: reduce waste and human suffering, screen for health
issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
05/03/2023 Understanding Cognitive Systems 104
Types
• Tool• Assistant•
Collaborator
• Coach• Mediator
05/03/2023 Understanding Cognitive Systems 105
Types: Progression of models and capabilities
Task & World Model/Planning & Decisions
Self Model/Capacity & Limits
User Model/Episodic Memory
Institutions Model/Trust & Social Acts
Tool + - - -Assistant ++ + - -Collaborator +++ ++ + -Coach ++++ +++ ++ +Mediator +++++ ++++ +++ ++
05/03/2023 Understanding Cognitive Systems 106
Build: 10 million minutes of experience
05/03/2023 Understanding Cognitive Systems 107
Build: 2 million minutes of experience
05/03/2023 Understanding Cognitive Systems 108
Build: Hardware < Software < Data < Experience
05/03/2023 Understanding Cognitive Systems 109
Understand them…
05/03/2023 Understanding Cognitive Systems 110
Work with…
05/03/2023 Understanding Cognitive Systems 111
Next generation cognitive curriculum
05/03/2023 Understanding Cognitive Systems 112
Backup slides
• Service systems - http://service-science.info/archives/3368
05/03/2023 Understanding Cognitive Systems 113
What is service science?
• IBM initiated effort to establish a multidisciplinary field to study service systems … with a focus on people-centered, IT-enabled service innovations for business and society– based on service-dominant logic– service = value co-creation– IT-enabled service architectures– service systems (socio-technical systems for
win-win value co-creation)• IBM helped establish
– computer science (1945-present)– service science (2005-present)
Service systems are dynamic configurations ofresources (people, technology, organizations,and information) interconnected byvalue propositions, internally and externally.
Examples:- macro: cities, states, nations- meso: hospitals, universities, businesses- micro: households, families, individuals
Reference:Spohrer J, Maglio P, Bailey J, Gruhl D (2007) Steps toward a science of service systems. IEEE Computer Society. 40(3):71-77(January).
05/03/2023 Understanding Cognitive Systems 114
What is service science?
• Now over 500 universities globally teach a more multidisciplinary approach to service innovation, including:– Service management and marketing– Service engineering and operations– Service design and arts– Service public policy and economics– Service computing and informatics
• SSME + DAPP = Service Science Management Engineering + Design Arts Public Policy– People, technology, organizations, information
interconnected by value propositions.
Reference:IfM & IBM (2008). Succeeding through serviceinnovation: A service perspective for education,research, business and government. University of Cambridge Institute for Manufacturing, Cambridge, UK. 2008.
05/03/2023 Understanding Cognitive Systems 115
How to get involved?
• Weekly speaker series– Service innovation– Service education & research– Smart service/cognitive systems
• Discovery summits & book series• Opportunities
– Institutional memberships– Leadership & ambassadors– Volunteer opportunities– Awards & sponsored conferences
ISSIP.org is a non-profit societyInternational Society of Service Innovation Professionals
Membership:Over 1000 professionals and students from 40+ countries, 50+ companies and 50+ universities.
05/03/2023 Understanding Cognitive Systems 116
How to get involved?
• Journals (INFORMS, etc.)
• Conferences (HICSS, etc.)
• Courses (MIT, etc.)• Funding (NSF, etc.)• Society (ISSIP, etc.)
05/03/2023 Understanding Cognitive Systems 117
What are the hot topics?
• Smart Service Systems: Intelligence Augmentation– AI + AR UX (Artificial Intelligence + Augmented Reality User
Experience)– Smartphones (mobile, social, secure, etc.)
• Collaborative Economy: Servitization– From assets to co-creation (e.g., Uber, AirBnB, etc.)– From product to capability/outcome-as-a-service– Manufacturing as a local recycling service
• Digital Transformation: Trust and Identity– Blockchain: Don Tapscott’s TED Talk & book– Big Data: Service Analytics & HAT (Hub of All Things)
05/03/2023 Understanding Cognitive Systems 118
Backups
• T-shaped people
Some paths to becoming 64x smarter:Improving learning and performance
• 2x from Learning sciences (methods)– Better models of concepts – Better models of learners
• 2x from Learning technology (tools)– Guided learning paths– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)– More you know, faster you go– Advanced organizers
• 2x from Lifelong learning (time)– Longer lives and longer careers– Keeps “learning-mode” activated
• 2x from Early learning (time)– Start earlier: Challenged-based approach– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)– Technology & Infrastructure Interactions– Organizations & Others Interactions
Next Generation:Future-Ready T-Shaped Adaptive Innovators
Many disciplinesMany sectors
Many regions/cultures(understanding & communications)
Deep in one sector
Deep in one region/culture
Deep in one discipline
05/03/2023 121
Future-Ready T-Shapes
© IBM UPWard 2016
05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development
122
Cognitive Assistants for all occupations are beginning to appear
05/03/2023 123
IBM Research – AlmadenSan Jose, CA USA
© IBM UPWard 2016
05/03/2023 124© IBM UPWard 2016
05/03/2023 © IBM Upaward 2016 125
05/03/2023 126
From App to Agent
© IBM UPWard 2016
05/03/2023 127
CognitiveBuild
© IBM UPWard 2016
05/03/2023 128
My Quest
• What is the best bot that anyone can easily install on their smartphone and laptop today?
© IBM UPWard 2016
05/03/2023 129
30th Anniversary Celebration
© IBM UPWard 2016
05/03/2023 130
IBM Cloud Bluemix:Watson APIs are growing…
© IBM UPWard 2016
So far (June 2016), 100,000 faculty and students globally given access