CS 597: Ph.D. Seminar - fall 2005 A Socio-Technical ...ilab.usc.edu/classes/2005cs597f/Lu CS597...

26
CS 597: Ph.D. Seminar - fall 2005 A Socio-Technical Foundation for Collaborative Engineering Professor Stephen Lu, Ph.D. David Packard Chair in Manufacturing Engineering Director, Product Development Engineering Program Founding Director, the IMPACT Research Laboratory University of Southern California Los Angeles, California USA October 17, 2005 – OHE 122

Transcript of CS 597: Ph.D. Seminar - fall 2005 A Socio-Technical ...ilab.usc.edu/classes/2005cs597f/Lu CS597...

  • CS 597: Ph.D. Seminar - fall 2005

    A Socio-Technical Foundation for

    Collaborative Engineering

    Professor Stephen Lu, Ph.D.David Packard Chair in Manufacturing Engineering

    Director, Product Development Engineering ProgramFounding Director, the IMPACT Research Laboratory

    University of Southern CaliforniaLos Angeles, California USA

    October 17, 2005 OHE 122

  • 2A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    ImprovingProductivity withAdvancedCollaborationTechnology

    Decision-makingProductivity ofEngineeringDesign Teams:

    quality speed cost

  • 3A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Key Points of This PresentationWith globalization, collaborative engineering (CE) is in!

    What is collaboration, and what is collaborative engineering?CE research needs a new intellectual foundation

    The determinism versus constructionism philosophyThe purely technical versus socio-technical paradigm

    Group decision is the key challenge of CE researchMany types of group decisionsA old myth of group decision making

    A socio-technical foundation (STF) for participative joint decisions in collaborative engineering (CE)

    Organization behavioral theory to model engineering teamsSocial construction theory to achieve common understandingSocial choice model to rate continuous alternativesCollaborative negotiation to support joint decisions

    STF/CE posts many challenging CS research questions

  • 4A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    What is Collaboration?Collaboration is a human Activity

    The Cultural and Historical Activity Theory (CHAT)Activity is the basic unit of analysis to study human endeavorSubject, Object, and Community

    Three types of Collaboration ActivityCoordination

    Uni-directional dependenciesCooperation

    Muti-directional dependenciesCo-construction

    Un-defined dependencies

    Level Oriented Towards Carried Out byActivity Motives (long-term) Community

    Action Goals (short-term) Individual (or united group)

    Operation Conditions Routinized human (or automated machines)

  • 5A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    What is Collaborative Engineering?Collaborative engineering is

    a socio-technical group decision-making process, whereby a team of engineers, who share a common commitment, engage in collaborative activities to:

    resolve conflicts, bargain for individual or collective advantages, agree upon courses of action,craft joint decisions that serve their mutual interests

  • 6A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Engineering Lifecycle Activities

    PartlyOverlap

    LargelyOverlap

    NoOverlap

    Product Opportunity GapIdentification/Understanding

    Concept Development

    Product Design

    Process Design

    Commercial Production

    Seq

    uen

    tial

    Engi

    nee

    rin

    g

    Degree of Concurrency(Activity Overlapping)

    Degree of Collaboration(Decision Coupling)

    Product Opportunity GapIdentification/Understanding

    Concept DevelopmentProduct DesignProcess Design

    Commercial ProductionCol

    labo

    rati

    veEn

    gin

    eeri

    ng

    Multiple stakeholders interactto make multiple decisions

    Multiple stakeholders interactto arrive at a single agreement

    Product Opportunity GapIdentification/Understanding

    Concept Development

    Product Design

    Process Design

    Commercial Production

    Con

    curr

    ent

    Engi

    nee

    rin

    g How do we make decisions forthese overlapping activities?

  • 7A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    An Old Myth of Group Decisions Arrows theorem of ImPossibility

    Kenneth Arrow proved the intransitivity of individual preferences to a group preference, which led to the traditional myth of group decision making.

    I a > b > c, and a > cII b > c > a, and b > aIII c > a > b, and c > b

    Individual Customer Preference Rankings

    Customers express their preferences via ordinal ranking of discrete alternatives

    Customer Decisions(when asked) a vs. b b vs. c c vs. a

    I a b aII b b cIII a c c

    Group Result a > b b > c c > a

    Democratic decision making (or social choice) by simple preference aggregations

  • 8A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Demystify the Old Myth!If group decisions are indeed irrational, then a true collaborative engineering is impossible

    let the leader to make autocratic individual decisionsBecome multi-objective, multi-attribute decision problems

    We challenge this old myth with a new approach

    JointIndividualDecision

    ParticipativeAutocraticStyleGroup Decision Making

    Socio-TechnicalPure-TechnicalParadigm

    Social Constructionism

    Scientific Determinism

    PhilosophyCollaborative Engineering

    New ApproachOld Thinking

  • 9A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Determinism vs. Constructionism

    Individual Group

    TraditionalEngineering

    Focus

    CollaborativeEngineering

    Focus

    N/AOur STF to

    CollaborativeEngineering

    Purely-Technical

    Socio-Technical

    A Old Myth of A Old Myth of GroupGroup

    Decision MakingDecision Making

    Determinism Any event can be rationally and precisely predicted, if a complete and accurate description of the event with all the needed laws of nature is given.

    Constructionism

    An idea which may appear to be obvious to those who

    accept it, but in reality is just a creation or artifact of

    a particular culture or society. Social constructs

    are human choices, rather than laws of the nature.

  • 10A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Traditional Technical Paradigm

    WHAT HOW?Engineering Decision Making

    WHAT HOW

    Engineering

    (WHY)(WHO)

    (WHY)(WHO)

    ??

    ?

    Marketing Service

  • 11A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    New Socio-Technical Paradigm

    Preference

    InteractionDynamic

    Collaborations

    ?Understanding

    SharedInterpretations

    PreferenceCollectiveChoices

    DecisionCollaborativeNegotiations

    WHAT(objective)

    HOW(decision)

    The TechnicalDimension ofEngineering

    WHO

    WHY

    The SocialDimension ofEngineering

    How can we integratethese two dimensionstogether scientifically?

    The Science Baseof Collaborative

    Engineering

  • 12A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Different Decision Making Styles

    Our Focus

    The Leader Decides1. Autocratic or directive style of problem solving2. Autocratic with group information input3. Autocratic with group's review and feedback4. Individual Consultative Style5. Group Consultative Style

    The Group Decides6. Group Decision Style (based on leaders definition)7. Participative Style (by all interested stakeholders)8. Leaderless Team

    CE research must support the Group-decide stylesClassical decision theory is only good for styles 1 5Our research is targeted at styles 6, 7 and 8

  • 13A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Individual vs. Group/Joint DecisionDECISION MAKING

    by Group

    (Interacting)

    by Individual

    (Unitary)

    Uncertainty &Risk Analysis

    Preference &Value Analysis

    Alternative-Focused Thinking

    Value-Focused Thinking

    DistributiveNegotiation

    IntegrativeNegotiation

    CollaborativeEngineering

    Non-repeatingGame

    RepeatingGame

    ConcurrentEngineering

    JointSingle

    Decision

    (Negotiation Analysis)

    InteractingMultiple

    Decisions

    (Game Theory) Descriptive Prescriptive Normative

    (Decision Analysis) (Behavioral Study)

    Sole or Multiple Decision(s)

    TRADITIONAL ENGINEERING LIFE-CYCLE ENGINEERING

  • 14A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Socio-Technical Paradigm for CEThe Social Dimensionof Engineering Design

    DecisionCollaborativeNegotiations

    WHAT HOW

    WHO

    WHY

    The Technical Dimensionof Engineering Design

    The Socio-TechnicalDesign Paradigm

    InteractionDynamic

    Collaborations

    UnderstandingShared

    Interpretations

    PreferenceCollectiveChoices

  • 15A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Alternative Theories and Models

    New Approach

    (HOW)Decision

    (WHY)Preference

    (WHAT)Understanding

    (WHO)Interaction

    New Paradigm and Procedure:

    Collaborative Win-win Negotiation Framework

    and Analysis

    Classic Decision Analysis, and Game Theoretic Approach

    JointDecision

    Cardinal Rating with Spatial Continuous Social Choice Model

    Ordinal Ranking with Discrete Social Choice

    Models

    GroupPreference

    Social Construction Theory with Dynamic

    Perspective

    Self-Interested Rationality with Static

    Perspective

    SocialInteraction

    Modern Organizational Man in Small Teams

    with Incentives

    Neo-Classical Economic Man in

    Open Large Groups

    TeamBehavior

    Current ApproachThe Nature and the Modeling of:

  • 16A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Economic vs. Organizational ManEconomic Man (and Rational Man)

    Based on neoclassical economic theory (and decision theory)Economic Man has a complete/consistent system of preferences to choose correctly among entire set of available alternatives

    all the alternatives of choice are given,all of the consequences of each alternatives are known, anda complete utility ordering for all possible set of consequences

    Organizational ManBased on modern organization theory (Simon, Cyert, March)

    While Economic Man optimizes, Organizational Man satisfices to look for a course of action that is satisfactory or good enough

    choice is always exercised with respect to limited resources, time, information, and approximate model of the real situation, andthe elements of alternatives are not given but are the outcome of a psychological and sociological processes, including the choosers own activities and the activities of others in the choosers environments

    Our research is based on organizational behavior theorysatisficing and bounded rationality

  • 17A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Social Construction of RealitySocial construction of reality is an interactive and dynamic process of socially shape an agreement and/or artifact by a group of interested stakeholders

    Interpretive FlexibilitySC (e.g., CE) results are always under-determined

    Relevant Social GroupAll members of a social group share the same set of meanings (i.e., interpretations) attached to a specific design

    Closure and StabilizationThe SC process continues until all conflicts are resolved, and the artifact no longer posts a problem to any relevant social group

    Wider ContextBackground conditions of social interactions matter

    We use this process to achieve a common understanding among team members

    Preferences are expressed w.r.t a common understanding

  • 18A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Spatial Social Choice ModelGroup preference can be rational and consistent

    Ordinal rankings of discrete alternatives of individual preferences leads to the Arrows paradox of group decisionsOrdinal ratings of continuous (spatial) alternatives of individual preferences can result in rational and consistent procedures of aggregating preferences of many to a group preference

    Spatial model of social choice draws on concepts from geometry, real analysis, and topology to describe the set of continuous alternatives of individual preferences

    Alternatives are drawn from an ordered set, represented by points in a continuum

    Our CE research is based on ratings of continuous alternatives of individual preferences

    Rating contains richer preference information than rankingIt is possible to obtain spatial social choice models (i.e., ratings of continuous alternatives) for most engineering problems

  • 19A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Collaborative Engineering via Negotiation (ECN)with a consistent group preference

    ECN

    1. Individual Analysis: each party thinks alone to decide their respective BATNA organizational behavior theory

    2. Communal Analysis: two parties get together to establish their initial ZOPA social construction theory

    3. Mutual Exploration: both parties jointly explore maximal technical feasibilities social construction theory

    4. Establish Preference: parties jointly & collaboratively establish a value structure spatial social choice model

    5. Initial Agreement: parties locate initial agreements along the Efficient Frontier within the negotiation feasibility region

    6. Joint Co-construction: parties work together to dynamically and collaboratively modify their previously constructed value structure to improve initial agreements

    7. Collective Invention: parties collaboratively probe each others knowledge to expand, or invent, new technical feasibilities for even more improved agreements

    8. Collaborative Innovation: parties simultaneously perform Steps 6 and 7, which is the ultimate goal of ECN

  • 20A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    ECN: a Graphical Example

    Reliability (by Engineer A)

    Aes

    thet

    ics

    (by

    Eng

    inee

    r B)

    (a) (X3a,Y3a)

    (1)(2)

    (3)(4)

    (1)(2)

    (3)(4)

    (X3.5aY3.5a)(b)

    (X5bY5b)(X4bY4b)

    GroupIndifferenceCurvesTechnical

    FeasibilityCurves

    IncreasingWin-WinNegotiationAgreements

  • 21A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    ECN: Dynamic Control SystemCombined dynamical system underboth external & internal controls

  • 22A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    ECN: Socio-Technical Construction

    PMSD (Perspective Model State Diagram) for each concept in the Concept Structure (V)

    ot p

    o1

    t1 t2

    p1 o2

    o21p11

    p12

    t21t12

    PT3

    o2

    o

    t po1

    t1 t2

    p1

    o2

    o21

    p11

    p12

    t21t12p12

    t121

    PT4

    ot p

    o1

    t1 t2p1

    o2

    PT2

    ot p

    o1t1

    Concept Structure(of the Design Campaign)

    (III)

    Long-term(Enterprises)

    Middle-term(Organizations)

    a3a1 a2 a4

    a5a6

    a7

    Baseline Process(from the application domain)

    (I)

    T1 T2 T3

    Time

    T4Activity

    ChangeProcess

    ModifyConcepts

    EvolvePerspectives

    PT1

    Perspective Model @t(of the participating

    Stakeholders -- S)

    (IV)

    Perspective Analysis

    (VI)

    Conflict Management

    (VII)

    Shared Reality

    SharedConcepts

    Shared Perspectives

    Product Model

    Near-term(Design Campaign)

    (VIII)S1

    S2S3

    Stakeholder(II)

    PMSD (Perspective Model State Diagram) for each concept in the Concept Structure (V)

    ot p

    o1

    t1 t2

    p1 o2

    o21p11

    p12

    t21t12

    ot p

    o1

    t1 t2

    p1 o2

    o21p11

    p12

    t21t12

    ot p

    o1

    t1 t2

    p1 o2

    o21p11

    p12

    t21t12

    PT3

    o2

    o

    t po1

    t1 t2

    p1

    o2

    o21

    p11

    p12

    t21t12p12

    t121

    o

    t po1

    t1 t2

    p1

    o2

    o21

    p11

    p12

    t21t12p12

    t121

    o

    t po1

    t1 t2

    p1

    o2

    o21

    p11

    p12

    t21t12p12

    t121

    PT4

    ot p

    o1

    t1 t2p1

    o2

    ot p

    o1

    t1 t2p1

    o2

    ot p

    o1

    t1 t2p1

    o2

    PT2

    ot p

    o1t1

    ot p

    o1t1

    ot p

    o1t1

    Concept Structure(of the Design Campaign)

    (III)

    Long-term(Enterprises)

    Middle-term(Organizations)

    a3a1 a2 a4

    a5a6

    a7

    Baseline Process(from the application domain)

    (I)

    T1 T2 T3

    Time

    T4Activity

    ChangeProcess

    ModifyConcepts

    EvolvePerspectives

    PT1

    PT1

    Perspective Model @t(of the participating

    Stakeholders -- S)

    (IV)Perspective Model @t(of the participating

    Stakeholders -- S)

    (IV)

    Perspective Analysis

    (VI)

    Conflict Management

    (VII)

    Shared Reality

    SharedConcepts

    Shared Perspectives

    Product Model

    Near-term(Design Campaign)

    (VIII)S1

    S2S3

    Stakeholder(II)

  • 23A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    ECN: Computing the Consensus

    Dendrogram for singlelinkage cluster analysis

    L2

    diss

    imila

    rity

    mea

    sure

    0

    .670309

    3 4 5 1 2 6 7

    ),...,1(),,...,1(),max(),( , srji njnidsrd =

    [ ]=

    +=g

    kkjkijkikji xxxxd

    1

    22, )()(

    F o r tw o p e r s p e c t iv e m o d e ls t o w a rd a c o n c e p t :

    [ ] = =

    +=R

    r

    g

    kkjrkirjkrikrji xxxxd

    1 1

    22, )()(

    F o r tw o s ta k e h o ld e r s p e r s p e c t iv e t o w a rda g ro u p o f c o n c e p t s :

    Dendrogram for singlelinkage cluster analysis

    L2

    diss

    imila

    rity

    mea

    sure

    0

    .670309

    3 4 5 1 2 6 7

    ),...,1(),,...,1(),max(),( , srji njnidsrd =

    Dendrogram for singlelinkage cluster analysis

    L2

    diss

    imila

    rity

    mea

    sure

    0

    .670309

    3 4 5 1 2 6 7

    ),...,1(),,...,1(),max(),( , srji njnidsrd =

    [ ]=

    +=g

    kkjkijkikji xxxxd

    1

    22, )()(

    F o r tw o p e r s p e c t iv e m o d e ls t o w a rd a c o n c e p t :

    [ ] = =

    +=R

    r

    g

    kkjrkirjkrikrji xxxxd

    1 1

    22, )()(

    F o r tw o s ta k e h o ld e r s p e r s p e c t iv e t o w a rda g ro u p o f c o n c e p t s :

    [ ]=

    +=g

    kkjkijkikji xxxxd

    1

    22, )()(

    F o r tw o p e r s p e c t iv e m o d e ls t o w a rd a c o n c e p t :

    [ ] = =

    +=R

    r

    g

    kkjrkirjkrikrji xxxxd

    1 1

    22, )()(

    F o r tw o s ta k e h o ld e r s p e r s p e c t iv e t o w a rda g ro u p o f c o n c e p t s :

    Figure 6: Mathematical Relations for Computing Perspective Distances and Cluster Analyses

  • 24A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Summary of Research Journey

  • 25A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    The BIG Picture Whats for CS?

    STF/CESTF/CE

    SupportingScience

    DecisionScience

    CollaborativeJoint

    DecisionMaking

    ValueFocusedDecision

    AnalyticalTechniques

    SocialScience

    SocialConstruction

    of Reality

    ActivityTheory

    TheoreticalFoundations

    ManagementScience

    NegotiationPractice

    OrganizationTeamwork

    PracticalGuidelines

    InformationScience

    ArgumentNegotiationProtocols

    CSCWMulti-agentModelingFrameworks

    Example Areaof Research

  • 26A Socio-Technical Foundation for Collaborative EngineeringStephen Lu 2005

    CS597 Ph.D. Seminar, fall 2005

    Organization by Focus/Foci (CS)