1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II...

49
1 Outbri ef IW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference Center MacDill AFB, Florida Final Outbrief for SOCOM NATO UNCLASSIFIED

Transcript of 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II...

Page 1: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

1

OutbriefIW II

Chair: Renee G. Carlucci, CAA

Co-Chair: Don Timian, ATEC

MORSIrregular Warfare IIAnalysis Workshop

3 - 6 February 2009Davis Conference Center

MacDill AFB, Florida

Final Outbrief for SOCOM

NATO UNCLASSIFIED

Page 2: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

2

OutbriefIW IIAgenda

Overview

Tutorial and Plenary Session

Observations

Key Issues and Discussion Items

Gaps

Recommendations

Page 3: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

3

OutbriefIW IITitle: Irregular Warfare Analysis WorkshopOrganization

–3-6 Feb 09, held at SECRET/REL to AUS/CAN/GBR/USA level at MacDill AFB, Tampa, FL–Program chairs: Ms. Renee Carlucci, Mr. Don Timian, and LTC Clark Heidelbaugh–5 Working Groups: Global Engagement; Stability, Security, Transition, and Reconstruction (SSTR); Information Operations (IO)/Psychological Operations (PSYOP)/Social Sciences; Counterinsurgency (COIN); and Thinking Models About IW;

–Synthesis Group

Objectives–To frame the toughest IW problems that SOCOM and DoD are facing–To bring special operators, analysts, and problem solvers together to help define IW analysis problems, explore techniques to deal with these problems, identify what has worked and not worked, and determine recommended ways ahead

Context–Changing strategy with greater emphasis on Irregular Warfare (NDS, QDR, IW JOC, etc.)–Continuing emphasis on building partnership capacity (BPC Roadmap, TSC, etc)–Limited policy, process, tools and methods for Irregular Warfare activities–Focus on partnering operators with analysts and problem solvers to gain operator perspectives

Scope: –Military dimension of conflict in Phases 0-5 of DoD’s campaign planning construct–Tools/methods, algorithms, historical/current data sources, on-going analysis, opportunities for collaboration on future analysis and tool development

Overview

Page 4: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

4

OutbriefIW II Tutorial, Plenary, and Keynote Speakers

Irregular Warfare Joint Operations ConceptMr. Jeffery (Gus) Dearolph, Deputy Director Internal,SOCOM J10

Lessons from the Irregular Warfare Methods, Models, TechniquesCOL Jeff Appleget, TRAC

Summary of Improving Cooperation Among Nations for Irregular Warfare Analysis WorkshopDr. Al Sweetser, Director, OSD-PAE SAC

Operational DesignLTC Reb Yancey, SOCOM SORR-J8-Studies

Sponsor’s WelcomeMr. E. B. Vandiver III, FSDir, Center for Army Analysis

Keynote SpeakerMr. William J. A. Miller Dir, Strategy, Plans, and Policy, SOCOM

Page 5: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

5

OutbriefIW II Irregular Warfare Joint Operations Concept

Mr. Dearolph There is continuing friction with the IW definition across

Services, agencies, interagency, and among allies There is a lack of grand strategy and a failure to understand

population Key IW factors are: indirect, enduring, persistent, proactive,

population-centric, respect of legitimate sovereignty linked to over-arching strategy

Consists of :– Key missions (e.g., FID, UW, COIN, CT, Stab Ops)– Key activities (e.g., Strategic communications, IO, PSYOPS,

Intel, Counter- intel, Support to law enforcement)

IW Military Leadership– JFCOM for General Purpose Forces (GPF)– SOCOM for Special Operations Forces (SOF)

Page 6: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

6

OutbriefIW IILessons from the Irregular Warfare

Methods, Models, TechniquesCOL Jeff Appleget

“IW focus is on the population” “COIN” is the Key when insurgents exert more influence on

local populations than the national government” IWMmAWG Study established a 7-element framework

– Identified 35 gaps, 34 related to data and social sciences Analytical Approach

– Now, Top-down, Western perspective (DIMEFIL-PMESII)– Soon, Bottom-up employing social sciences expertise– Track strategic level Methods, models, Tools (MmTs)

Iterative development of “key data” is central Over-all needs

– Create credible, relevant MmTs to address decision maker issues– Make social scientists integral members of the analysis team

Continue community-wide dialogue through IW Working Group

Page 7: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

7

OutbriefIW II Improving Cooperation Among Nations for Irregular Warfare

Analysis Workshop (NPS)Dr. Al Sweetser, Director, OSD-

PAE SAC

There is value having international participants from many different nations

Emphasized importance of “Whole of Government“ approach

Useful to conceptualize the problem as “Complex Adaptive Systems” (e.g., act, react, re-react,…)

Consider a hybrid approach (e.g., wargame – model – wargame)

Page 8: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

8

OutbriefIW II Systemic Operational Design (SOD)LTC Reb Yancey, SOCOM J8-

Studies IW is a “wicked problem” Akin to relearning COIN analysis approaches (Vietnam / Iraq) SOD employs a structured method of inquiry that enables a

commander to:– Make sense of a complex situation– Capture understanding– Share the resulting visualization

SOD is a method of inquiry, is based on discourse, creates a learning system

Requires accepting humility and valuing heresy Means challenging the information and the boss To deal with a dynamical complex system, one needs to

explore the interactions among the key parts (“hermeneutics’)

Page 9: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

9

OutbriefIW II Keynote SpeakerMr. William J. A. Miller, SOCOM Dir, Strategy, Plans, & Policy,

“IW is about populations”

In analyzing IW issues, a Lanchester view is not useful

“Behave” not kill our way to victoryShape vs. exploit, synthesis not analysis, transforming is satisfising whereas solutions are optimizing, presence changes the problem

Be as “un-wrong” as can be in conceptualizing a global perspective on issues

Globalization challenges and threats to the US—Migration, Crime, Extremism

SOCOM Challenges: Be up-stream (leverage), turn down the heat (affect), engage in dialogue with senior decision makers

Page 10: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

10

OutbriefIW IIWorking Group Observations

The working groups (WG’s) were highly partitioned by their titles and topics areas (tough to find overlap)

WG’s employed from 4 to 9 presentations in their sessions—a total of 30 different workshop presentations

WG’s ranged in size from 16 to 50 members—the “modeling IW WG” had the highest numbers

WG’s recognized that they have more challenges and tasks then they can handle in a three-day workshop

WG’s have heart and intellectual energy but are limited by clock time and “soak time”

WG’s would like to “sit in” on other working groups (series vs. parallel information meetings)

Page 11: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

11

OutbriefIW IIGeneral Observations

We are still struggling with the exact meaning and breadth of irregular warfare (bounding and characterization)

We are not familiar with the agencies that understand or have jurisdiction for DIMEFIL and PMESII

“Models and Tools” do not equal “computer programs and computer models”

Wargaming with the right players offers a powerful technique for discovery

Graphics in a storyboard approach has a prominent place in IW for displaying and understanding influences

Everyone is talking about data, its definition, its meaning, its form, who is collecting it, processing it, and storing it

No consensus on what information does exist, should exist or who is or should be responsible—regardless, the complexity of the situation transcends the data

VV&A is still the topic on IW models and data

Page 12: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

12

OutbriefIW II WG 1:Global EngagementFindings/Recommendations

WG1: Global Engagement Charter: Provide recommendations on appropriate analytical techniques to prioritize, plan, and assess Theater Security Cooperation activities to assist the COCOMs in addressing the analytical challenges that they currently confront.

Key Questions:– (1) How should objectives and indicators be structured? – (2) How does an assessment division with four to ten people measure and maintain the

baseline? – (3) How can you determine the right activities to support partner nations while making the most

progress towards desired end-states? – (4) Is it possible to measure cause and effect in a complex system? – (5) What is missing from this process?

Takeaways:– Many of the effects are potentially unquantifiable (and will remain so). The challenge

remains informing decision makers given this constraint.– Interagency analytical resources can assist and are essential– Don’t just accept objectives or rush to create them. Need to focus on shaping objectives

as well as measuring progress. Reframe.– IW analysis will affect traditional analytical paradigms

» Messy data, Cause & Effect, No easy “one-size-fits-all” toolset

– Effective Security Cooperation exceeds the boundaries of DoD’s authorities and capabilities

Page 13: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

13

OutbriefIW II

Analysis Method Description Examples

Quantitative data Collection of input/output data associated with activities and generic country indicators

•TCSMIS database•Country indices on corruption, economic growth, security etc.

Polling and surveys Public opinion or opinion of targeted groups

• View of the U.S. before and after USNS Comfort port visit

Content Analysis Survey popular media for identified themes

• Failed States Index (Fund for Peace)

Expert Opinion Subject Matter Expertise and Focus Groups

•TSC Working Group•Objective identification

Modeling/ Simulation and Gaming

Simplified representation of a complex system

• COMPOEX (PACOM)

Assessment Techniques

Baseline

Trends

Forecasting

Page 14: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

14

OutbriefIW IIActivities (14 engagement tools)

1. Combined/Multinational Education

2. Combines/Multinational Exercises

3. Combined/Multinational Experimentation

4. Combined/Multinational Training

5. Counter/Non-Proliferation

6. Counter Narcotics Assistance

7. Defense & Military Contacts

8. Defense Support to Public Diplomacy

9. Facilities & Infrastructure support projects

10. Humanitarian Assistance

11. Information Sharing/Intelligence Cooperation

12. International Armaments Cooperation

13. Security Assistance

14. Cross-Cutting Programs

Page 15: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

15

OutbriefIW IIWG1 Findings-- Suggestions

Q1.How should objectives and indicators be written, structured and prioritized?

Ideally, a comprehensive set of metrics should be identified, where that is not possible indicators should be MOE rather than MOP.

Beware, decomposition can be endless. “If you can’t measure the objective then you have no objective!”

Involvement of the analyst in structuring the specific language used in objectives is essential. It must mean something analytically. Embed analyst in the strategy division?

SME qualitative indicators. Are they valid and consistent between different experts? May not be able to trend the data, there will be limits here. Prefer something that is quantitative but don’t take judgment out of the process.

Consider prioritizing indicators, on basis of which are most important, not by which are easiest to collect. (Embedded analyst can assist).

Don’t forget to re-evaluate what indicators you are using. Iraq experience of looking at MOP rather than MOE to assess progress. And reframe the problem at the objective level, reprioritize when necessary, goals should be achievable.

Page 16: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

16

OutbriefIW IIWG1 Findings-- Suggestions

Q2. How should a baseline be established and maintained?

Identify the indicators before looking for data, this allows you to identify gaps in the data you collect.

– Have to put effort into thinking about inclusive measures – no laundry list– End states & steady-states.

Use, wherever possible, existing government or reliable data sources. Be aware of the origin of data where sources may not be reliable.

– Be aware of dangers of active verses passive data collection– Some indicators useful for forecasting, others not. There will be some

universal measures, such as child mortality rates which will be good indicators across a range of objectives.

Aggregate diverse data elements into composite index. Will show trends.– Need correct SMEs to interpret the data. Most data will be messy.– If you measure too often you may affect the system.

If you can’t present your data reliably you’ve failed. Map background and cartographic display and trends work well. For stop-light charts define criteria.

Page 17: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

17

OutbriefIW IIWG1 Findings-- Suggestions

Q3. How should developing partner nations’ security forces be evaluated and supported?

Focus on sustainability (institutional change, 15 years)– Trust and confidence– Build the professional military education school house before going out on the rifle

range– Target/create/instill/develop the cadre of professionals

Assessment methods for building security institutions– Defense Resource Management Study Project (DRMS) difficult to implement for

under-developed institutions– Comprehensive baseline surveys must be conducted. E.g. U.S. Country Team or

SOF site survey. Consider host nation’s security forces – not just military.– Can we do that with other U.S. government institutions? Authorities and treaties

are issues. Other allies where required.

Assessment measures must be tailored to each country’s unique security requirements, authorities and situation

– Existing U.S. assessment measures may be considered for establishing baseline or appropriate framework

– A negotiation on suitable role/end-state for each partner nation’s forces– Leverage capacity of other allies to help build regional capacity– You don’t necessarily need a U.S. level of performance to be successful

Page 18: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

18

OutbriefIW IIWG1 Findings-- Suggestions

Q4. How would you begin to address analyzing cause and effect?

Can’t easily get to cause and effect. Is measuring effect enough for the COCOMs to make good decisions?

– Without cause and effect how do we build models?– Need to be realistic about the level of perfection that can be achieved, “better than

a coin toss” may be an appropriate standard

Make more structured use of SMEs– Use techniques to add scientific rigor to SME contributions: pair-wise comparison,

gaming, structured interviews, role-playing, value focused thinking, – SME selection remains important, encourage diversity of opinion - groupware– Try and think through to potential second & third order effects

Other techniques that may be valuable– Historical analysis, electronic markets, risk-consequence management– Near real time data required for insights on causal relationships.– Modeling needs to be issue specific, at least initially. Need to be able to look

under the hood (no black boxes, we need insights not just answers)

Need to understand the lag between action and response in the system– System dynamics– What is the ideal refresh rate for indicators and reframing objectives? It may be

different from one indicator or objective to the next.

Page 19: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

19

OutbriefIW IIWG1 Findings-- Suggestions

Q5. What is missing from the process?

Consider the link between the indicators required for the baseline and measuring the effects of activities. Is there a common set?

Activity Identification is immediately resource constrained– Need to identify unconstrained requirement to estimate risk– Where in the process do we do the risk evaluation?

Policy incentives to encourage regional development– NATO was a strong incentive for development

Stronger links between COCOMs and OSD/ PA&E and Policy – Understanding resource constraint earlier in the process will

assist with assessing IPL requests and creating new authorities, policies and funding vehicles.

Design new engagement tools to meet regional security challenges

Potential misalignment of assessment resources to assessment requirements – Continue to prioritize objectives and indicators.

Page 20: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

20

OutbriefIW II WG 2:Stability OperationsFindings/Recommendations

WG2: Stability Operations Charter: Identify SO challenges and problem areas to be solved and identify analytical methods that might help solve those areas

Critical Insights:– No single method, model or simulation will provide complete answer, but

many can provide results to help inform decisions in one or more areas.– Several of the tools can be used immediately and many under development

have promise.– Identification of metrics is absolutely critical.– Identification and collection of relevant data is difficult but must be done.

Key Takeaways– Though Stability Operations is only a part of Irregular Warfare, it still presents a large

problem space– Challenge areas presented by different agencies had some common threads:

Determination of demand/requirements,Prioritization of efforts/risk management, Determination/use of metrics, Attaining “whole of government” approach

– Many challenge areas are not adequately addressed by current analytical methods, models, and techniques

– Many promising methods, models, and techniques are in development

Page 21: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

21

OutbriefIW II Working Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity / Impact Difficulty with Solutions

1. Foreign Security Forces

<USSOCOM>

Need a coherent plan for building and training Foreign Security Assistance (SFA) Forces.

Supply of forces may not be available to meet demand from COCOMs.

Coordination with interagency elements is inadequate.

2. Identification of SFA Requirements (missions, etc.)

<USSOCOM>

Need to understand and identify the demands driving SFA requirements.

Related to challenge area above, need to identify demand to plan resources and schedule training.

-Need clarification by identifying total US govt demand and then identifying DOD piece.

3. Prioritization of SFA Requirements

<USSOCOM>

- Need tools/methods to prioritize SFA activities.

Each COCOM has high priority requirements but not enough resources to fill needs.

Who has authority to prioritize between COCOM requirements?

4. Personnel Tracking <USSOCOM>

Determine and track training, skill sets, and experience relevant to SO.

Some missions may require special skills or experience. Who has them?

- Need more than skill identification. - Consider implications for career path .

Page 22: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

22

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

5a. Information prep of the Operational Environment

<IDA>

Determine what needs to be done within each sector.-Determine causes/fixes.-Reconstruction reqts for self-governance.- How to recognize when “self-governing” achieved

Without this info, resources may be misapplied or inappropriate actions may be taken.

Who has responsibility for this?

Different agencies have different perspectives.

Needs must be relevant the host nation.

5b. Information prep of the Operational Environment

<IDA>

Determine potential partners and what they can do.-Affected govt/society.-Int’l partners (donor nations, humanitarian, financial org, non-govt). -USG agencies.

Without this information, inefficient or ineffective efforts may result.

Who has responsibility for leading or coordinating this effort?

Page 23: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

23

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

5c. Information prep of the Operational Environment

<IDA>

Determine how to achieve unity of effort.-Collaborative and Cooperative architectures.- Public diplomacy and strategic communications.

Without unity of effort, inefficient or ineffective efforts may be initiated that fail to meet needs and waste resources. This sends negative message to host nation.

Information sharing is hindered by lack of common terminology and political issues.

5d. Information prep of the Operational Environment

<IDA>

Determine how to measure progress toward achieving objectives.-Quantitative metrics-Qualitative metrics.

Without proper metrics to measure progress, no way exists to determine whether certain projects or interventions are working or remain appropriate.

Need prior identification of goals/objectives

When is “good enough” achieved?

Page 24: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

24

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

6. What capability and capacity does DOD need for sectors other than security?

<OSD SOLIC>

-DOD is both supported and supporting agency for SO, therefore must know what is needed. -What factors should be considered when prioritizing support?-Need metrics to evaluate performance.

Supply of forces of appropriate type may not be available to meet demand from COCOMs.

- Requires decisions and guidance outside DOD. -“Restore” is relatively clear, but “support” is more open-ended

7. Security Force Assistance

<OSD SOLIC>

- Need to identify overall SFA demand. - Need process to identify and prioritize SFA needs of partners- Need metrics to evaluate performance.

Meeting overall demand has implications for SOF/GPF and AC/RC Mix.

Page 25: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

25

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

8. Lethal and non-lethal capabilities

<PKSOI>

Must use mix of methods to set conditions supporting other instruments of power.

Must establish security for progress but not totally alienate relevant populations.

Non-lethal capabilities are more than rubber bullets and tear gas.

9. How should the military support reconstruction and stabilization policy and strategy?

<PKSOI>

This requires actions in Doctrine, Organization,Training, Materiel, Leadership, Personnel and Facilities.

This could be a significant resource issue. Leaders must be able to make informed decisions.

Need to clearly understand other agencies capabilities and intent with respect to this area.

10. How do information and info ops support and nest within stability operations?

<PKSOI>

Information operations and strategic communications must be informed by data and send consistent messages.

Inconsistent or late info ops and strategic comms make US look bad and can be exploited by rivals and opposition media.

Can problem be solved analytically?

Page 26: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

26

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

11. Do the joint and service task lists sufficiently address the range of activities required to conduct joint stability operations?

<PKSOI>

Must ensure unit missions and Mission Essential Task Lists are updated and that doctrine and training are appropriate.

Supply of forces of appropriate type and capability may not be available to meet demand from COCOMs.

-Army and Joint Task lists recently reviewed as part of Army’s SO Capabilities Based Assessment.-Must review other service task lists.

12. Is the military’s current approach sufficient for operations where the focus is on “relevant populations” and not an enemy force? <PKSOI>

This requires actions in Doctrine, Organization,Training, Materiel, Leadership, Personnel and Facilities.

This could be a significant resource issue. Leaders must be able to make informed decisions.

-Must be able to identify status of military’s ongoing efforts to assess.-Can problem be solved analytically? -How do you measure “sufficient” approach?

Page 27: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

27

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

13. How do we best determine appropriate MOEs and MOPs for full spectrum operations?

<PKSOI>

Must identify Metrics that cover range of sectors, include strategic to tactical level, cover immediate response , transition, and sustaining efforts. Can they be modeled and simulated

Without proper metrics to measure progress, no way exists to determine whether certain projects or interventions are working or remain appropriate.

-Can metrics be modeled and/or simulated?-If some metrics are “qualitative” how do you evaluate?

14. How does the military support emerging security initiatives and DOD policy on Security Sector Reform?

<PKSOI>

Must identify how support requirements change with changing policies in this area.

This could be a significant resource issue. Leaders must be able to make informed decisions.

Page 28: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

28

OutbriefIW IIWorking Group # 2 Challenge Areas

Challenge Area<Source>

Description Severity \ Impact Difficulty with Solutions

15. How does the US military’s approach nest within the emerging body of interagency, intergovernmental, and allied approaches to reconstruction and stabilization?

<PKSOI>

Must identify how force requirements change with changing approaches in this area.

This could be a significant resource issue. Leaders must be able to make informed decisions.

Can problem be solved analytically?

Page 29: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

29

OutbriefIW II Working Group # 2 Methods, Models, Simulations

Method\Model\ Simulation <Agency>

Description Areas addressed Current Status

1. Integrated Gaming System

<TRAC FLVN>

-Flexible definition of infrastructure and factions.-Stochastic.

-Faction satisfaction.-Infrastructure status.-Military impacts.-Operational insights.

In use.

2. PSOM <UK DSTL/JS J8>

- Strategic and Operational level training assessment.-Social Behavioral response.- Stochastic \ Deterministic.

-High level pol/mil.-Gain insights on operational impacts of high level decisions and resource allocations.

In use.

3. Nexus Network Learner

<OSD PA&E>

-Societal Assessment-Bayesian .- Stochastic.- Agent Based.- Modular. - Adaptive to data and other models.

-Assess DIME impact (different COAs) on social changes. - Examine modification of behavior.

In use with continuing development.

Page 30: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

30

OutbriefIW II

Method\Model\ Simulation <Agency>

Description Areas Addressed Current Status

4. Primary Force Estimator (PRIME – ATLAS model)

<CAA>

- Task based using approved rules of allocation.- Includes geospatial considerations.- Quick turn results.- Deterministic.

Army forces only. Under development.

5. Wargaming <CAA>

- Human in the loop board game method.- Focused on Security.- Regional and overall Theater focus.

-Assess force levels required to respond to different levels of violence.-Integration with other DIME aspects of campaign.

-Established and in use.-Expansion of capabilities underway.

Working Group # 2 Methods, Models, Simulations

Page 31: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

31

OutbriefIW II

Method\Model\ Simulation <Agency>

Description Areas Addressed Current Status

6. Task Event Outcome (TEO) IW Analysis

<TRAC >

- Tactical focus.- Human in the loopWargame.-Quick turn around.-Ties in to Lines of Effort (LOE)

- Analyze changes in organization equipment and TTP.-Identify required changes in MOE (different metrics).- Capture, analyze and disperse experience/ information gained in the field.-Link actions to LOE to higher PMSEII states.

Requirements under development.

7. Workshops <CAA>

- Provides an established structure to examine non-quantitative issues.-SME-based.-Senior level reviews.

-Investigate a wide variety of issues related to stability operations.

Available and in use.

Working Group # 2 Methods, Models, Simulations

Page 32: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

32

OutbriefIW IIMethod\Model\ Simulation <Agency>

Description Areas Addressed Current Status

8. Contingency Operations Tiger Team (COTT)

<USACE \ TRAC>

-Provides recommendations relating to USACE and ERDC R&D, analysis and studies for reconstruction, stability, contingency, aid, and relief efforts.

- Understand challenges and build collaborative solutions to complex problems in reconstruction and stability efforts.-Develop, identify, and validate potential R&D solutions to strategic and mission-level stability and reconstruction challenges.-Link capabilities from different sources or programs.

COTT formed, collaborations being established.

9. Agent-based model for cultural geography in SO

<COTT/USACE/TRAC>

- Stochastic- Agent Based- Stand alone tool- Tactical focus

- Provide evaluation of impact of SO infrastructure projects on social perceptions.

Under development.

Working Group # 2 Methods, Models, Simulations

Page 33: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

33

OutbriefIW IIWorking Group # 2 – Session 2 Assessment

(A)=Available Tool

Method 1 2 3 4 5 6 7 8 9 (A) (A) (A) (A) (A) (A)Challenge IGS PSOM NEXUS PRIME WAR

GAMETEO WORK

SHOPCOTT ABM

1. SFA plan X X2. SFA demand X X3. SFA priority X4. SFA skill tracking5a. Sector Needs X X X X X5b. Partner capability X5c. Unity of effort X X5d. Sector Metrics X X X X X X6. Sector needs X X X X X X7. SFA demand X X8. Lethal/non-lethal X X X X X X X9. Support to policy X X X X X10. Nest info opns X X X X X X11. Task lists sufficient X X X X12. Focus on Population X X X X X X X13. MOE & MOP X X X X X14. New policy X X X15. USG, allied & NGO approach X X X X X

Page 34: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

34

OutbriefIW IIWG2 Findings & Suggestions

♦ Findings:– −Even though everyone agrees that Stability Operations requires

whole of government, non-government, coalition, and host nation/public participation, most of our methods, models, and techniques do not account for all of them

– −It appears that many of the challenge areas are indirect results of an absence of overarching strategies and goals

– −It is hard to understand how some tools, methods, and models work without common terms of reference – the same is true for data

♦ Suggestions:– −Develop common terms of reference for understanding how

tools, methods, and models work and for describing data– −Ensure future collaboration efforts continue and expand to

include the entire SO community-of-interest

Page 35: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

35

OutbriefIW II WG 3:IO/PSYOP/SocSciencesFindings/Recommendations

WG3 Charter: Improve the foundations of information operations /PSYOP analysis; identify existing analytic capabilities and shortfalls; explore the application of quantitative and qualitative methods for improving analytical capabilities; evaluate and recommend concrete applications.

Key Takeaways:– A coherent taxonomy and lexicon of IO is required: Analysts and

operators must use the same set of definitions – Models, methods, and tools must provide mechanisms for learning,

understanding of the problem, not prediction– Coordinate PSYOP across related combined, joint, and inter agency

arenas– Develop robust case studies which capture a full problem set to greatly

benefit exercises, education, and training– Non-kinetic assessment (MOP, MOE) must be in the initial plan– Key gaps in PSYOP capabilities must be resolved by other means

(traditional social sciences, ORSA approaches may assist): Red teaming, Evolutionary development of M&S, Enhanced Wargaming (Phase 0), Human terrain and media analysis

Page 36: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

36

OutbriefIW IIAnalytic Design Issues

How do we appropriately choose models methods and tools for OD in PSYOPS?

– Generic tools that can be fine-tuned to the situation through social

– discourse (like the MpiCE project – Measuring Progress in Conflict Environments which provides a list of MOEs for organization’s SMEs to choose from to tailor to specific situation).

– Develop different solutions that you can test

– Know the TYPE of your problem

– Test and compare using same data sets

– Get a conformal standardized data set What disciplines should be on the team? How do we choose the right

ones and access them?

– Analytic Ability/skills regardless of field

– Open-minded and able to work across disciplines

– Familiar with both military and OD process

– Have both field and background analysis capabilities

Page 37: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

37

OutbriefIW IIAnalytic Design Issues

What is the appropriate approach to measure effectiveness? What else needs to be measured?

– Step 1: Know the intent of campaign or conditions to be changed– Step 2: then you can set measures up front and constantly refine over time

(iteratively) How should we study outcomes of our actions?

– COORDINATE – form friendly network of interservice, interagency, govt, private partners

– Tailor to sub-groups and integrate– Do in steps – eg – how much closer did I get to the goal? (eg – goal 50%

positive polling – track trends from beginning)– Give your partners the collection requirements so they can collaborate– Don’t rely on a single measure (eg – not just polling)– There should be different measures for different timeframes – short/medium/long– Short – single behavior events (eg – vote, obey curfew, etc)– Medium – trends in behavior (eg. Calling a reporting hotline)– Longer term – attitudes underlying (Must understand what attitudes underly your

objectives and then what behaviors reflect these attitudes iot measure them)– Address both good and bad outcomes– Cannot measure attitudes directly (polling can help but is not entirely reliable)–

Page 38: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

38

OutbriefIW IIAnalytic Design Issues

Gap: need to fund longer-term studies on what kinds of observable behaviors reflect the attitudes we are likely to seek (eg – what behaviors underly acceptance of a “market democracy”?)

Further issue: giving people something positive, something to say “yes” to –something which reflects their self-interests and values. This approach might be more effective (can sponsor studies to determine) but also more likely to provide the types of objectives which lend themselves to observable/measurable behaviors.

Page 39: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

39

OutbriefIW II WG 4:CounterinsurgencyFindings/Recommendations

WG4: Counterinsurgency Charter: Explore Various Analytical Tools And Methods For Use In Planning And Conducting Counterinsurgency

Findings/Recommendations:– COIN analytical techniques applicable to general purpose forces

(GPF) are equally applicable to special operations forces (SOF)– Strengths and weaknesses of COIN analytical support for GPF are

the same for SOF– Tools include: Deployed analysts, Human-in-the-Loop (HITL)

computer-supported wargaming, COIN M&S not mature (caution on ability to model human behavior)

– Recommend USSOCOM develop a structure to provide analytical support to COIN forces

– Recommend USSOCOM consider interdisciplinary teams– Recommend SOF training/education/familiarization with benefits of

analytical support

Page 40: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

40

OutbriefIW II

COIN analytical techniques applicable to general purpose forces (GPF) are equally applicable to special operations forces (SOF)

– IED Analysis, Polling, Social Network Analysis, ISR Network Analysis, Assessment Analysis, Trend Analysis, Criminal Activity Profiling, RIO Analysis, Etc.

Strengths and weaknesses of COIN analytical support for GPF are the same for SOF

– Assessing influence on population

Problem Area – at times data obtained from host nation untrained collectors

Present – COIN Execution

Page 41: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

41

OutbriefIW II

Human-in-the-Loop (HITL) computer-supported wargaming

– Adequate way to provide insights now

– Federations of specialized simulations

– Wargame Integration toolkits

– Must use caution; not mature enough for some contexts

Models and Simulation– Warm and fuzzy – not!

– Emerging but still in its infancy

Present – COIN Planning

Page 42: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

42

OutbriefIW II

Substantial efforts ongoing– M&S as well as Non M&S – Data is problematic across the board

Context specificity– Strategic, operational, tactical

» Difficult to separate analytical implications between levels of war (“Strategic Corporal”)

» Realize need for a conceptual framework for understanding and integrating causality across all levels of analysis

» Iterative process/dialogue

Present – COIN Planning

Page 43: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

43

OutbriefIW II

Recommend USSOCOM develop a structure to provide analytical support to COIN forces

– Established during planning – every operation is different

– Diverse operating environments – varying footprints

– Reachback analytical support

– Support through GPF - when GPF are available

Recommend SOF training/education/familiarization with benefits of analytical support

Future - COIN Execution

Page 44: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

44

OutbriefIW II Future – COIN Planning

Recommend USSOCOM consider interdisciplinary teams

– Centralized

– Decentralized

– Hybrid

Recommend USSOCOM look into a conceptual analytical framework to provide analytical support to USSOCOM COIN planning

– Mr. Miller’s Trinity (crime, migration, extremism)» Left of boom

» Forecast next hot spot

» Correlation, not causality

Page 45: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

45

OutbriefIW II WG 5:Thinking ModelsFindings/Recommendations

WG5 Charter: Frame the context of the IW problem properly, break down IW operations into its natural components, and investigate the subject through discourse and the application of systems thinking.

Findings:– Many ways to see/represent IW – different languages/logic– Lack of common terms/understanding about IW– IW analysis at strategic/operational/tactical may require different cognitive

models/techniques/representations – Modeling is difficult – must learn to think differently – Focus on uncovering indirect opportunities– Need tools to improve research capabilities that enhance thought and shared

understanding– Need decision makers to shape/provide guidance:

» frame problem» visualization – make the whiteboard a “group thinking pad”» acquire a depth of understanding

– The Operational Design process:» requires continuous learning» provides insight, not answers» expect some risks» Identifies what we know and don’t know about the problem

Page 46: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

46

OutbriefIW II Gaps

There is a gap between our analytical capability and our commander’s operational needs

The repository of the IW “body of knowledge” has not been clearly identified (IW online Library)

There is a relational, supportive, and authority gap between the military and “the interagencies” on IW

We do not understand interagency lines of communications We don’t understand how to balance government capacity for

“restoration of services,” security, or economic development We do not know the modeling requirements for IW analysis Many do not know about IW Community Hubs, Potential Data

sources or samples of IW Activities available by Joint Data Support

Page 47: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

47

OutbriefIW II Key Issues & Discussion Items

Our current metrics don’t capture the qualitative aspects of conflict that commanders need

We have voids in our data and very little cause and effect data (e.g., temporal effects require years/decades of observations)

There is no “owner” of a common lexicon We lack sufficient analysts/SMEs with DIMEFIL (Diplomatic,

Informational, Military, Economic, Financial, Intelligence, Law Enforcement) experience

Identifying the differences between “indicators” and “effects” and understanding some effects are not quantifiable (e.g., measuring persuasion and influence)

We have not retained our history of IW, how do we bring it back—we need to leverage that operational experience and those earlier insights

There are different levels of IW that require very different tools

Page 48: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

48

OutbriefIW II Recommendations Identify, create and sustain credible IW data

– It will require iteration to decide on the data needed and to characterize it (e.g., metadata; pedigree) Develop a lexicon of key terms

– Current definitions are not acceptable to the interagency, coalition partners Continue the dialogue on MmTs to support IW analyses

– This workshop represents a significant step forward– More dialogue is needed w/ whole of government participation

MORS provide a forum to help organize the needed information– Create a common template to compare and contrast key IW models and tools– Continue to support efforts to identify key gaps and priorities to guide future actions

MORS and Sponsors assist in bringing the various IW Communities of Interest (COI) together; e.g.,

– IW Working Group– Human, Social Cultural Behavior (HSCB) modeling– MORS Social Science Community of Practice (COP)

Support Service initiatives to put Operations Research Analysts in SOF operational staffs Invite more allies and the interagency to these meetings

Page 49: 1 OutbriefIW II Chair: Renee G. Carlucci, CAA Co-Chair: Don Timian, ATEC MORS Irregular Warfare II Analysis Workshop 3 - 6 February 2009 Davis Conference.

49

OutbriefIW II

Questions?