Download - Introduction to the DOD 101 workshop - narrative H$D Stanford 2016

Transcript
Page 1: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 1 of 20

HackingforDefense@StanfordDOD/IC101Workshop

Readthisnarrativealongwiththeslidesat

http://www.slideshare.net/sblank/h4d-dod-101-workshop-040516Slides1-11JoeFelter:

Inthespiritofdoingmoreworkthananyofyourotherclasses,it's7pmanditsnotascheduledclasssessionandyou'reallhere.Weappreciateallofyouattendingandwe’llnotwasteyourtime.I'mgoingtogiveyoualittlebackground,andafewvignettesandcontexttohelpframeandunderstandthenatureofthecontemporaryandemergingchallengeswearefacing.

Thisisabravenewworldandathreatenvironmentunlikethosewehavefacedinpreviousdecades.I’dliketodescribethecomplexitiesandchallengesofthisenvironmenttohelpyougetyoumotivatedtoaddresstheproblemsyourteamsaretakingon.Next,PeteNewellisgoingtogiveyousomebackgroundonwhereourDODandICproblemscomefrom.Andourguest,JackieSpaceisgoingtotalktousaboutsomeofthepracticalapplicationsoftheacquisitionprocessandthechallengesandopportunitiesitpresents.(Slide2)

ThisisascenefromWestPointin1963.Youmayrecognizethespeaker,DouglasMacArthur,justbeforehepassedaway.Thisishisfamousdutyhonorcountryspeech.…the“bigidea”-touseSteveBlank’svernacular-fromthisspeechwasthat,“themissionofWestPointcadetsandtheentire

DODistowinournation'swars”.Howdowedothis?ThinkaboutthetypesofwarsthatGeneralMacArthurwasthinkingofwhenhesaid"Ourmissionistowinourwars."(Slide3)

Backinhisday,warswerenoteasybutmuchsimplertounderstandhowtofight.Whenastatewasattacked,theyknewthesourceoftheattackanditwasusuallyanothernationstatewiththecapacitytoprojectpower.Forexample,considertheaftermathofPearlHarbor.Weknewwhoattackedusandingeneraltermshowtorespond.TheUSmobilizeditsresourcesandindustrialbase,raisedpowerfulmilitaryforcesand

projectedpower-directingitatadefinedenemyandtheenemiesindustrialbase.Inconventionalstate-on-statewarfare,theoperationalandtacticallevelactivitiesthatsupportastrategytowinareoftenclear.Youmassfirepoweronobjectives.Youdestroytheenemy’smilitaryandindustrialcapabilitiesandseizeterrain.Allthosethingsaremissionsthatthemilitarycangettheirheadaround.Conventionalwarsagainstwelldefinedenemiesarenoteasybutaresimpletoappreciatewhatittakestowinthem.

Page 2: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 2 of 20

(Slide4)

Ifyoufightthesewarseffectivelyyoueventuallywin.InMacArthur’stimeweactuallydefeatedourenemies,drovethemtounconditionalsurrender.Wehadvictoryparades-kissedthenurse,wenthomeanddemobilized.TheUSandtheirallies’back-to-backworldwarchampions.…We'rethewinningteam.Itwasgoodtobekingthen,right?

Weusedtowinourwars,andweknewhowdoit.WenotonlywonconventionalwarslikeWWIandWWII,wewereprettygoodatwinninglow-intensityconflicts,unconventionalwars,limitedwars.There'snolow-intensityconflictwhenyou'reattheotherendofanAK47,trustme,butwewereevengoodatleveragingourtechnologyandourcapabilitiestowinlow-intensityconflictsandsmallwars.Weweredominant,buttoday'sit'ssomethingthat'schanged.(Slide5)

Thisisapictureatthetailendofthecoldwar.It’stakeninDecember1989inOperationJustCauseinPanamawherewewereconductinganightcombatairborneassaultintoPanamaandultimatelyseizedformerPanamanianPresidentManuelNoriega.PeteNewellandIwerebothjuniorofficers,Iwaswiththe3dRangerBattalion,Petewasinthe82ndAirbornedivision.Weknewthemissionwasdangerous.Wewere

parachutingininthemiddleofthenighttohostileterritoryunderfire.Wewerenotcocky,butwehadacertainlevelofconfidencegoingintothemission.Wewerethewinningteam-nobodycouldstanduptoourpowerfulmilitary.WehadaircraftcarriersandICBMs,butwealsohadaprettygoodtechwhenitcomesdowntothesmallunit,theindividualleveltechnology.Letmetellyouaboutsomeofthetechnologywehadbackthen.(Jokingly)It'sgoingtojustblowyouaway-nobodybuttheUSandotherpowerfulstates’militarieshadaccesstothisleveloftech.Wehadnightvisiongogglesyoucouldputonyourheadandyoucouldseeinthedark.Nokidding.Seeatnight!Itwasphenomenal.Welandedontheairfield,peopleareshootingatyou,theydon'tknowwherewearebutthey'resprayingtryingtohitpeople,wecouldseethem.Wehadnightvisionscopesonsomeofourrifles.WecouldputacrosshaironthewhiteT-shirtstheywerewearing.Itis“goodtobetheking”andhaveaccesstothesegamechangingtechnologies.Beforewewentinwehadoverheadimagesfromsatellitestakingpicturesoftheearthandgivingusmapssoweknewhowtoplan,andknewwhereourobjectiveswere.Theseimagesobtainedfromnationalassetsweresosensitivethatthesatelliteimagerywasclassifiedmaterial.Iremembertyingmyimagerywithparachutecordontomycargopocketbecauseifyoulostit,itwaslosingasensitiveitemandIwouldbesubjecttoaninvestigation.

Page 3: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 3 of 20

IliterallywasjumpingoutofaC-130at450feetwhichwasprettylow.Gettingshotat.Mymapripsoutofmypocket.AllIcanthinkofis,“ohmyGodI'minbigtroublebecauseIjustlostmyoverheadimagery,”whichisprettysensitivestuff.Atthesametimewealsohadsatellitesupinorbittriangulatingtotelluswithin10metersofaccuracywherewewerestanding.GPS.Itwascrazy.Wehadcommunications,whereeveryindividualsoldierinmyplatooncouldtalktoeachother.Imeanlittletinyradiosthatcouldtalktoeachother.Theselittlepensthatcouldshootalasertodirectfireandmaneuver.Neverbeforeinthehistoryofwarfarehasanorganizationbeenabletodirectitsoperationsandfireandmaneuverwiththatkindoftechnology.Andallofthiscostthousandsandthousandsandthousandsofdollars,reallyexpensivestuffthatfewotherstatesifanycouldaffordtodeploy.There’sasayingthat,“thestrongdowhattheywanttodoandtheweakdowhattheyhavetodo.”We'reoneofthestrongstates.WhatdostrongstatesliketheUnitedStatescareabout?Whodotheyworryabout?Otherstrongstates,right?SowhowasbiggerthantheU.S.backthen?Butthiswastheendofanera.Thisis1989,thecoldwarwasaboutover.Insomeways,despitethenuclearmenace,thoseseeminretrospectlikethegoodolddays.Whenitwasgoodtobeking–wherepowerandresourcestranslatedalmostdirectlyintobattlefielddominance.What'schanged?Whoarethesefolks?(slide6)

Iwasjokingabouttheadvancedtechnologywehadin1989.TodaywithacreditcardandInternetconnectionandyoucangetanyoneofthosethingsdescribedasgamechangingadvantagesforuswhenPeteandIjumpedintoPanamafora$100.Nightvisiongogglesarecheapandavailable,GoogleMapswithimagesofalmostanypartoftheplanetare

online,youcanjustgetthatanddownloadit.Allofthiswasformerlyonlyinthehandsoftheverystrongeststates,theverystrongestsuperpowers.Thefollowingslideshighlightjustafewexamplesofhowtheproliferationanddiffusionoftechnologychangesthefaceofthebattlefieldtodayandwhythismatters.Let'slookatsomeexamplesoftheasymmetriesthatgroupslikeISIS,al-Qaedaandothergroupstakeadvantageoftodousharm.

Page 4: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 4 of 20

(Slide7)

ISISisabletouseoverheadimageryanddronesurveillancetoplanandexecutetheiroperations.It'snotsohardtodo,they'vegottheirowndrones.They'reusingthisagainstus.Thisisanexampleoftechnologythat'snowinthehandsofouradversariesthatformerlywasonlyinthehandsofthestrongeststatesliketheUnitedStates.

(Slide8)Terroristsandothernationstatesareusingsocialmediaagainstus.IremembergoingtoSEREschoolasaspecialforcesofficercandidate.Weweretrainedtodevelopacoverstorytohideouridentifyifcaptured.Thiswasawholeconvincingcoverstorythatyougivesoyoudon'tgetfoundout.Today,ifyouGooglemeorcallupmyFacebookpageitwouldbeprettyclearwhoIwasandmybackground.

(Slide9)

Imaginewhatourourenemiescandowithreadilyavailabletechnologylike3Dprinting?Theinstructionsformakingthesemi-automaticrifleinthisphotoareavailableonline.

(Slide10)

CyberThreatstoCriticalInfrastructure.Thinkabouthowtheinternetandsocialmediahavechangedtheabilitytorecruit,totrain,toradicalize,motivateandinspireourenemies.It'sjustunbelievablewhatthistechnologyisdoingtoempowerourgroupsintentondoingusharm.

Oneofthebigadvantagesofbeingastrongsuperpower-likestatewasthatyougottoprojectpower.Nowanyonesittinganywhereintheworldcanprojectpower…sonowtheabilitytoprojectpowerisnotonlythepurviewofstrongstatesandsuperpowers,it'skidswhoarejustloggingonandthey'reabletoattackusfromafar,withcyberthreats.(Slide11)

BacktoMacArthur.…whenhetoldtheWestPointCorpsofCadetsin1963thattheirmissionwastowinourhewastalkingaboutdefeatingstrongstateswhichwereourbiggestthreatsatthetime.Thinkaboutwhatthethreatsarenow.Internationalrelationstheorystatesthatsaid,strongstatesneedtobemost

Page 5: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 5 of 20

concernedbythreatsposedbyotherstrongstates,hasbeenturnedonitshead.Today,weakstates,sub-stateactors,evenindividualsarenowempoweredthroughincreasinglyavailabletechnologytodousharm.Addressingtheseemergingandlethalthreatsisnowalsorequiredto“winourwars”,-thisisdefinitelyadifferentkindofthreatenvironmentthatwe'rein.Sowhatdowedoaboutit?Howdowewinourwarsgoingforward?Ataminimumweneedtostackthedeckagaininourfavor.Weusedtobeback-to-backworldwarchamps,abletomobilizeourresourceseffectivelyandtakeittoourenemies.WellIwouldarguethatinmanywayswe'renotdoingwellintodayschangedthreatenvironment.Notonlydoweneedtostackthedeckinourfavor,insomecasesweareatadisadvantageandjustneedtoleveltheplayingfield.Ironicallywearen'tthereyet.We'vegottocontinuetodefendagainsthigh-intensitythreats.Thisisn'tjustawaragainstISISandterrorism,we'vegotaresurgentChina,pushingusintheSouthChinaSea.Wehavetobasicallydefendonbothfronts.ISISdoesn'thavefederalacquisitionregulations;inSteveBlank’sdefinitionISISisaLeanOrganization.Theyarepivoting,learningandadaptingandtheyrapidlyreacttoevolvingthreatenvironments.Thisisatoughadversary-anadaptiveenemy.Thisisathreatenvironmentwhereouradversarieshaveaccesstotechnologiesandthey'reabletoadapt,toovercome,andimproviseandpivotanddeploythattechnologyinwaysthatarewayaheadofus. I’mtryingtoemphasizethatthisisadifferenttypeofthreatenvironment,differenttypeofadversaries.Theformerlylinearrelationshipbetweenstatepowerandmilitaryeffectivenesshasforeverchanged.Statesdon’tautomaticallygeneratethepowerpredictedbytheirresources–choicesmatter.Someoftheadvantagesthatweenjoyedbackinthedaywhenwewere“back-to-backworldwarchamps”don'treallyapplytoday.Thestakesarehighandwe'relosinggroundonmanyfronts.Weneedtodosomethingaboutit.Youcanhelp.PeteNewellisgoingtogiveyouthebackgroundofhowwedevelopourrequirements,whereourmissionscomefromandthenourguestJackieSpaceisgoingtotalkaboutsomeofthechallengesandopportunityoftheacquisitionprocess.Slides12-29PeteNewell

Obviously,thingshavechangedovertheyears.Theenvironmenthaschanged,ourcountryhaschanged,theeconomyhaschanged.Eachofyourteamshasaproblemthatwasgeneratedbyagovernmentsponsorforareason.Therestofthediscussion

tonightispeelingbackthelayerstofigureoutwhatthatreasonis,wherethatproblemmighthavecomefromandwhoelsesharesthatproblem.

Page 6: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 6 of 20

TobeginthesearchyoumustunderstandhowourNationalStrategiesarebuiltandhowtheycometogethertodrivethismassiveorganizationcalledtheDepartmentofDefense.Whatwe'regoingtotryanddohereisfastaswepossiblycan,isgiveyouaoneovertheworldofhowstrategyandfundingeffecthowthingsarebought.(Slides13-15)

Onthisfirstslideisabig,complicatedchartthatwouldtakeme30yearstoexplaintoyou.Sowe'renotgoingtodothat.We'llcutitdownfrom2000slidestoabout15.Here'sthechart.Thisisthedefenseacquisitionsystem.Wayupthereintheupperlefthandcorner,iswherethe

requirementsformilitarysystemscomefromandwhatgetsthingsstarted.TomakeitsimpleifyoustartonthetopleftyouhavetheJointCapabilitiesandIntegrationDevelopmentSystem,(JCIDS).JCIDSishowwehandlethecollisionbetweentwomanyrequirementsandnotenoughmoney. We'regoingtosplitthistalk.I'mgoingtotakecareofthetanksandairplanesideofthisandthenwe'regoingtohanditofftoJackieSpaceandshe'sgoingtotalkthroughtheislandsofinnovationwherealotoftheserulesdon'tapply,orthey'vecondensedthemintomuchtighteracquisitioncycles.LookingattheredboxesatthetopofthechartI’vehighlightedthekeyactivitiesyouneedtounderstand,beginningwithhowrequirementsaredeveloped.Nextwedevelopprototypes.Thenwefigurehowwe'regoingtoproducesomething.Thenwefigureouthowwe'regoingtosustainit.That'skindofthelifecycleoftheacquisitionsystem.It'snotrealcomplicateduntilyoudigintowhodoeswhattowhoandhowandwhentheymakedecisions.Forthepurposesofthisclasswhatisintheredboxesattopoftheslidearethethingswe'vegottokeepinmind.(Slides16-17)

Here'swhatyou'vereallygottoremember,therearethreekeyactivitiesthattakeplace.Inthebottomleftcornerofthisslideistheplanning,programming,andbudgetexecutionwork-nodifferentthananymajorcorporationoutthere.Youhavetofigureoutwhatfundsarecominginandwhereyou'regoingtoprioritizeandsendthosefundsoutto.Thisislargelydrivenbyaprocess

ofstrategydocumentsthatwe'lltalkthroughinjustasecond.TotherightinyellowisJCIDS,thesystemusedtodeveloprequirements.Finally,inredatthetopoftheslideistheacquisitionprocessofhowwebuythingstofillthegapsthatwereidentifiedinoriginaldocuments.JackieSpace:Dothepeopleintheaudienceknowwhatwemeanbyrequirements?Basicallyrequirementsarewhatareusedtobuildasystem,it’sthetechnicalparametersbywhichthesystemisbeingbuilt.Sothereisawholeprocessofpeoplethatdevelopthe

Page 7: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 7 of 20

requirementsandthecostrequirements,thetechnicalrequirementsaroundwhatsystemisactuallybeingbuilt.JoeFelter:Forexample,defendingagainstdismountedIEDs(roadsidebombs)inAfghanistanversustheIEDthreatinIraq,whichwereagainstvehicles.ThelagtimethatittookforthemilitarytoaddressthedismountedIEDsthreatinAfghanistancausedthousandsofcasualties.Petemadethataverypoignantpointlastweek.PeteNewell: (Slide18)

Allrightsoherewego.Let'sstartwiththestrategydocuments.ThestrategydocumentthatstartsitallistheNationalSecurityStrategy(NSS).ThisisadocumentthatthePresidentoftheUnitedStatesproducesthatlaysoutAmerica'senduringinterests,notjustmilitarilybutalsoeconomically,andsocially.

TheNSSlistsfourthingsthatareconsideredtobeourenduringinterests.1. ThesecurityoftheUnitedStates,itscitizens,andUSalliesandpartners.2. AstronginnovativeandgrowingUSeconomy.3. Anopeninternationaleconomicsystemthatcanproduceopportunityfor

prosperity,respectforuniversalvaluesathomeandaroundtheworld,and4. AninternationalorderadvancedbyUSleadershipthatpromotespeace,security,

andopportunitythroughcooperationtomeetglobalchallenges.(Slide19)

TheSecretaryofDefenseusestheNSSasabasisforissuinghisstrategy.TheDepartmentofDefensecallsittheNationalDefenseStrategy(NDS).TheNDStakesthePresident’sNationalSecurityStrategy,looksatitfromadefenseperspective,andsaysherearethethingsthatweneeddothatmeetthosePresidentialobjectives.ThecurrentNDSincludesthingslikecounter-terrorism,irregularwarfare,

deferanddefeataggression,projectpower,counterweaponsofmassdestruction,provideastabilizingpresence,conductstability,andcounterinsurgentoperations,andhumanitariandisasterreliefandotheroperations. There'sabunchmoreintherebutbroadlyitdetailswhattheDepartmentofDefenseisgoingtodotomeetthePresident'sNationalSecurityStrategy.(Slide20)

Thencomesthequadrennialdefensereview(QDR).It’sdoneeveryfouryears.Younoticethedatesoftheseareoutofsync,becauseseveralyearsgoesbetweeneachoneofthem.Soonedocumentmaybeissuedin2015butwe'restilloperatingoffonefrom2012anotheronefrom2013andone

Page 8: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 8 of 20

more.Thequadrennialdefensereviewisreallythedocumentthatstartstotakethosestrategiesandlookatthemintermsofwhatcanwereallyafford.TheQDRdescribeswhatarewereallygoingtodoinordertomeetthePresident’sandtheSecretaryofDefense’srequirements.Thedocumenthassomeverybroadstatementslike,“Protectthehomeland”and“DeteranddefeatattacksontheUnitedStates,”“Buildsecuritygloballytopreserveregionalstability.”“Projectpowerandwindecisivelyanddefeataggression.”Butunderneaththere'sanicelinethatsays"AtthePresident'sbudgetlevelthemilitarywillbeabletodefendthehomeland,conductsustaineddistributedcounterterroristoperations,anddeteraggressionandassurealliedinmultipleregionsbeforepresenceandengagement."Youknowwhatitdoesn'tsayanymore?Thatwe'regoingtofightandwintwowarssimultaneously.Seriously.AtthePresident'sbudgetlevel,whichmeansthePresident'salreadytoldhimhere'swhatwe'regoingtopayforintermsofdefensethisyear,theydeterminethatthesearethebestthattheycandotomeetthekeyobjectivesthatweresetupbytheNationalDefenseStrategyinordertomeetthePresident'sNationalSecurityStrategy.Ithinkyou'restartingtoseethewherethegapsmightstarttoappear.AswechangeonewordinonelineintheQDRandsuddenlytheStrategydocumentsmeansomethingradicallydifferent.Arewebuyingtanksnow?Orarewedoingmorehumanitarianoperations?Moreaircraftcarriersormoreairplanes?Dependingonwhereyousitinthatbigsystemitcanveryrapidlychangebasedonhowyouperceivethebestanswertothoseproblems.Whatthethreedocumentsendupgivingus,andwhatfallsoutofit,iscalledtheDefensePlanningGuides.Itreallyishowwedevelopthebudgetsthatdrivetheorganizationofthemilitaryandeventuallytheactivitiesoftheseagencies.(Slide21)

IntheU.SwehavefourMilitaryServices:theArmy,Navy,AirForce,andMarines.(TheCoastGuardgetstoactlikethefifthservicebuttheyactuallybelongtoanothergovernmentagency.)Themilitaryservicesareresponsibleforprovidingpeopleandequipmenttocombatantcommanders.It'stheirjobto

raisethearmy,navy,airforceandmarines.It'stheirjobtotrainandequipthem.It’stheirjobtoprovidetrainedequippedreadyforcestocombatantcommanderswhoaretheguysoutherewhoactuallyfightthewars.InbetweentheMilitaryServiceswehaveanumberofDefenseAgencies.Theeasywaytoknowifyourtalkingaboutanagencyisthelastwordintheirnamesaysagency.It'sthingsliketheNationalGeospatialIntelligenceAgency,theNationalSecurityAgency.There'sonlyagencywhodoesn'thavethewordagencyistheirnameistheNationalReconnaissanceOffice.Forsomereasontheygottobedifferentthaneverybodyelse.

Page 9: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 9 of 20

TheagenciesoutthereallhaveconsolidatedportfoliosofactivitiesthattheydoatthebehestoftherestofthegovernmentforDOD,butthey'realsostrategicforceprovidersforthecombatantcommanders.I'llshowyouacoupleofslidesthatactuallymakesthisalittleeasiertounderstand.Finally,wehaveabunchofDODfieldactivities.It'sinterestingwhatshowsupasfieldactivities.Forexample,WashingtonHeadquartersServicesisresponsibleforthemilitaryinstallationsofWashingtonDC.AnotherexampleofafieldactivityistheDefensePOWmissionpersonneloffice.60someoddyearsaftertheendoftheKoreanwarwearestilllookingforpersonsmissinginactionorremainsthatwereneverrecovered.WestillhaveanactivitythatactuallygoestoVietnam,Laosandsomeotherplaceslookingfortheremainsofservicememberswhonevercamehome.Therearelotsofothersmallactivitiesthatdon'tneatlyfitanywherewithinsomeplaceonthatchartupthere.Student:InoticedthattheCentralIntelligenceAgencyisnotonthere.Why?PeteNewell:TheCentralIntelligenceAgencyisnotaDODactivityoragency.Although,I'lltalkabitlaterabouthowsomeoftheothergovernmentagenciesactuallyhaveinterestthatareembeddedinDOD.AsadeployedbrigadecommanderinIraqinsouthernIraqin2010IhadmembersoftheCIA,DIA,theNSA,theFBI,thesecretservice,allwhowerepartofmyorganizationorpartofmyfootprintthatIwasresponsibleforensuringthattheycoulddowhateverthegovernmentsentthemtheretoactuallygetdone.Student:Whenthere'sagroupthat'smadeupofDODpersonnelandsayCIApersonnel,howdoesthatworkintermsofcoordination?PeteNewell:Therearefirstaseriesofstandinginter-agencyagreementsthataccountforcross-agencyactivities.Thenthereareaseriesofcontingencyplansthatareareactiontosomething,thatautomaticallyenact.Oneexampleiswhathappenedon9/11.On9/11littleknowntoanybodytherewasa1960’sagreementthatallowstheUnitedStatesAirForcetotakecontrolofalloftheairspaceintheUnitedStates.About30minutesaftertheplanehitthesecondtower,therewasayoungwatchofficeratNORAD,whichisinColorado,whoreadsaone-linesentenceoverthephoneonelinesentence."WeatNORADareenacting..."andwhatyouheardonthephonewasdeadsilencewhilepeoplewerefocusedonfiguringoutwhathewastalkingabout.ThefirstguyonthephoneisaguyfromtheFAAwhosays"SoifIunderstandthisrightyouwantustoturnoffallthenavigationalaidsintheUnitedStates."Therewasapregnantpauseandthisguy'sflippingthroughthebook,andsays"NoIwantyoutodoX,Y,andZ."Insomecasestheseareagreementsandrulesgobackyears.Inthiscasetherewasastaffanddecisionmakerswhozeroedinonthatregulationwhounderstandswhat'ssupposedtohappen.

Page 10: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 10 of 20

Student:TowhatextentisthestructurehereembracedbypersonnelwithinDOD?Likehoweasywoulditworkthistime?PeteNewell:Whatyouhavetounderstandiseverytimeanagencygetstheirnameuphereonthischart,theyhaveabudgetthatcomeswithitfromCongress.IttakesalmostanactofCongresstochangeoneofthosethings.Ifyou'reaneworganizationandyouwanttobecomeanofficialagency,ittakesanactofCongresstogetyournameuphere.FromastructuralcontextthelastmajorchangethatwasmadewasbasedontheGoldwater-NicholsActthatmandatedtheformationofcombatcommandersandanumberofotherthings.Itchangesfromtimetotime,butnotfrequently.(Slides22-24)

AsImentioned,theservices–theArmy,Navy,AirForce,Marinesjobistoprovidepeopleandequipmenttothecombatantcommanderswhoareresponsiblefortheworld.Onthebottomofthischartarethecombatantcommands.The

AfricanCommand(AFRICOM)isacommandresponsiblefor53Africancountries.TheCentralCommand(CENTCOM)isresponsiblefortheMiddleEast,NorthAfricaandCentralAsia.TheyarealsoresponsibleforprosecutingonewarinIraq,oneinAfghanistan,andalsodealingwithpiratesoutsideofYemen.Thecombatantcommandersgetallthebadstuffthatgoesonintheworld.Tohelpdealwiththeworldtheygetpeople,equipment,assetsfromalloftheseServices,andfromallofthoseagenciesthatlistedonthepreviousslide.Basedontheirmissionstheyhaveaseriesofcontingencyplansthataredevelopedinresponsetothestrategies,thatsay,“ifthishappensweapportionthesekindsofforcestoyou.”Eachoneofthosethingsalsocomeswithabudget.Andthebudgetcomewithspecific“typesofmoney”called“titlesofmoney.”TitleXmoneybelongstotheservices.Forinstances,astheDirectoroftheArmy'sRapidEquippingForce,Ihada$200millionbudgetwhichwastitleXmoney.I'llgiveyouascenario.InAfghanistan,ifaMarineelementworkingaspartofanArmyorganizationcametousandsaid“heywe'rehavingaproblemandweneedtofindasolutionfor,”Icouldn'tdoit.Icouldn'tgiveittothembecauseIcouldn'tspendtitle10moneydirectedtotheArmybyCongresstoprovideequipmenttotheMarines.However,IcouldprovidethatequipmenttotheArmyelementthatcontrolledthem,whocouldthenassignitdowntothem.TherearetitlesofmoneydirectedatReservesandNationalGuardforcesstrictlyfortheiruseintheUnitedStates.Therearetitlesofmoneyforcombatantcommanders.Thereisadifferenttitleofmoneythat'sdirectedtothemfortheircontingencyoperationstodothingsandthenthere'sallkindsofcolorsofmoneyrelatedonwhatactivitiestheyplaceinthesayofthings.We’llcomebacktotalkaboutthe“colorsofmoney”inSlide27.

Page 11: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 11 of 20

Thekeytakeawayhereistheworld'sbrokenupintoregions,thatarerunbycombatantcommands.Andit’sthesecombatantcommandsstarttoidentifygapsbasedontheiroperations.Forexample,InCentralcommand,theArmyandDepartmentofDefensefeltthatgettingMRAPSintoIraqwouldsavesoldiersinHumveesfromgettingblownupbyIEDs.MRAPswerethebestthingsinceslicedbutter,buttheywereasbigasanelephant,armoredbutsavedlotsoflives.WemovedtoAfghanistanandMRAPStherewerelikedrivinginquicksand.VeryshortlyafterwardtheCENTCOMCommanderwastellingtheDepartmentofDefenseistheMRAPstheywereprovidinginAfghanistanwereinadequatetomeettheconditionsoftheenvironmentandthatcreatedagap.(Slide25)

Thatgapthen,leadsusbacktothatJCIDSprocessImentionedontheinitialslide.InJCIDsagapisassignedapriorityforsomebodythentogofigureouthowtosolveit.Thatsolutionthenturnsintoarequirement.ThesolutioninthiscasewasadifferentkindofarmoredvehiclewhichwereasmallerversionoftheMRAP.Theywerelighter,couldhandlethesandalittlebetter.

Herewego.Gaps,notrequirements,gaps.Thosetopthreethecompetitionwithwhattheseguyssaytheyhavetodoinordertoactuallyachievesomething.Soletstakeoneoftheteamsinclasshere,distributedISR.Isitagaporarequirement?Student:Itisagap,PeteNewell:Who'sgapisit?Student:Thegapislackofacapabilitytorapidly,tohaveeyesonmostofthedomainthe7thFleetissupposedtobekeepingtrackof,andsimultaneouslybeabletodeploysomethingquicklyto,iftheywantedtoseesomethingrapidly.PeteNewell:Correct.IfI'mresponsibleforhuntingRussiannuclearsubmarinesinthePacificandIcan'tfindthembecausetheocean'stoobig,it'sagap.IfIamresponsibleforsecuringthehighspeedaccesstothewesterncoastfromdrugandillegalpeopleimmigration,thosekindsofthings,that'sagap.Whichcombatantcommandisit?It’sPACOMwhere7thFleetisassignedasaNavycomponenttothecommand.We'llwalkthroughalittlebit,butyoucanseewherefrommultipleperspectivesthesamegapmayproducedifferentrequirements.Thegapisstillthecenter,wecan'tmanagetodoX,Y,orZ.(Slide26)

Obviouslythereisfrictionthere.I'lltellyouthishappensalot.Theseguysgetabudgetandtheyplanonafive-yearcycle.Istartedbuildingatankinyear1,we'recomingupwithasolution

Page 12: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 12 of 20

thatI'mstilldeployinginyear5.However,inYear2,thecombatantcommandercomesinandsayswhateveryouwerebuildingdoesn'tsolvemyproblemanymore.Theguyupatthetopsays,wellifyouwantmetostartoverit'sgoingtobeanotherfiveyearsbeforeIgetyoursolutiontoyou.Insomecasesthecombatantcommandswillusetheirmoneytoactuallyprocurematerialsolutionsthatfillimmediategaps.Whenthey'redonewiththematerial,orwhenitgetsreallyexpensivetomaintain,they'lllookattheservice,becausetheyhavealltheauthoritiestomaintainthatstuff,andsayhereyougoIneedthemaintenancepackagethatgoeswiththisstuff.There'sfrictionbetweenthetwooverhowtheysolvethosekindsofproblems.Whenithappensitcanbereallyugly.Student:8problemswerechosenfortheteamsinthisroomtoworkon.Wereanyofthemrequirements,orweretheyallgaps?PeteNewell:Noneofthemarefull-fledgedrequirements.Alotofpeoplemisusetheterminology.Ihavea“requirement”tofixthisproblem.Theonlywayyougetarequirementistocomeoutthebottomendofthismassivechartuphere.Weveryspecificallytoldoursponsorsnottogiveusrequirements.Yourgapcamefromthepartofthechartuphereunderjointoperatingconcepts.EventuallygapsturnintoJCIDSrecommendationsthatsaywe'regoingbuyatankthatrequiresthreepeoplethathastobetrainedandsustained,andalonglistofthingsthatgoeswithit.Eventuallythatcomesoutalistofrequirements.Onceitcomesoutasarealrequirementit'svery,veryhardtochangebecauseyouhavetogobackthroughtheentireprocess.Inourcase,forthisclassweveryspecificallyvettedsomeoftheproblemstoensurethattheyweremoreonthegapside,thattheyhadn'tdeterminedwhattherequirementwasgoingtobeanditwasn'twellwithinthatprocess.Alloftheproblemsforthisclassfallwithinrecognizedgapsthatareoutthere…Student:What'stheauthoritythatcertifiesthatarequirementhasbeenmet?Forinstance,ifIhavearequirementthat'soutthereandI'dliketobealittlebitflexiblewithit.Whocertifiesthatyestherequirementismetandthewaythatit'smet?PeteNewell:I'llgiveyouthebookanswerandthenI'lltellyouthepolitics.Atonetimetheysetastandardformeasuringbatteryusage:9peopleoperatingfor72hoursawayfromthebase.Thismakessense.72hoursmeanswecarryalotofweight,alotofwater,foodandalotofbatteries.AtthetimedependinguponwhatmissionwewereperforminginAfghanistanthosemyguyshadtodistribute247poundsofbatteriestooperatefor72hours.Thefirststandardthatissetisnotreallyastandardfortherequirements.itusedforthestandardforthemeasurementofperformingeffectivelyfor72hours.Sothefirstguysayswhyisit72hoursandnot120hours.Nuclearpowerguyswhohaveitintheirheadsthattheywanttodeploysmallnucleardevicestopowerthis.Youknowwhatthosenukedudes

Page 13: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 13 of 20

have?Theyhaveareallygoodpowerfullobbyist.Thatcausedadebatefor18monthsoverthecapabilitiesmanagerandtheotherguyswhosaid72hoursisstandard.Theyhadtogobackover10yearsworthofdocumentstoarticulatewhythestandardwas72not120or24,orsomethingelse.Becauseassoonasyouopenacanofwormseverybodycomesinandsayswellmysolutionwouldbeperfectifitwas24hours.Butifit's36thenI'museless.I'vegotalobbyist,I'mgoingtoattackthesystemtotryandgetthestandardchanged.Peopleplayalotofgameswhenitcomestowhodeterminestherequirement.WithintheArmy,theTrainingandDoctrineCommandisresponsibleforactuallytrainingpeopleanddetermininghowmanypiecesofequipmentweneedtoperformamissionisresponsibleforwritingtheinitialrequirementdocument.ThatdocumentthengoestothePentagonwhereitgoesthroughaseriesofboards.Theboardsthendecidethatyesisitavalidrequirementwrittencorrectly,theparametersfitwithinourpriorities,itdoesn'tviolatethelaw,etc.Ican'ttellyouhowmanyofthoseboardsthereare.Eventuallyitcomesouttheotherendandpoofwehavearequirement.Itdependsonwhatyou'retouchingandhowmanydifferentcomplexitiestherearetoit,butifyoulistencarefullyyou'llstarttohearvendorsandotherpeoplewhohavethingstosellstartingtotalkabouthowtheirthingdoesbetterthansomethingelse.They'llstartquotingnumbers.I'vedoneitwithsensors.I'mactuallyworkingonavehicleatonepointatGeorgiaTechResearchInstitutevalidatingthesensorsplacedinsidestrikervehiclestoprovidedataloggingagainstIEDblasts.Wewantedtoknowwhathappenedinsidethevehicle.Wecameupwithasetofparametersforthatsensor.Itwasapoundspersquareinchreadingthatithadtowithstand.LiterallyIhadavendorstartaCongressionalinvestigationoverwhyitwas10poundsandnot8pounds-becauseitmeanthisversusanothervendor’ssensor.Yourunintothosethingsallthetime.Whichiswhysometimessomebodyiswillingtosayexactlywhatitisbecauseassoonasyousaidit,andyoucan'tretractit.Iknowthat'salonganswerbutIjustwanttotellyouit'snotsimple.Student:foraprogramlikespace-basedradar,ledbyAirForce,dotheyconsidertheneedsofotheragenciesandtakerequirementsfromthosepeople?PeteNewell: Ifthey'resmarttheywill.They'llnotonlyconsiderwhatthoseotherpeopleneed,they'llconsiderwhatthosepeoplearealreadydoing.Ifyouwanttobesuccessfulyouavoidduplicatingsomethingelse.Student:Whowasthemainsponsorofthisclass?Iwasjustwonderingwhat'stheirexpectationfromtheoutcomeoftheclass.…PeteNewell:Doyoumean,“What'sthegapthatthisclassmeets?”It’stheLackofDOD/ICinnovation.Thereisalackofopportunityforyoungtechnologisttoperformanationalpublicservice.Thereisamassivegapbetweenthemilitaryandtheciviliansthatthey'rechargedwithprotecting.Ashrinkingmilitaryinaverycomplexworldwheretechnologyisblowingpastthematlightspeedwhohasnoaccesstotheintellectthatyouhaveona

Page 14: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 14 of 20

recurringbasis.Thoseareallgaps.Nobody'swrittenarequirement,althoughthey'retalkingallovertheplaceabouthowdoyoudealwiththoseissues.Forfolkslikeusthatrecognizethatthere'sagapourhopeisthatwecanstepinandprototypesomethingtohelpvalidatethatthegapisrealandthattheremaybeapotentialpathwaytosolvingit.Thisclassisexactlywhat'sgoingtohappen.We'llprototypeit.It'sapilot.It'sgoingtogrow.Somebodyinthegovernmentisgoingtodecidetoputawholelotofmoneyinit,youknow$20-$30millionayeartoensurethatitgrowsintoanother30collegesacrossthecountry.Somebodyelsefromanotheragencysaysthat'sreallycoolIwanttoconnectmyprogramtoit.Andeventuallywe'llbeatthesustainmentmode.…Student:WespokewithsomefolksfromabigsystemintegratorwhosaidsaidthatpartofthereasonwhythesensorsaresoexpensiveandhardtodeployisbecausewehavetosourceeverythingthroughtheUSfacilitiesandassembleinsecurefacilities,andsoonandsoforth.Ifoursolutiongoesdownthispipeline,atwhatpointmightwebeexpectforsomeonetosayheyweneedtosourceeverythingintheUS.JackieSpace:Youaretooearlyintheprocesstojudgewhereyouneedtosourceit.Becausetheyhavetogothroughthetraditionaldefenseindustrialbaseforthemostpartitstrue.ButIthinkthattherearecertainlysensorsorothertechnologiespotentiallythatarebeingbuiltontheoutside.Eventuallyatsomepoint,ifyou'regoingtocontinuedevelopmentonsomethingbigyouwillhavetoconsiderthat.Student:…Iguessyou'resayingincommercialsitestheirtoleranceforsensorerrorarealothigherbecausethey'renotusedtoapproachingitfromthe‘heywecanfixthisarea.’Theyneedtohaveamuchlowererror.…PeteNewell: Iwouldsaythere'safundamentaldifferencewhenyouapplythemwithpublicmindthathastobeaccountedfortothenthlevel.Myexperienceindealingwiththesefolks,andit'snotbecausethey'rebadpeoplebutthesystemcreatesbadbehaviors.Itdis-incentspeopletotakerisk.Notonlyaretheynotrewardedforacceptingriskandfailingbutthey'reactuallypunishedfornotbeingperfect.Sointhegoaloftryingtoperfectlyacquiresomethingwetendtofailbigger,morefrequentlythanwewouldotherwise.PartofthebeautyofwhatSteveBlankhasdonewithLeanLaunchPadisessentiallybuildaframeworkbywhich,withalittlebitoftranslating,we'vebeenabletoprovideastrategybywhichwecanfailinthissystemmuchearlierandmuchlessexpensively.Atleastthat'sourhypothesis.That'swherewe'reattoday.…JackieSpace:Thereareplacesinthegovernmentthatarealwaysgoingtoremainmilitarygrade.Thebillion-dollarsatellitethattheylaunchthatenablessomebodytoreadalicenseplate?That'sgoingtostayamilitarygradesystem,butthere'sthisawarenessnowinthemilitaryandgovernmentthatthere'salotofotherthingsouttherethataregoodenough,withamuchlowerresolutionthatyoucanfindtheprivateindustry.

Page 15: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 15 of 20

(Slide27)PeteNewell:Oneofthethingsthatyouhavetounderstandismoneyhasdifferentcolors.There'sdifferenttypesofmoneytosaywhatitwasusedfor.BelieveitornottheDepartmentofDefensecauseditselfthisproblem.Itdoesn'thavetobethisway.IfCongresswouldquitehonestlychangeitifDODsaid“wewanttochangeit.”Buthere'swhathappens.Operationsmoneyisessentiallyone-yearmoneythatisused

foreverythingfrombuyingtoiletpaperinabarrackstopayingforgasforvehiclesorforbuyingthingsthatcostlessthan$250,000peritem.Icanbuysomethingfor$200,000,evenifit'sapieceofequipment,usingoperationaldollars.Theproblemthatyourunintowithoperationalmoneythoughisonthe30thofSeptemberitgoesaway.Itdoesn'tgobackintothegovernment'sbank,itdoesn'tgobackintosomemagicbagtopulloutlater.Itisgone.Disappeared.IfyouareworkingonaproblemandaguysuddenlyshowsupinJulyandsaysI'vegotamilliondollarsIcanspendittoday,whatcanIget.Myguessishe'sprobablyusingendofyearmoneyandhe'sinapanicbecauseheknowsitdisappearsthe30thofSeptember.Hereiswhathappens.ThefolksinthePentagonwhomanageamassivebudgetsayonthe30thofAugustifyouhavemoneyleftinyouraccountsubordinatetouswe'retakingitallandwe'regoingtospenditonourun-forecastedrequirements.Sothenextlayerdown,theysay“ifyouhavemoneyleftinyourbudgetonthe30thofJulywe'retakingitallforouruse.Onitgoesuntilyouhavethepoorguy,whoonthe1stofApril,isinapanicbecausehehasn'tspenthismoneyyet.JackieSpace:Ifyoudon'tspendyourmoneyyougetyourbudgetslashedthenextyear.Theysayohyoudidn'tspendyourmoney.…anotherpointonthesecolorsofmoneyisthatifyouhaveaprojectthatyou'reworkingonyoushouldbeaskingbeneficiarieswhattypeofmoneyareyouworkingwith.Howyouendupputtingyourproposalandprojectstogethercanactuallyfitinallthreeofthosedependingonhowyouwriteit.Reallyhavinganunderstandingbeforehandofwhattypeofmoneyyou'reworkingwithisveryimportantPeteNewell:Herearethequestionsyoustarttoasksoyoucanfigureoutwheretheyare.First,procurementdollars.Iwilltellyouprocurementisnotmyexpertise.Iprobablyviolatedmorerulesthannot.Procurementprocesswasdesignedtobuymuchlargerthings.That'showwebuytanks.That'showwebuysustainment.Thelifecyclecostofputtingsomethingoutthere.Unfortunately,youcan'tuseprocurementdollarstobuytoiletpaperoranythinglikethat.Soit’sdesignedtobuymajoritems.Itdoeslastforthreeyears.Whichmeansthatwe'reinthemiddleof2016soattheendofSeptember2016,2014procurementmoneyisgoingtoexpire.Whyisthatimportanttoknow.Ifsomebody'stellingyou“heycomedothisforuswe'vegot$3million,”Youmightwanttoaskwhattheexpirationyearis.Becauseifsomething'sdraggingalongandyou're

Page 16: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 16 of 20

abouttohitthe30thofSeptember,andyoudon'tknowifthecontractisgoingtobesignedyet,ifit'sexpiringmoneyyou'renotgoinganyfurther.JackieSpace:ThesmartmoneymanagerwillhavehismoneyspentbyJuly1stjusttoavoidlosingitorhiscontracts.Alotofpeopledon't,soanothersmartmanagerknowshowtogoaroundgetmoneytouseintheirprogramfrompeoplethatcan'tgettheirmoneyspent.Oneofthequestionswhenyou'retalkingtoyourprogramsponsor,especiallyprogrammanagers,ishowdoyouhandleyourendofyearbudget.Youwanttoknowiftheyaregoodatplanningmoneyatendofyeartosupportyourprograms.PeteNewell: I'mgoingtohitthelastone,RDT&Emoney,research,development,testingandevaluationmoney.Withthismoneyyoucanbuildprototypes,youcantest,etc.MostofyouworkingonyoursolutionswouldlikelyfirsttouchRDT&Emoney.Therearespecialcasesofmoneystartingwithpurplemoneywhichmeanstheycandowhatevertheywantwithit.Insomeofthesecasesorganizationshavebeengivenspecialauthoritiestoallowthemtoessentiallybreakalltherules.Theproblemsometimesthoughiswhenyou'regivenspecialauthoritiesyoualsogetspecialoversight.ThoseorganizationsareprobablythemostscrutinizedorganizationsoutthereintermsofCongressionaloversight.Notthatthey'regoingtodosomethingwrongbutbecauseCongressmenwanttoknowthatthatmoney'sbeingspentwheretheythinkit'sbeingspent.TheSecretaryofDefensehasaRapidAcquisitionAuthority(RAA).WhenIwaswiththeRapidEquippingForce,theSecretaryofDefensecouldauthorizetheupto$200millionayearinRAAthatwouldallowustochangethewaymoneywasused.TousethatauthoritywewouldsimplywriteamemothatsayswearegoingtouseRDT&EmoneytobuygasorsomethinglikethatandstaffitthroughtheSecretary.Ifheapprovedtherequestwewereabletodowhatweneededto.Itwasn’teasybutitwasn’thardeither.ItwasfairlyquickbutitalsorequiredCongressionalnotificationbecauseweweredoingsomethingotherthanwhatCongressdirectedwiththemoney.Thefollowingtypeofmoneyisoneyouhavetopayattentionto.OverseasContingencyOperatingmoney.Thisisthethingtheyslapontopofthebudgeteveryyearbecausewekeephavingconflictssomeplacethatweren’tplannedforaspartofthebudget.WhatyouhavetoknowaboutOCOisthatifyou'reworkingonsomethingandsomebody'sofferingyouOCOmoneytodosomething,whatyou'redoinghastobefocusedonsolvingagapoverseas.Youcan'tuseOCOdollarseverywhere,becauserightnowIthinkOCOisstilllimitedtoCENTCOMwhichmeansthatwecan'tsolvethedistributedISRprobleminPACOMusingthesedollars-evenifthat'sallwehaveatourdisposal.Thelastthingyououghttopayattentionto,continualresolutions(CR’s).Forexample,ifwe'renotgoingtopassadefensebudgetinSeptemberbecauseCongresswantstoseewhathowtheelectionturnsoutfirst,wewilllikelyendupwithacontinuingresulutiontofundtheDoD.Whathappenswithacontinuingresolutionisthatthebudgetfolkswillsay“youarenotallowedtoprogramspendingmorethan65%oflastyear'sbudget.”Thatpoorguywho'ssupposedtospendallhismoneybyAprilorifit’salreadytakenaway,isnowtold

Page 17: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 17 of 20

you'vegottostretch65%ofyourbudgettolastallyear.WhenthebudgetsfinallypassedinJanuary,whathappens?Hesuddenlyhasthismassive(influx)ofcashandhe'sgothowlongtospendit?Twomonths.Whichmeanshehastofigureoutwhathe'sgoingtobuy,hehastocontractit,hehastodoeverythinginaveryshortperiodoftime.Student:Sotheyliterallycannotspend35%ofthatbudgetonanythingoverthisperiod?…PeteNewell:No,infacttheyhavetoturninabudgetthatdoesnotexceed65%ofthepreviousyear’sbudgetandshowhowthatwillcoverthemfortheentireyear.OncethereisaDefensebudgetpassed,theyhavetosubmitawholenewbudget.Thismeansthey'realwaysplayingwithtwobudgets.Thisissometimeswhatcausesexpensiveprogramstotripleinexpense.Failureofpoliticianstodotheirjobisoneofthebiggestexpenseswehave.(Slide28)

Let’sgobacktothemissionmodelcanvas;Valuepropositions,buyin,advocates…accordingtowho?Therearealotofpeopleoutherewhowilltellyoutheyfallinallthreeofthesecategories.Onthisslideisalistoffolksyoushouldlookfor.OnitI'vealsoleftyousomequestionsyououghttobeaskingwhoeveryouaretalkingto.Thefirstoneis:

• whoareyou?• Wheredoyoufallinhere?Beneficiary,advocate,areyouboth?• Areyoufromaservice?AreyoufromaCOCOM?• Wheredoyoufitinthismassivelistofthings?• What'syourmission?• Whatareyousupposedtodo?Whatareyounotsupposedtodoandnotallowed?

Makesureyou'vegotthatclearinyourhead,whataretheysupposedtodo,whataretheynotsupposedtodo.Where'dyourfundingcomefrom?Whatkindsdoyouhave?Whatareyoutalkingtomeabout?Iwouldaskabouttypesofcontractsifit'sappropriate.Finally,whodoyouworkwith?Thenfinally,whoelsedoyouknowthathasthisproblemthatmightbeworkingthisarea?ThiswhatIcallanassetinventory.Everybodyyoumeetexistsinanecosystem.You'retryingtofigureoutwheretheybelongandhowtheyconnect.Hereare8questionsyoucanaskthatwillhelpyouclarifywheretheyare.Theanswerstothosequestions,orthewaytheyanswerthemwillallowyoutofigureoutwheretheybelonginyourecosystemofthingsthatyoumightneedeventually.

Page 18: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 18 of 20

(Slide29)UsingoneofourteamsworkingonDistributedISRasanexample,thesponsoristhe7thFleet.The7thFleetispartoftheUSNavy,however7thFleetisassignedtoPACOMastheNavycomponentofthePacificcommand.Sowhohastheproblem?IsittheNavy'sproblemorisitPACOMsproblem?Orisitboth?Mighttheyhavedifferenceof

opiniononhowtosolvethatproblembasedonhowexpensiveitistotrainpeopleandhowmanypeopleitcosts.Doyouseewherethefrictionmightcomefrom?Youcanbegivenconflictingguidancewhenyou'retalkingtopeople,onesideversustheotherside.AlltheseagencieswhoprovideassetstoPACOM,probablyhavesomeamountofequityinthatproblem.Byequitywemeantheyhaveauthorityandtheyhavebudgetstotakeactionagainstpartsoftheproblem.TheymayalsohavefivedifferentopinionsonthescopeoftheproblemthataredifferentthanthatofPACOMor7thFleet.Now,theCIA,theCoastGuard,otherfolks.Don’tyouthinkthattheymighthaveavestedinterestinhowthisissolved?Aretheyauser?Aretheyacapabilityprovider?Aretheyanadvocate?Aretheytryingtokilltheeffort?Otherservices.IftheNavycomponentofPACOMsaysthisisaproblemrestassuredthere'sanArmycomponent,there'saMarinecomponent,there'sanAirForcecomponentwhoallthinkitisaswell,butfordifferentreasons.Doyouthinktheymighthaveavestedinterestinthis?Finally,SOCOMisacombatantcommand,butSOCOMalsoprovidesfolkstoPACOM.SoSOCOMhasavestedinterestinthisright?Slide28iswhatyou'vegottopayalotofattentionto.Money,contract,strategyandallthatotherstuff,it'sinterestingbutnotnecessarilygoingtohelpyouforthenext8weeks.Slide28will.Slides30-36JackieSpace:

SoPetejusttalkedabouttheacquisitionsystematlargeandIwanttojustdrilldownreallyquicklyintothemorepracticalaspectsofwhatitmeansforyourteamsandtheprogramsponsorsthatyou'reworkingwith,theproblemstatements,andhowitfitsintothis.Alsoforyou'rebeneficiariesandhowyoushouldbetalkingtothemasyou'reworkingthroughtheirproblems.

(Slide31)Quicklyaboutme,I'masystemsengineerbytrade,IwenttotheAirForceAcademy.Ispentthemajorityofmycareerdoinggovernmentacquisitions.I'veworkedverylargeprogramslikeGPSandI'vealsoworkedverysmallprogramsintermsofgettingthingsrapidlyfieldedintothefieldfromatechnologyperspective.

Page 19: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 19 of 20

(Slide32)Thepurposeofthisslideistotoconveytoyouthateventhoughyou'reallworkingwithdifferentgovernmentorganizationsandtheyallfallunderthisbigsystemofacquisitions.Everyorganizationisquitedifferentincultureandsowhenyou'reworkingwiththemyouneedtofigureout,1)dotheymove

rapidlyinhowtheydobusiness,2)howtheydeveloptechnology,3)howtheyfieldthem.Aretheyfocusedonlargerweaponssystemsandisit'sgoingtobetenyearsbeforetheyactualdevelopandfieldcapability.WhenIsayrapidImeanlikelessthan2years,versus10-yeartimelines.Partofyourworkistofigureoutwheredoesyourorganizationprogramsponsorresideinthattimeframe.(Slide33-34)

Thewholeacquisitionprocessisdesignedtodevelopbigprograms-liketheF35,ballisticmissiledefense,helicopters,-thatsortofthing.Allofthisexiststobeabletofieldbigweaponsprograms.Alotofthefrictionendsupwhenwehaverequirementsorwhenwehaveneedsthatemergethatdon'tfitintothetimeline.

Onslide33we'vegottheDARPA’sandtheAirForceResearchLabandtheotherlabsthatexistinthegovernmentthataredevelopingtechnologythatwillprobablynevereverleavethelab.Orinsomecasesitwilltake10yearsbeforeitactuallydoesanything.OnthisslideIputsomeoftheorganizationthattheteamsintheclassareworkingwithtoshowwheretheyfitintechnologymaturityandhowthey'redifferentfrombothendsofit.Ifyoulookattwoofthesponsorsinthisclass,theAsymmetricWarfareGroupandtheJointImprovisedThreatDefeatAgency,theyoperatedifferently.They'renotconcernedaboutweaponsystemsordevelopingthingsinsupportofthoseweaponsystems.Theseguysareonarapidtimelineandtheywanttofieldcapabilitiestouserrequirementsinlessthan2years.Alloftheproblemstatementsforteamsinthisclassfitwithinthiscategory.Thisiswheretheopportunitiesresidetoactuallymakeanimpactbecauseyouhaveashortertimelinetofieldinganddelivery.ThenyouhaveotherorganizationslikeSOCOM,NSA,CIA,andtheservicecomponentsthatplayinallpartsofthetimeline.Evenwiththeteamthat'sworkingwithSOCOMIwouldbetthattheyaremoreonthis2-yeartimelineforfieldingasolution.Butthat'ssomethingthatyoushouldbeaskingyourprogramsponsorswhenyou'reworkingwiththem,“Whatisyourtraditionaltimelineforfieldingtechnologies?”(Slide35)

Forentitiesoutsideofthetraditionaldefenseindustrialbasetoengage(ie.Startups),it'sreallyintheR&Dareaaswellasprototypedevelopment.Onecaution,whenyoutalkaboutgovernmentR&D,ifyoubringacapabilityyouwantthe

Page 20: Introduction to the DOD 101 workshop -  narrative H$D Stanford 2016

ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial4.0InternationalLicense

DOD/IC Workshop: Hacking for Defense Joe Felter, Pete Newell, Jackie Space Page 20 of 20

governmenttogiveyoumoneytohelpdevelop,youwilleventuallyhavetodealwithIPissues.Becauseanytimethegovernmentgivesyoumoneytodevelopsomething,theynowownit.Inothercaseswhereyouhaveacapabilitythat'smoredevelopedthatyoubringthattothegovernmentanddemoit,that'swhenyoucanactuallymaintainthemajorityofyourIP.(Slide36)

Iwanttotalkmoreaboutthequestionsthatyoushouldbetalkingtoyourbeneficiariesabout.…Mostofyouhavetalkedtothepotentialusersofyoursystemandyou'regettingfeedbackfromthem,whichisreallyvaluable.However,youneedtofindtheprogrammanagersand/orthepeoplethatareactuallyexecutingaprogramthatis

eithersimilarorhaspartsoftheproblemthatyou'redealingwith.That’sbecausetheprogrammanagerunderstandsthetimelineittakestofieldsomething,ie.Whatareallthethingsthattheyhavetogothroughtoactuallybringonacapabilitylikethat?Howdotheyengagewithindustry?Howdotheyactuallyparticipatewithpeopleoutsideoftheirprogram?Findingthatindividualorsetofindividualsisreallyimportantwillbereallyimportantforthisclass.Intermsoftheculture,Ithinkit'sincrediblyimportanttoasyou'retalkingtoyoursponsorstoaskthequestionsaboutthetrackrecordoftheirorganizationinactuallygettingsomethinglikeyoursolutionfielded?Howlongdidittake?Howmanytimeshavetheyactuallyattemptedthisparticulartechnologyset?Doyouknowwhothemissionpartnersaroundyouthatmaybeabletocontributetothat?TogetmoreinformationgotoFedBizOpps.gov.FedBizOpps.govisthemainmechanismbywhichthegovernmentwillpostorsolicitforindustryfeedback.They'llposttheirproblemssaying,wewantaproposalorwewantsomeinformationaroundthisactualtechnologythatwe'relookingat.IfyougotoFedBizOpps.govandyoutypeinakeywordaroundyourparticularproblem,whatcomesupwillbereallyinterestingbecauseyoumightfindthatthere'sfiveorsixotherorganizationsthatareactuallysolicitingforthesametechnology.Thanks,JoeFelter,PeteNewell,JackieSpace