Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics...
Transcript of Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics...
![Page 1: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/1.jpg)
Data-DrivenThreatIntelligence:MetricsonIndicatorDisseminationandSharing
(#ddti)
AlexPintoChiefDataScientist
MLSec Project/Niddel@alexcpsec
@MLSecProject /Niddel
![Page 2: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/2.jpg)
• WhatisTIgoodfor?• CombineandTIQ-test• MeasuringIndicators• ThreatIntelligenceSharing• Futureresearchdirection(i.e.willworkfordata)
Agenda
HTto@RCISCwendy
![Page 3: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/3.jpg)
WhatisTIgoodfor(1)Attribution
![Page 4: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/4.jpg)
WhatisTIgoodforanyway?
TYto@bfist forhisworkonhttp://sony.attributed.to
![Page 5: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/5.jpg)
WhatisTIgoodfor(2)– CyberMaps!!
TYto@hrbrmstr forhisworkonhttps://github.com/hrbrmstr/pewpew
![Page 6: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/6.jpg)
WhatisTIgoodforanyway?• (3)Howaboutactualdefense?• Strategicvs.tacticalvs.operational:planning• Technicalindicators:DFIRandmonitoring
![Page 7: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/7.jpg)
AffirmingtheConsequentFallacy
1. IfA,thenB.2. B.3. Therefore,A.
1. Evilmalwaretalksto8.8.8.8.2. Iseetrafficto8.8.8.8.3. ZOMG,APT!!!
![Page 8: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/8.jpg)
Thisisadata-driventalk!Pleasecheckyouranecdotesatthedoor
![Page 9: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/9.jpg)
CombineandTIQ-Test• Combine(https://github.com/mlsecproject/combine)• GathersTIdata(ip/host)fromInternetandlocalfiles• Normalizesthedataandenrichesit(AS/Geo/pDNS)• CanexporttoCSV,“tiq-testformat”andCRITs• h/t@kylemaxwell,@sconzo,@c0wl
• TIQ-Test(https://github.com/mlsecproject/tiq-test)• RunsstatisticalsummariesandtestsonTIfeeds• Generateschartsbasedonthetestsandsummaries• WritteninR(becauseyoushouldlearnastatlanguage)• h/t@hrbrmstr
![Page 10: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/10.jpg)
SuddenlyDatahttps://github.com/mlsecproject/tiq-test-Summer-2015
![Page 11: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/11.jpg)
![Page 12: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/12.jpg)
UsingTIQ-TEST– FeedsSelected• Datasetwasseparatedinto“inbound”and“outbound”
TYto@kafeine andJohnBambenek foraccesstotheirfeeds
![Page 13: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/13.jpg)
DataFormatforTIQ-TEST
![Page 14: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/14.jpg)
TonsofThreat-yTests
• NOVELTY – Howoftendothefeedsupdatethemselves?• AGING – Howlongdoesanindicatorsitonafeed?• POPULATION – Howdoesthispopulationdistributioncomparetomydata?
• OVERLAP– Howdotheindicatorscomparetotheonesyougot?
• UNIQUENESS – Howmanyindicatorsarefoundonlyononefeed?
Puttingthisthreatdatatowork
![Page 15: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/15.jpg)
TonsofThreat-yTests
• NOVELTY – Howoftendothefeedsupdatethemselves?• AGING – Howlongdoesanindicatorsitonafeed?• POPULATION – Howdoesthispopulationdistributioncomparetomydata?
• OVERLAP– Howdotheindicatorscomparetotheonesyougot?
• UNIQUENESS – Howmanyindicatorsarefoundonlyononefeed?
Puttingthisthreatdatatowork
![Page 16: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/16.jpg)
OverlapTestMoredataisfine,butmakesure
itisdifferent
![Page 17: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/17.jpg)
OverlapTest- Inbound
![Page 18: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/18.jpg)
OverlapTest- Outbound
![Page 19: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/19.jpg)
UniquenessTestHowmanyfishREALLYarethereatthesea?
![Page 20: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/20.jpg)
![Page 21: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/21.jpg)
![Page 22: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/22.jpg)
Ihatequotingmyself,but…
![Page 23: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/23.jpg)
KeyTakeaway#1
MORE!=BETTERThreatIntelligenceIndicatorFeeds
ThreatIntelligenceProgram
![Page 24: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/24.jpg)
![Page 25: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/25.jpg)
“TISharingisTOTALLYgoingtosolvethis”
Right,people?Right?
![Page 26: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/26.jpg)
HerdImmunity,isit?
Source:www.vaccines.gov
![Page 27: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/27.jpg)
![Page 28: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/28.jpg)
![Page 29: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/29.jpg)
ThreatIntelligenceSharingWewouldliketothankthekindcontributionofdatafromthefinefolksatFacebookThreatExchangeandThreatConnect…
…andalsothesharingcommunitiesthatchosetoremainanonymous.Youknowwhoyouare,andwe❤ youtoo.
![Page 30: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/30.jpg)
ThreatIntelligenceSharing– Data
Fromaperiodof2015-03-01to2015-05-31:- NumberofIndicatorsShared
§ Perday§ Permember
Notsharingthisdata– privacyconcernsforthemembersandcommunities
![Page 31: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/31.jpg)
OVERLAPSLIDE
![Page 32: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/32.jpg)
OVERLAPSLIDE
![Page 33: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/33.jpg)
UNIQUENESSSLIDE
![Page 34: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/34.jpg)
TheCognitiveDissonancesofTISharing
Everybody shouldshare! TheCIRCLEOFTRUST
![Page 35: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/35.jpg)
Whatdoyoushare?
Whatdoyouconsume?
TheTwoSidesofTrust
![Page 36: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/36.jpg)
ActivityTestIsthereanyactualsharinggoing
on?
![Page 37: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/37.jpg)
Updatefrequencychart
High10saverage Low100saverage
Large– 10.000smembers Small– High10smembers
![Page 38: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/38.jpg)
DiversityTestCheckyoursharingprivilege
![Page 39: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/39.jpg)
![Page 40: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/40.jpg)
![Page 41: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/41.jpg)
RecallTestButisthedataanygood?
![Page 42: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/42.jpg)
![Page 43: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/43.jpg)
Whatdoesgoodcurationlookslike?
![Page 44: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/44.jpg)
KarmaandAnonymity
![Page 45: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/45.jpg)
![Page 46: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/46.jpg)
KeyTakeaway#1
'Howcansharingmakemebetterunderstandwhatare
attacksthat“aretargeted”andwhatare“commodity”?'
![Page 47: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/47.jpg)
Telemetry>AnalysisNoteveryoneshouldneedtoknowhowtohunttomakeameaningfulcontribution
![Page 48: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/48.jpg)
MoreTakeaways
• Analyzeyourdata.Extractmorevaluefromit!• IfyouABSOLUTELYHAVETObuyThreatIntelligenceordata,evaluateitfirst.
• Trythesampledata,replicatetheexperiments:• https://github.com/mlsecproject/tiq-test-Summer2015• http://rpubs.com/alexcpsec/tiq-test-Summer2015
• Sharedatawithus.I’llmakesureitgetsproperexercise!
![Page 49: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/49.jpg)
![Page 50: Data-Driven Threat Intelligence: Metrics on Indicator ......Data-Driven Threat Intelligence: Metrics on Indicator Dissemination and Sharing (#ddti) Alex Pinto Chief Data Scientist](https://reader033.fdocuments.in/reader033/viewer/2022042711/5f81997644f1fd21db324dc4/html5/thumbnails/50.jpg)
Thanks!
• Q&A?• Feedback!
”Themeasureofintelligenceistheabilitytochange."- AlbertEinstein
AlexPinto@alexcpsec
@MLSecProject /@NiddelCorp