FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15...

38
FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE Saâd Kadhi CERT-BDF / TheHive Project A SCALABLE, OPEN SOURCE AND FREE INCIDENT RESPONSE PLATFORM

Transcript of FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15...

Page 1: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE

Saâd Kadhi CERT-BDF / TheHive Project

A SCALABLE, OPEN SOURCE AND FREE INCIDENT RESPONSE PLATFORM

Page 2: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVATIONSTHREATS & REACTION

Page 3: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

DRIVING DOWN THE TIME TO REACT

FAST-PACED THREAT

LANDSCAPE

HIGH NUMBER OF SECURITY

EVENTS

TALENT SHORTAGE

LIMITED MONEY & TIME

AUTOMATION

COMPLEXITY

COLLABORATION

Continuous improvement

Page 4: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

DFIR = TEAM WORK

▸ DFIR = team work

▸ Mantra: 'with enough eyeballs, skills and mindsets, all threats are shallow'

▸ We shall seek to drive DFIR activity and continuously improve it

▸ Thanks to operational, meaningful statistics

Page 5: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

SHARING IS CARING

▸ Investigation performed, IOCs collected and proper response done

▸ Wouldn’t they be useful to peers to defend themselves?

▸ Hopefully, they will come up with complementary IOCs that were unbeknownst to us

Page 6: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

SPECSHUNTING FOR A SOLUTION

Page 7: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

AUTOMATION & COLLABORATION

▸ Let many analysts work on multiple cases, sometimes simultaneously

▸ Collect observables and make their analysis as simple as possible

▸ Index observables, cases and any noteworthy evidence or reference

Page 8: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

AUTOMATION & COLLABORATION

▸ Maintain history & an audit trail

▸ Change behavior according to the TLP

▸ Offer open, documented API to extract IOCs or create cases out of MISP events, email reports or SIEM alerts

▸ Generate statistics to drive and improve the activity

▸ Facilitate report writing

Page 9: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

WE ARE HUMANS — WARNING / 'EXPERT' DEBATE

▸ Human interaction with the constituency may be negatively impacted by a ticketing system

▸ Do not expose tickets to the constituency

▸ Automation is good… until it strips away the social aspects of our work

Page 10: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

BACK IN 2014…

▸ Hunting for a solution started in early 2014

▸ Solutions existed but partially fulfilled the requirements

▸ Office (*cough*), AbuseHelper, RTIR, MISP, CIF, Resilient Systems…

▸ Build vs. buy: given the requirements and our skills, we decided to build

Page 11: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

THEHIVELEARNING FROM BEES

Page 12: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

▸ 3-IN-1

▸ Collaboration platform

▸ Task & work log

▸ Analysis and storage platform

▸ Supports LDAP, Active Directory & local accounts for authentication

▸ Used by several CERTs/CSIRTs throughout the world

Page 13: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

ARCHITECTURE

BACKEND

STORAGE

FRONTEND

RESTAPIS

HTTP

A A A A

ANALYZERS

RESTAPIS

HTTP

CORTEX

Page 14: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

WORKFLOW

CASE

TASK

LOG

OBSERVABLE

JOB

ANALYZER

CASE TEMPLATE

AUDIT

USER

TASKTASK

LOGLOG

OBSERVABLEOBSERVABLE ANALYZERANALYZER

JOBJOBREPORT

TEMPLATE

ALERT / MISP EVENT

ANALYSIS REPORT

Page 15: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

MAIN FEATURES

▸ Import & sync events from several MISP instances

▸ Preview alerts from multiple sources (SIEM, IDS, email…)

▸ Handle cases the way you want using templates

▸ Analyze observables through several Cortex instances

▸ Leverage statistics to drive the activity

▸ Stay up-to-date on new cases, tasks, analysis jobs thanks to the real-time stream

Page 16: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

▸ Automate bulk observable analysis through a REST API

▸ Query analyzers through a Web UI to quickly assess the malicious nature of observables

▸ Analyzers can be developed in any programming language that is supported by Linux

▸ Invoke MISP expansion modules

▸ Can be queried from MISP to enrich events

Page 17: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

23 ANALYZERS (AND MORE ARE COMING)

FORTIGUARD URL CATEGORY

CIRCL PDNSCIRCL PSSL

MISP SEARCH

DOMAINTOOLS

PASSIVETOTAL

VIRUSTOTAL

ABUSE FINDER

FILEINFO

OUTLOOK MSG PARSER

NESSUS

OTXQUERY

HIPPOCAMPE

GOOGLE SAFE BROWSING

DNSDB

YARA

PHISHING INITIATIVE

PHISHTANK

MAXMIND

JOE SANDBOX

SPLUNK SEARCH

FIREHOL

VMRAY

IRMA

MCAFEE ATD

CUCKOO

FAME

INTELMQ

WHOISXMLAPI

FIREEYE AX

HYBRID ANALYSIS

Page 18: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

GET THE SOFTWARE

▸ TheHive and Cortex are available under an AGPL license

▸ Can be installed using RPM, DEB, Docker image, binary package or built from the source code

▸ Pre-requisites: Linux with JRE 8+, Chrome, Firefox, IE (11), and a decent computer

▸ https://thehive-project.org/

Page 19: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

DEMO?SHOW TIME

Page 20: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

MAIN VIEW

Page 21: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

LIVE STREAM

Page 22: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

CASE VIEW

Page 23: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

CASE VIEW

Page 24: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

LOG VIEW

Page 25: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVABLE VIEW

Page 26: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVABLE VIEW

Page 27: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVABLE VIEW

Page 28: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVABLE VIEW

Page 29: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

OBSERVABLE VIEW

Page 30: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

STATISTICS

Page 31: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

STATISTICS

Page 32: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

STATISTICS

Page 33: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

CORTEX

Page 34: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

CORTEX

Page 35: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

CORTEX

Page 36: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

THE BIG PICTURECOME AGAIN?

Page 37: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

VIRUSTOTAL

DOMAINTOOLS

PASSIVETOTAL

HIPPOCAMPE

MAXMIND

PHISHTANK PHISHING INITIATIVEOTXQUERY

DNSDB

ABUSE FINDER

URLCATEGORY

Analyzers

FILEINFO

OUTLOOK MSGPARSER

URLQUERY WHOISXMLAPI

CORTEX4PY

THEHIVE4PY

SIEM

EMAIL

ALTERNATE SIRP

ALT. ALERT SOURCE

MISP NESSUS JOE SANDBOX

VMRAY CIRCL PSSL CIRCL PDNS YARA

GOOGLE SAFE BR. VMRAY

Page 38: FIRST CONFERENCE 29 / 2017-06-15 TLP:WHITE A SCALABLE ... · first conference 29 / 2017-06-15 tlp:white saâd kadhi cert-bdf / thehive project a scalable, open source and free incident

THANK YOU!

NABIL ADOUANI CERT-BDF

CORE TEAM

MAIN CONTRIBUTORS

THOMAS FRANCO SAÂD KADHI JÉRÔME LEONARD

CONTRIBUTORS

RÉMI POINTEL

ANTOINE BRODINMEHDI ASCHY

THEHIVE PROJECT

ERIC CAPUANOCERT-BUND

GUILLAUME ROUSSE