Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery...

28
1 Rich Murphey ACS Automated Windows event log forensics Repair Correlate Extract Case Study Engagement Preliminary Results Final Report Log Analysis Extract Repair Correlate Interpret DFRWS Aug 13, 2007

Transcript of Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery...

Page 1: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

1

Rich MurpheyACS

Automated Windows event log forensics

Repair

Correlate

Extract

Case StudyEngagementPreliminary ResultsFinal Report

Log AnalysisExtractRepairCorrelateInterpret

DFRWS Aug 13, 2007

Page 2: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

2

Special Thanks ToSponsor:

Digital Forensic Services In-depth Analysis, Testimony

Data Recovery ServicesComplex RAID, Exotic File Systems

Technology Consulting

Reviewers: Matthew Geiger, CERTJerlyn Mardis, ACS

Page 3: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

3

Log Forensics Process

Forensic Process ModelsRepair

Correlate

Extract

Extract

Analyze

Interpret

Page 4: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

4

Log Forensics Process

Forensic Process ModelsRepair

Correlate

Extract

Recover:Step 1 – Extract

•Data Carve for Logs, etc.

Step 2 – Repair and Validate•Obtain valid log files.

Step 3 – Correlate•time, files, paths,…

Analyze

Interpret

Page 5: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

5

1st Hurdle: Define a ScopeOfficer/Director callsSomething bad happened….Possible contract violation.Outgoing transfer of proprietary documents.

#1: Define a scope of work.Can we identify file transfer?Examine hard drivesEmail attachmentsFile transfer, uploadsAnything else?

Page 6: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

6

2nd Hurdle: Preliminary ReportGood news:We know what to look for.Well defined keywords, file names

#2: Preliminary ReportD:\OfInterest.docIn unallocated space….

Bad News:IT deleted the user profile, andgave laptop to a new employee,

six months ago, after they reformatted andreinstalled Windows XP.

Page 7: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

7

Shortcuts#2: Preliminary ReportD:\OfInterest.docIn unallocated space….

Surrounding data looks like a shortcut.

Shortcuts contain a snapshot of:MAC timestampsFilenameAbsolute Path, Relative PathKind of Device (Hard disk/CD-ROM)Partition’s Volume Serial Number

Page 8: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

8

ShortcutsShortcuts may contain IDs, label, sizeA snapshot of file’s attributes, media’s attributes

Shortcut File

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 9: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

9

3rd Hurdle: Final Report

How to identify outgoingfile transfer?Data carve for file path, time….

Where to find time stamps?Event logsInternet historyShortcutsRegistry, and others?...

Page 10: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

10

Log Analysis

Log recovery process…

Step 1 – ExtractData Carve for Logs, etc.

Step 2 – RepairFix corrupt log files.

Step 3 – CorrelateFormulate queries for time, names,…

Page 11: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

11

XP log signature – 16 bytes30 00 00 00 4c 66 4c 65 01 00 00 00 01 00 00 00

Typical log sizes:512K on desktops1MB on servers

Signatures

Page 12: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

12

Using DataLifter:

Page 13: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

13

Log Recovery

scalpel.conf entry:evt y 1048576\x30\x00\x00\x00\x4c\x66\x4c\x65

\x01\x00\x00\x00\x01\x00\x00\x00

Step 1 – Initial script to recover logs:scalpel /dev/sda1

Repair

Correlate

Extract

Page 14: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

14

Step 1 – Extract

The Results:

Step 1 – ExtractRun DataLifter100 logs are extracted.Only two are viewable.98 corrupt logs

Step 2Repair 98 corrupt logs?

evt y 1048576 \x30\x00\x00\x00\x4c\x66\x4c\x65 \x01\x00\x00\x00\x01\x00\x00\x00% scalpel /dev/sda1

Page 15: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

15

Event LoggingWindows 2000, XP, 2003Time, SID, Source, Severity, Message

windows/system32/config:AppEvent.evtSecEvent.evtSysEvent.evtInternet.evt

Page 16: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

16

Repair

FixEvt – an XP log repair toolAutomatically repairs corrupt logs

Repairs or identifies known forms of corruption.

In seconds.

Steve Bunting's Manual Methodhttp://128.175.24.251/forensics

Repair

Correlate

Extract

http://murphey.org

Page 17: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

17

Repair

XP event log repairInvalid Header:

Trailer with good data:

Repaired Header:

Page 18: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

18

FixEvtAvailable on the web.A 4K command line executable.Very simple – no install.

% fixevt *.evt

For each log, FixEvt reports either:1 - Did not need repair2 - Was repaired3 - Cannot be repaired4 - Might be repaired by another method

Repair

Correlate

Extract

Page 19: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

19

Log Analysis

How the process worksStep 1 – ExtractRun DataLifter100 logs are extracted.98 corrupt logs.

Step 2 – Repair the LogsManual: 15 minutes/log * 98 Logs = 3 days“FixEvt *.evt”: 2 seconds.

Repair

Correlate

Extract

Page 20: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

20

Results

The Results:

Step 1 – Extract100 logs are extracted.98 corrupt logs.2 valid logs

Step 2 – Repair50 logs repaired52 Total logs.

Step 3 – Correlate events in 51 logs?

Repair

Correlate

Extract

scalpel /dev/sda1fixevt *.evt

Page 21: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

21

Correlate

LogParserInput:evt, IIS, REG, FS, ADS

Output:csv, XML, SQL, HTML

Run SQL queries onmultiple log files

Repair

Correlate

Extract

Page 22: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

22

Results50 logs were repaired.Some are still invalid due to corruption.Tools will not parse a sets containing corrupt logs.

Use LogParser to validate the logs.LogParser "select count(*) from log.evt"Returns an error status that indicates parsing errors.

Script to extract, repair and validate logs:

Result: 46 total valid logs23 empty, 23 non-empty87,413 events total

14 months of activity prior to reformatting of the hard drive.

Repair

Correlate

Extract

scalpel /dev/sda1fixevt *.evtfor i in *.evt;do LogParser "select count(*) from $i" \

&& cp $i goodlogs; done

Page 23: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

23

CorrelateStep 3 – Correlate

select <columns> from <table> into <output-file>

logparser “select * from system.evt into excel.csv”Reads the log file: system.evtCreates a spreadsheet of comma separated values“*” selects all columns of data

Write Queries – for correlating time, name…… select TimeGenerated, Message from system.evt …Output timestamp and full message

… where TimeGenerated > '2006-11-11 00:00:00' and TimeGenerated < '2006-11-12 00:00:00'

Filter a one day period.

… where Message like “%CD Burning%” …Filters for start, stop, running events

Page 24: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

24

CorrelateSQL queries to identify patterns

logparser“select TimeGenerated, Message

from system.evtwhere TimeGenerated > '2006-11-11 00:00:00'

and TimeGenerated < '2006-11-12 00:00:00‘and Message like “%CD Burning%”

Repair

Correlate

Extract

The CD Burning service entered the running state.11/11/2006 15:21

MessageTime (UTC)

The CD Burning service entered the running state.11/11/2006 15:26The CD Burning service entered the running state.11/11/2006 15:25The CD Burning service entered the running state.11/11/2006 15:24The CD Burning service entered the running state.11/11/2006 15:23The CD Burning service entered the running state.11/11/2006 15:22

The CD Burning service entered the stopped state.11/11/2006 15:27The CD Burning service entered the running state.11/11/2006 15:27

The CD Burning service was successfully sent a start control.11/11/2006 15:21

Page 25: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

25

ShortcutsShortcuts may contain IDs, label, sizeA snapshot of file’s attributes, media’s attributes

Shortcut File

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 26: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

26

Timestamp Analysis

Last write time is earlier than created.

Can indicate the time at which a file wastransferred from source media.Can help identify the location of the sourcemedia.

11/3/2006 10:12:34 AMLast write11/11/2006 3:21:14 PMCreated

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 27: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

27

ReportCorrelations indicateA CD-ROM was burnedOn this system.By account name: BobAt: 11/11/2006 3:21 PM UTC

The CD media may be identified:Label: “Nov 11 2006”Volume serial number: E2C3-F184

The source media may be identified:OfInterest.doc with size = 1643743 bytes, andLast Modified = 11/3/2006 10:12:34 AM UTC

Repair

Correlate

Extract

Page 28: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

28

[email protected]://murphey.orghttp://acsworldwide.com

Repair

Correlate

Extract