Mapping the Digital Preservation Wilderness: What you need to know

68
What You Need t o Know Mapping the Digital Preservation Wilderness Best Practices Exchange, 20 November 2014 Jody DeRidder [email protected]

Transcript of Mapping the Digital Preservation Wilderness: What you need to know

Page 1: Mapping the Digital Preservation Wilderness:  What you need to know

What You Need to Know

Mapping the

Digital Preservation

Wilderness

Best Practices Exchange, 20 November 2014Jody DeRidder

[email protected]

Page 2: Mapping the Digital Preservation Wilderness:  What you need to know

Digital Preservation can be

BIG

Page 3: Mapping the Digital Preservation Wilderness:  What you need to know

Digital Preservation can be

MURKY

Page 4: Mapping the Digital Preservation Wilderness:  What you need to know

Digital Preservation can be

CONFUSING

Page 5: Mapping the Digital Preservation Wilderness:  What you need to know

Digital Preservation can be

SCARY

Page 6: Mapping the Digital Preservation Wilderness:  What you need to know

Digital Preservation

is a SWAMP

Page 7: Mapping the Digital Preservation Wilderness:  What you need to know

Three Existing Maps

• Open Archival Information System (OAIS) Model

• Digital Curation Centre (DCC) Curation Lifecycle

Model

• Digital Preservation Outreach & Education (DPOE)

Modules

Page 8: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices: OAIS

"Reference Model for an Open Archival Information System (OAIS)," 2012.

Page 9: Mapping the Digital Preservation Wilderness:  What you need to know

The OAIS Component Areas

• Preservation Planning

• Administration and Management

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

• Data Management

• Archival Storage

~~~~~~~~~~~~~~~~~~~~~~~~~~

• Receive (submission) (SIP)

• Ingest (AIP)

• Access (DIP)

Page 10: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices: DCC

Digital Curation Centre (DCC): http://www.dcc.ac.uk/resources/curation-lifecycle-model

Page 11: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices: DCC

Digital Curation Centre (DCC): http://www.dcc.ac.uk/resources/curation-lifecycle-model

Page 12: Mapping the Digital Preservation Wilderness:  What you need to know

The DCC Component Areas

• Curate

• Preserve

~~~~~~~~~~~~~~~~~~~~~~~~~~~~

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 13: Mapping the Digital Preservation Wilderness:  What you need to know

DCC and OAIS• Curate

• Preserve

~~~~~~~~~~~~~~~~~~~

Create or Receive

• Appraise and Select

Ingest

• Preservation Action

• Store

Access, Use, and Reuse

• Transform

• Preservation Planning

• Administration and Management

~~~~~~~~~~~~~~~~~~~~~~~~~

• Data Management

• Archival Storage

~~~~~~~~~~~~~~~~~~~~~~~~~~

Receive (submission) (SIP)

Ingest (AIP)

Access (DIP)

Page 14: Mapping the Digital Preservation Wilderness:  What you need to know

DCC and OAIS• Curate

• Preserve

~~~~~~~~~~~~~~~~~~~

Create or Receive

• Appraise and Select

Ingest

• Preservation Action

Store

Access, Use, and Reuse

• Transform

• Preservation Planning

• Administration and Management

~~~~~~~~~~~~~~~~~~~~~~~~~

• Data Management

Archival Storage

~~~~~~~~~~~~~~~~~~~~~~~~~~

Receive (submission) (SIP)

Ingest (AIP)

Access (DIP)

Page 15: Mapping the Digital Preservation Wilderness:  What you need to know

DCC and OAIS• Curate

• Preserve

~~~~~~~~~~~~~~~~~~~

Create or Receive

Appraise and Select

Ingest

Preservation Action

Store

Access, Use, and Reuse

Transform

• Preservation Planning

• Administration and Management

~~~~~~~~~~~~~~~~~~~~~~~~~

Data Management

Archival Storage

~~~~~~~~~~~~~~~~~~~~~~~~~~

Receive (submission) (SIP)

Ingest (AIP)

Access (DIP)

Page 16: Mapping the Digital Preservation Wilderness:  What you need to know

DCC and OAISCurate

Preserve

~~~~~~~~~~~~~~~~~~~

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Preservation Planning

Administration and Management

~~~~~~~~~~~~~~~~~~~~~~~~~

• Data Management

• Archival Storage

~~~~~~~~~~~~~~~~~~~~~~~~~~

• Receive (submission) (SIP)

• Ingest (AIP)

• Access (DIP)

Page 17: Mapping the Digital Preservation Wilderness:  What you need to know

identify

select

store

protect

manage

provide

Digital Preservation Outreach & Education

DPOE Baseline Modules: Intro, version 2.0, Nov 2011

Page 18: Mapping the Digital Preservation Wilderness:  What you need to know

DPOE and DCC

• Identify

• Select

• Store

• Protect

• Manage

• Provide

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 19: Mapping the Digital Preservation Wilderness:  What you need to know

DPOE and DCC

• Identify

• Select

• Store

• Protect

• Manage

• Provide

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 20: Mapping the Digital Preservation Wilderness:  What you need to know

DPOE and DCC

• Identify

• Select

• Store

• Protect

• Manage

• Provide

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 21: Mapping the Digital Preservation Wilderness:  What you need to know

DPOE and DCC

• Identify

• Select

• Store

• Protect

• Manage

• Provide

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 22: Mapping the Digital Preservation Wilderness:  What you need to know

DPOE and DCC

• Identify

• Select

• Store

• Protect

• Manage

• Provide

• Create or Receive

• Appraise and Select

• Ingest

• Preservation Action

• Store

• Access, Use, and Reuse

• Transform

Page 23: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation Actions

• Storage & Protection

• Providing access

Page 24: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 25: Mapping the Digital Preservation Wilderness:  What you need to know

Creating & Receiving

• Use open source software, such as Open Office

• PDF/A

• Open format exports of databases

• Prefer archival formats & collect metadata

• Document, document, document

Page 26: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 27: Mapping the Digital Preservation Wilderness:  What you need to know

Identification

Best Practices:

1: Don’t change the original!

2. Protect your computer

2: Collect metadata during receipt

3. Verify formats

4. Extract and store technical metadata

PRONOM registry of file formats: http://apps.nationalarchives.gov.uk/PRONOM

Page 28: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 29: Mapping the Digital Preservation Wilderness:  What you need to know

Appraisal & Selection

Guidelines:

Digital Preservation and Outreach Education (DPOE):

• does the content have value?

• does it fit your scope?

• is it feasible for you to preserve the content?

• is it technically and legally possible to make the content available?

NARA : http://1.usa.gov/10VQUbT

Page 30: Mapping the Digital Preservation Wilderness:  What you need to know

Appraisal & Selection

Tools:

BitCurator: http://www.bitcurator.net/

DigiPres Commons: http://www.digipres.org/tools/by-function/

Page 31: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage &Protection

• Providing access

Page 32: Mapping the Digital Preservation Wilderness:  What you need to know

Ingestion & Preservation Actions

• Extract and generate preservation

metadata

• Relate all metadata to files

• Verify and validate digital objects

• Normalize file formats/structures

Page 33: Mapping the Digital Preservation Wilderness:  What you need to know

Ingestion & Preservation Actions

Formats & Transformation:

• Consider significant properties

• Normalize to archival formats

• Test results

• Retain original

Sustainability of Digital Formats (LOC):http://www.digitalpreservation.gov/formats/

Page 34: Mapping the Digital Preservation Wilderness:  What you need to know

Ingestion & Preservation Actions

Preservation Metadata includes:

• Descriptive

• Structural

• Administrative:

o Rights

o Technical

PREMIS:

http://www.loc.gov/standards/premis/

Page 35: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 36: Mapping the Digital Preservation Wilderness:  What you need to know

Storage & Protection

Trusted Digital Repositoriesand

Trusted Repository Audit Checklist

http://bit.ly/1tR5RGy

Use for Gap Analysis:

• Where are we?

• Where do we want to be?

• Therefore, what gaps need to be filled?

Page 37: Mapping the Digital Preservation Wilderness:  What you need to know

Storage & Protection

CLOCKSS: http://bit.ly/1zdgllh

ADPNet: http://www.adpn.org/

Page 38: Mapping the Digital Preservation Wilderness:  What you need to know

Storage & Protection

Plan for:

• Business Continuity

• Succession Plan

• Crisis Communication

• Cyber Incident Response

• IT Contingency

• Disaster recovery

From NIST Contingency Planning Guide for Information Technology Systems, pg. 10.

Page 39: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 40: Mapping the Digital Preservation Wilderness:  What you need to know

Providing Access

• To the information needed

• Metadata, search & retrieval

• At the point of need

• When and where it is required

• In the form needed

• Emulating or transforming it as required

Page 41: Mapping the Digital Preservation Wilderness:  What you need to know

Areas for best practices

• Creating / Receiving

• Identification

• Appraisal & Selection

• Ingestion & Preservation actions

• Storage & Protection

• Providing access

Page 42: Mapping the Digital Preservation Wilderness:  What you need to know

What ARE best practices?

A set of:

• guidelines,

• techniques or

• methods

that represent the most

efficient or prudent

course of action.

Page 43: Mapping the Digital Preservation Wilderness:  What you need to know

How do we create best practices?

• Find something that works

• Compare it to other approaches

• Test it in all feasible contexts

Page 44: Mapping the Digital Preservation Wilderness:  What you need to know

Not Just Technical

Page 45: Mapping the Digital Preservation Wilderness:  What you need to know

Pattern of Experiences

Page 46: Mapping the Digital Preservation Wilderness:  What you need to know

Swamps have

hidden dangers

Page 47: Mapping the Digital Preservation Wilderness:  What you need to know

No!

Picture of a brick wall

Page 48: Mapping the Digital Preservation Wilderness:  What you need to know

Kubler-Ross’ 5 Stages of Grief

DenialAngerBargainingDepressionAcceptance

Page 49: Mapping the Digital Preservation Wilderness:  What you need to know

Denial

Olga Bonfiglio, www.resilience.org

Page 50: Mapping the Digital Preservation Wilderness:  What you need to know

Anger

Page 51: Mapping the Digital Preservation Wilderness:  What you need to know

Bargaining

www.stop-finance.org

Page 52: Mapping the Digital Preservation Wilderness:  What you need to know

Depression

Page 53: Mapping the Digital Preservation Wilderness:  What you need to know

Acceptance

Page 54: Mapping the Digital Preservation Wilderness:  What you need to know

What’s behind all that?

FEAR

John Zande, www.rationalhub.com

Page 55: Mapping the Digital Preservation Wilderness:  What you need to know

We’re All Battling Monsters

Page 56: Mapping the Digital Preservation Wilderness:  What you need to know

How do I respond?

Pay attention!ThinkReflectSupport

Page 57: Mapping the Digital Preservation Wilderness:  What you need to know

Transformational Cycle

Deep Change: Discovering the Leader Within by Robert E. Quinn

Transformational Phase

RoutinizationPhase

Initiation Phase

Uncertainty Phase

Page 58: Mapping the Digital Preservation Wilderness:  What you need to know

The Initiation Phase

Desire, Fear and Vision

Risks:

stagnation, or illusion.

Page 59: Mapping the Digital Preservation Wilderness:  What you need to know

The Uncertainty Phase

Experimentation and Insight

Risk of panic

Page 60: Mapping the Digital Preservation Wilderness:  What you need to know

The Transformational Phase

Confirmation and Synergy

Risk of exhaustion

Page 61: Mapping the Digital Preservation Wilderness:  What you need to know

The Routinization Phase

Mastery and Confidence

Risk of stagnation

Page 62: Mapping the Digital Preservation Wilderness:  What you need to know

Transformational Cycle

Deep Change: Discovering the Leader Within by Robert E. Quinn

Confirmation and Synergy

Mastery and Confidence

Desire and Vision

Experimentation and Insight

Page 63: Mapping the Digital Preservation Wilderness:  What you need to know

Success through Connections

Page 64: Mapping the Digital Preservation Wilderness:  What you need to know

People = Capital

Page 65: Mapping the Digital Preservation Wilderness:  What you need to know

What makes us valuable

• Courage

• Curiosity

• Willingness to:

Collaborate

Support one another

Page 66: Mapping the Digital Preservation Wilderness:  What you need to know

What we face

Page 67: Mapping the Digital Preservation Wilderness:  What you need to know

What we need:

Page 68: Mapping the Digital Preservation Wilderness:  What you need to know

Together We Succeed