Towards Concise Preservation by Managed Forgetting: Research Issues and Case Study

ForgetIT Project, GA 600826

Towards Concise Preservationby Managed Forgetting

iPRES-2013 ConferenceLisbon, Portugal5 September 2013

Nattiya Kanhabua, Claudia Niederée, and Wolf SiberskiL3S Research Center / Leibniz Universität Hannover

Hannover, Germany

2

Partners in the ForgetIT project

An interdisciplinary team of experts in:– Preservation, information management, information extraction– Multimedia analysis, storage computing, cognitive psychology

3

Outline

Motivation & VisionApproaches: First IdeasIntegration FrameworkPilot Applications: Overview

ForgetIT Project, GA 600826

4

Inspiration

A Computer that forgets ?Intentionally ??

And in context of preservation???

5

Inspiration

However we are facing– dramatic increase in content creation (e.g. digital photography)– information overload and changing professional + private lives– increasing storage costs for long-term storage (>10 years)– increasing use of mobile devices with restricted capacity– inadvertent forgetting in lack of systematic preservation



6

Inspiration


And: Forgetting plays a crucial role for human remembering and life in general (focus, stress on important information, forgetting of details)



7

Inspiration


And: Forgetting plays a crucial role for human remembering and life in general (focus, stress on important information, forgetting of details)



So: “Shouldn’t there be something like forgetting in digital memories as well?

ForgetIT

8

Complementing Human Memory

V. Mayer-Schönberger. Delete - The Virtue of Forgetting in the Digital Age. Morgan Kaufmann Publishers, 2009.

9

Motivation

major progress in preservation technology

maturing Information extractiontechnology

storage as service (e.g. clouds)

Opportunities increasing amount of digital contenthandled over decades

more or less systematic backup strategies used

non-paper practices for long-term perspective required

Needs

10

Motivation




Opportunities increasing amount of digital contenthandled over decades



Needs

large gap for adoption high-up front cost no established

practices lack of understanding

of benefit reluctance to invest

Major Obstacles

11

Vision: Building a Bridge




Opportunities increasing amount of

digital contenthandled over decades



Needs




Major Obstacles

12









Needs

Enabling smooth transition to preservation




Major Obstacles

13









Needs


Creating immediate benefit + reducing effort




Major Obstacles

14









Needs

ForgetIT



Opening alternatives to “keep it all” and “forgetting by accident”




Major Obstacles

15









Needs

ForgetIT




Easing interpretation in the long run




Major Obstacles

16









Needs

ForgetIT




Easing interpretation in the long run

taking inspiration from and complementing human memory




Major Obstacles

17

Building the Bridge

Managed Forgetting

Synergetic Preservation

Contextualized

Remembering

18

Building the Bridge

Managed Forgetting


Contextualized

Remembering

• as opposed to the current “forgetting by accident”

• inspired by human forgetting

19

Building the Bridge

Managed Forgetting


Contextualized

Remembering

• bringing back information into active use in a meaningful way



20

Building the Bridge

Managed Forgetting


Contextualized

Remembering

• bringing back information into active use in a meaningful way



• couples information management and preservation management

21

Simple Example: Holidays

+20 Years+5-10 Years+1 Yearsafter trip +1 month

• Trip to Paris with Friends

• Thousands of picures

22

• High awareness of trip details

• Showing of pictures

• Sorting out redundant pictures

• Sub-grouping and sorting





23









• Life goes on• Pictures go

out of focus• Creation of a

small diverse subset for showing occasionally

24












• Creation of summary page

• Addition of context info

• Further reduction of redundancy

• Rest of pictures into archiveFebruary 2015ParisTeam: Me, Mary Christine, Tom

25
















• Changes in life (e.g. marriage)

• Addition/update of context information

• Dealing with preservation issues

girlfriend

26



















girlfriendGirlfriendwife

27



















girlfriendGirlfriendwife

• Revisiting of Photo of trip photos

• Re-integration into overall photo collection (link into context)

Managed Forgetting

28

Automatic Deletion?

Managed Forgetting

inspired by central role of human forgetting

Aim: – help in identifying and focus on relevant information– supporting preservation content selection

will replace inadvertent forgetting

managed forgetting ≠ automatic deletion

instead: range of forgetting options e.g. – resource condensation– change of indexing & ranking– reduction of redundancy

29

Managed Forgetting






Based on:

30

Managed Forgetting






Based on:

careful information value assessment

31

decreasing memory buoyancy

Managed Forgetting






Based on:


forgetting strategies via policies

32


Managed Forgetting






Based on:



forgetting options to integrate final manual checking before deletion

33


Managed Forgetting






Based on:



forgetting options to integrate final manual checking before deletion

combination with multi-tier storage solution possible

34


Use of tiers

35

Contextualized Remembering

Aim: – bringing back information into active use in a meaningful

way even if a lot of time has passed– aiming for semantic level of preservation

Based on:

taking into account relevant parts of context when moving to archiveincreasing contextualization of preserved contentconsidering context evolution over time (evolution-aware contextualization)

Evolution-aware Contextualization & Re-contextualization

36

Context of Interpretation

t

C

Archival InformationSystem

Information System

D


37


t

C C‘


Information System

Human ForgettingChange in focusStructural changes

D


38


t

C C‘


Information System


Contextualization

DD


39


t

C C‘


Pres(D‘)

Pres(C‘)

Information System


Contextualization

D

Context-awarePreservation

DD


40


t

C C‘


Pres(D‘)

Pres(C‘)

Information System


C‘‘

Semantic evolutionStructural evolutionTerminology evolution

Contextualization

D


DD


41


t

C C‘


Pres(D‘)

Pres(C‘)

Information System


C‘‘


Contextualization

D


Semantic Evolution Detection

DD


42


t

C C‘


Pres(D‘)

Pres(C‘)

Information System


C‘‘

Evolution-awareContextualization

Pres(D‘)

Pres(C‘‘)


Contextualization

D



DD


43


t

C C‘


Pres(D‘)

Pres(C‘)

Information System


C‘‘

Evolution-awareContextualization

Re-contextualization

Pres(D‘)

Pres(C‘‘)


Pres(D‘)

Pres(C‘‘)

D

Contextualization

C‘‘‘

D



DD

ForgetIT Project, GA600826 - Kickoff Meeting, Hannover, February 2013

44


smooth and step-wise transition between active information use and preservation enables rich information flow in both directionssupports more informed preservation decisionseases preservation adoption

Data Management

Descr. Info.

Archival Storage

AIPs

Access

Ingest

Administration

Preservation Planning

Preserve-or-Forget Framework


Extraction & Contextualization

Re-Contextualization

Content Management

Access

Authoring

Administration

Adapter Layer

Managed Forgetting

Information Assessment Condensation

Arc

hiv

al In

form

atio

n S

yste

m

Info

rmat

ion

Man

agem

ent

Sys

tem

Integration Framework

45

Information Management System

• Resources + Meta data:• ResourceID• Content (size, tags, aging, geo)• Context (folder/file usage)• Social features • Resources neighbours (Graph)

Forgettor

Assessorcalculates:+ Memory Buoyancy+ Perservation Value

Analyzer1. Classification of resources

w.r.t. startegies2. Triggers forgetting actions

Strategies

ValuesStatistics

Resources Meta-Info

Resources Values + Decisions


46



Forgettor




Strategies

ValuesStatistics

Resources Meta-Info


Input: strategy meta-infomation (content, context,

neigbours )previous values


47



Forgettor




Strategies

ValuesStatistics

Forgetting strategies for

different types of resources

Resources Meta-Info





48



Forgettor




Strategies

ValuesStatistics



Resources Meta-Info




Processing Resources based on stategies and

information values


49



Forgettor




Strategies

ValuesStatistics



Resources Meta-Info





information values

Storing the new values and sending them back to IMS


50



Forgettor




Strategies

ValuesStatistics



Resources Meta-Info





information values

Storing the new values and sending them back to IMSArchives

Acce

ss

Stor

e

Store &access data

51

Application: Organizational Preservation

Starting point: existing and popular CMS (TYPO3)Sophisticated workflows for content creation and publicationBut: Separation of publication and preservation/archival Access to archived content is difficult and costly obsolete and even outdated information stays online

ForgetIT approach:Preservation as integral part (binary model gradual managed forgetting)

Bolder attitude towards removing content possibleAutomated support of cleaning up processesSupport of many stages of archiving, e.g. offline but still in index, aggregates online/ content in archive, only aggregates kept, etc.

Dissemination/Exploitation: Involvement of TYPO3 community, TYPO3 with preservation extension as open source project to TYPO3 community

52

Application: Personal Preservation

Starting point:tremendous growth of information in personal sphereDiversity and fast evolution of devices, platforms and formatsKeeping info sustainably available: Only ad hoc solutions for mid-term, long-term solutions

ForgetIT approach: Preservation solution for personal information spaceBased on concept of Semantic DesktopConsideration of social web content, multimedia content, other types of personal content, knowledge structuresAdditional short/mid-term benefit: de-cluttering information space by managed forgettingConsideration of multi-level infrastructures (e.g. mobile, PC, cloud)

Dissemination/Exploitation: Personal Preservation as a service (e.g. to customers of a telco company)

53

Variables & Dimensions

Personal Organization

Scenarios • Personal events (years at school, holidays, social events, graduations, marriage, etc)

• Public events

• Work-related events (project starts/closing, business trips, new products, etc.)

Data Type • Local: photos, mobile contacts, sms• Online: user-generated content• Feature:

1. documents2. user behaviors3. social context

• Local: textual documents• Online: web pages• Feature:

1. documents2. user roles3. policies

Interaction(user vs. system)

• search/retrieve, re-find• organize• explore• preserve

Action summarization, aggregation, delete

54

Information Value Assessment

Memory Buoyancy Preservation Value

Short-term relevance/interestsE.g., current meeting documents

Long-term interestsE.g. important life events

Subjective metrics+ usage logs (views, edits, modifies)+ social context, influences

Objective metrics+ diversity, coverage, quality

55

Thank you

http://ForgetIT-Project.eu/

Enter EventForgetIT Project, GA 600826

Towards Concise Preservation by Managed Forgetting: Research Issues and Case Study

Presentations & Public Speaking

Transcript of Towards Concise Preservation by Managed Forgetting: Research Issues and Case Study