IBM - 2007 - The Challenges of Building Enterprise Content Taxonomies and the Role of Classification...

8/17/2019 IBM - 2007 - The Challenges of Building Enterprise Content Taxonomies and the Role of Classification Technologies in Maintaining

1/39

© 2007 IBM Corporation 1

The Challenges of Building EnterpriseContent Taxonomies and the Role of

Classification Technologies in MaintainingTheir EffectivenessReginald J. Twigg, Ph.D. (rtwigg!".i#$.%o$&Capt!re, Cla""i'i%ation and Taono$), IBM *CM


2/39

© 200+ IBM Corporation

Information Management Software | *nterpri"e Content Manage$ent

2

Agenda

The Challenge o' n"tr!%t!red Content

-e) Con%ept" and Ter$"

Taono$), Cla""i'i%ation and *CM doption

Cla""i'i%ation Te%hnologie" 'or *CM


3/39

© 2007 IBM Corporation /

The Challenge of ManagingUnstructured Content


4/39



4

80% of nter!rise "ata is Unstructured

"ata#ases

Billing "tate$ent"

Clai$" i$age" C!"to$er

%orre"ponden%e Mortgage do%" Contra%t" igned B3" 4ealth%are *B"

Mar5eting %ollateral 6e#"ite %ontent oi%e a!thori8ation" ignat!re %ard" Credit enroll$ent" Material a'et) Data

heet" I 9000 do%" Plant "%he$ati%" Prod!%t i$age" pe% "heet"

:.and $!%h $ore;


5/39



$

hat is nter!rise Content&


6/39



'

here do I start&

6e00 ?B o' %ontent 'ro$#a"i% %ontent "er=i%e" all o=er theenterpri"e.4ow %an we get thi" %ontente''i%ientl) $apped into o!r *CMtaono$)@

6e


7/39© 200+ IBM Corporation


(

-e) B!"ine"" Dri=er"

In%rea"e wor5er

prod!%ti=it) anda!to$ate %ontent

related de%i"ion"

Ad )oc Categor*

Suggestion

Content+,ased

or-flow Selection

Content ,ased

"ecision Ma-ing

In Pro%e""

Cla""i'i%ation

In%rea"e a%%e""i#ilit) o'

%ontent !nder

$anage$ent

Automated. )igh Scale

Classification

Classif* at ingestion

and/or re+classif* oer

time

Ta1onom* olution

Tools

nhanced Accessi#ilit*

Ta1onom* ro!oser

*CM Taono$) and

Cla""i'i%ation

In%rea"e legal

di"%o=er) re=iewe''e%ti=ene"" while

red!%ing ri"5

3egal "iscoer*

rioritiation and

or-flow Assignment

5ecords Classification

and 1ce!tion )andling

Storage and 5etention

olic* Assignment

Co$plian%e,

Re%ord", 3egal

Di"%o=er)

Red!%e in!ir) %o"t",

a!to$ate $e""agero!ting and in%rea"e

%!"to$er "ati"'a%tion

mail. Chat 5outing

Agent 5es!onse

Suggestion mail Su!erision

and Monitoring

Automatic

Customer 5es!onse

Me""age Tagging,

Cla""i'i%ation and

Monitoring1 32 4

,usiness 6alue of Classification for CM




8

Percent of corporate information value managed intraditional databases

Data Creation

And

Demand

OLTP and BI

(narrow scope)Application

Tpes

Compliance! Competitive

Intelligence (wide scope)

Source: Gartner

"nstructured

Data

#tructured

Data

A#ilit* to Structure Content with "ata#ases




7

Multi!le 5e!ositories Ma-e Access "ifficult

/>

1A

2E

17

1 repo"itor)E

2FE repo"itorie"

>F10 repo"itorie"10F1E repo"itorie"A

More than 1E

repo"itorie"

DonGt 5now

Ba"e +1 Horth $eri%an de%i"ionF$a5er"

($!ltiple re"pon"e" a%%epted&

The 9uture of Content in the nter!rise.:

Connie Moore and 5o#ert Mar-ham




;0

And Then There


11/39

© 2007 IBM Corporation 11

>e* Conce!ts and Terms




;2

>e* Conce!ts

Metadata: a $ean" o' de"%ri#ing, lo%ating, %ataloging, anda%ti=ating %ontent a" o#e%t" in a "o'tware e%o")"te$ (literall),

data a#o!t data&.

nter!rise Catalog? a %entrali8ed and nor$ali8ed $etadata

$odel 'or !n"tr!%t!red %ontent 'or the p!rpo"e" o' pro=iding

%on"i"tent "er=i%e" a%ro"" all *CM appli%ation".

Taxonomy: a hierar%hi%al "tr!%t!re o' in'or$ation

%o$ponent", an) part o' whi%h %an #e !"ed to %la""i') a

%ontent ite$ in relation to other ite$" in the "tr!%t!re.

Classification: a %oding o' %ontent ite$" a" $e$#er" o' agro!p 'or the p!rpo"e" o' %ataloging the$ or a""o%iating the$

with a taono$).


13/39



;@

Ta1onom* Is = = =

Not t!rning ani$al" intotrophie"

")"te$ 'or organi8ing the%orp!" o' #!"ine"" %ontent

http://images.google.com/imgres?imgurl=http://www.horns-a-plenty.com/graphics-illustrations/mounts-deer-i.jpg&imgrefurl=http://www.horns-a-plenty.com/Level%25202/shed_antler_taxidermy.htm&h=485&w=355&sz=38&hl=en&start=7&um=1&tbnid=AdYbC5cWRtrIEM:&tbnh=129&tbnw=94&prev=/images%3Fq%3DDeer%2BMount%26svnum%3D10%26um%3D1%26hl%3Den%26client%3Dfirefox-a%26rls%3Dorg.mozilla:en-US:official%26sa%3DG


14/39



;4

Ta1onom* and Classification in CM

Classification Examples: Do%!$ent Cla""ing

Koldering

Taxonomy Examples:

*nterpri"e Content Catalog

Ind!"tr) tandard Do%!$ent Taono$ie" (I, LMI&

Methods:

Rules-Based: pplie" preFdeter$ined r!le" 'or i',then< %la""i'i%ation o' tet and propertie"

nalytics-Based: pplie" algorith$" to interpret%la""e" in order to appl) %la""i'i%ation r!le" to the$


15/39



;$

CM Ta1onom* Illustrated


16/39

© 2007 IBM Corporation 1>

Ta1onom*. Classification and CMAdo!tion


17/39



;(

"rie ew ,usiness 6alue from Content

ContentCla""i'i%ation

ol!tion"

I$pro=e Content %%e"" rgani8e n"tr!%t!red Content

Deri=e B!"ine"" In"ight


18/39



;8

,usiness "riers for CM Ta1onom* Management

!"olife"atin# depa"tmental solutions

Content Manage$ent

Colla#oration (P, N!i%5r, Tea$ Roo$", 6i5i"&

$se"-%ased classification and hi#h &o"'fo"cetu"no(e"

Prod!%ti=it) de%line" a" 5nowledge di"appear"

3egal di"%o=er) i" a "e%ondar) %on%ern

Me"#e"s and c)uisitions need to re%on%ile di"parate

%ontent $anage$ent pra%ti%e", repo"itorie" andpro%e""e"


19/39

I f i M S f | * i C M


20/39



20

Brganiation is the 5oot Cause

Mo"t organi8ation" 'a%e %ontent taono$) #arrier"

e"pe%iall) a" the) "tandardi8e aro!nd *CM

""igning %ategorie" en $a""e

Re%la""i')ing ei"ting %ontent a" taono$ie" e=ol=e

Merging taono$ie"

Integrating the wi"do$ o' 'ol5"ono$ie"

I f ti M t S ft | * t i C t t M t


21/39



2;

Challenges and Im!acts of Merging Ta1onomies

Misclassification %hange i" %on"tant, and $a"tertaono$ie" $!"t $anage $!ltiple %!"to$ taono$ie" 'orea%h %ontent "o!r%e

*+ol'sonomies, 'ro$ depart$ental %olla#oration"ol!tion" are %reated #) !"er" and !n$anaged #) *CM

"tandard"

mpact:

$n"elia%le Metadata In%on"i"ten%ie" lo"e or$i"la#el %ontent

!"ocess Misfi"es – Poor $etadata trigger"in%orre%t e=ent" and wor5'low"

.cale is the Challen#e / utomation is Essential



22/39



2@

3essons 3earned 9rom 5 Ado!tion

etting Classification 5ight? ?ar#age in O gar#age o!t< i" o'ten !"ed in$etadata $anage$ent proe%t" to de"%ri#e the pro#le$ o' #!ilding a

$etadata $odel on in%on"i"tent "o!r%e".

"riing rocess on Ta1onomies? *RP ")"te$" depending on / $a"ter

taono$ie" $aterial, =endor and %!"to$er. The"e taono$ie" dri=e

e=ent", wor5'low de'inition and the de=elop$ent o' tran"a%tionF%entri%#!"ine"" pro%e"" appli%ation"

Mastering Metadata? The a#ilit) to deplo) new enterpri"e appli%ation"

depend" !pon the reF!"a#ilit), "%ala#ilit) and integrit) o' the $etadata $odel

S*stem of 5ecord is 5eDuired for Standardiation?

*"ta#li"he" an enterpri"e "tandard that %an #e a!dited

Kor$" the 'o!ndation 'or #!ilding de$on"tra#le #e"t pra%ti%e"

*n'or%e" %on"i"ten%) o' data %apt!re and o!tp!t



23/39



24

Customer 3essons for Mastering CM Ta1onomies

Ma"ter< taono$) o' re%ord re!ired 'or Co$plian%e

B!"ine"" pro%e"" appli%ation"

Merged $a"ter taono$ie" #e%o$e large and !nwield)

M!ltiple taono$ie" re!ire integration and tran"lation

Centrali8ed, de%entrali8ed, or h)#rid@

Intelligent Cla""i'i%ation in%rea"ingl) i" !"ed to $anage

Taono$) $erging 'ro$ $!ltiple !"e %a"e"

Taono$)'ol5"ono$) tran"lation 'ro$ di"tri#!ted %ontent

"o!r%e"


24/39

© 2007 IBM Corporation 2E

A 3oo- at CM ClassificationTechnologies



25/39



2'

State of Classification Management Technologies

*CM Cla""i'i%ationTaono$) i" an e$erging di"%ipline Ind!"tr) "tandard taono$ie"

Ko%!" on #!"ine"" '!n%tion or tran"a%tion t)pe"

4a=e not rea%hed the enterpri"e le=el

Cla""i'i%ation #e"t pra%ti%e" Content inge"tion

ppli%ation de=elop$ent re%la""i'i%ation

Cla""i'i%ation "o'tware 'o%!"e" on %ontent inge"tion

*le%troni% %ontent (e$ail, ''i%e do%!$ent", 'reeF'or$ tet&

Paper %ontent (do%!$ent i$age"& re!ire" CR

ear%h i" not eno!gh $!"t dri=e =al!e in the #!"ine"" pro%e""



26/39



2(

Criteria 9or CM Classification Management Solutions

Integrate with and "!pport the *CM $etadata $odel Interpret a highl)F'ederated %ontent e%o")"te$

?o #e)ond "ear%h to %atalog and $anage %ontent

B!ild on ad=an%ed anal)ti% te%hnologie" r!le" aloneare not eno!gh

Interpret %ontent to etra%t $eaning'!l ($eta&data

*$plo) $!ltiple $ethod" (engine"& 'or %la""i'i%ation

Integrate tea%hinglearning


27/39



28/39



@0

I,M Classification Module for lectronic Content

Brganie *our CM content

!to$ated %la""i'i%ation and 'iltering

Co$#ine" tet anal)ti%" !nder"tandingwith r!le"

%!ire" do$ain "pe%i'i%it) 'ro$ )o!r

own %ontent ni!e learning te%hnolog) 'or adapti=e

%la""i'i%ation

!gge"t" new %ategorie" or e=en "eed"an entirel) new taono$)

Re%ti'ie" %on'li%ting taono$ie"

Mar5et pro=en, "%ala#le plat'or$



29/39



@;

Understanding Content with Te1t Anal*tics

M a t ch

i n g

Categories list and

5eleancies

EScoresF

Classification

ngine

Classification

ngine

Cor!us

ECategoriedF

The strategic

value of thismarket is

paramount to

IBM

The strategic

value of thismarket is

paramount to

IBM

Audit

Training

ETeachF

9eed#ac-

CThe core market

for this new

product has been

defined as such by IBM

CThe core market

for this new

product has been

defined as such by IBM

A

IP is

essential

A

IP is

essential

A

Legal is

currently

requiring

full approval

A

Legal is

currently

requiring

full approval

,Engineering

requires clear

requirements

,Engineering

requires clear

requirementsCtrategy is

Important tothe marketing

team

Ctrategy is

Important to

the marketing

team

C? 7(%.

,? $4%.

A? ;2%

The strategic

value of this

market is

paramount toIBM

The strategic

value of this

market is

paramount to

IBM



30/39



@2

Classification or-flow? Accelerating Content Brganiation

File

System

Cla""i'ier

*i"ting

n%la""i'ied

Managed Content

Cla""i'i%ationRe=iew

Tool

Kilter o!t do%!$ent"

!to$ati%all) %ategori8e $aorit) o' %ontent

5eference? Integration Com!onents

Cla""i'ier (R!nti$e ppli%ation&

Cla""i'i%ation Re=iew (I&

Taono$) Propo"er (I&

Content *tra%tor (training #a"ed on P+&

end to taono$) propo"er

Basic Content

Services



31/39



@@

Com!onents of the Solution for Te1t Classification

Classifier !to$ati%all) %la""i'ie" and 'ilter" o!t do%!$ent"

Mo=e" "o$e do%!$ent" 'or $an!al re=iew

Classification 5eiew Tool

llow" !"er to $an!all) re=iew do%!$ent"

Content 1tractor

*tra%t" %ontent 'ro$ the *CM ")"te$ 'or training

Ta1onom* ro!oser "er wor5'low to identi') and na$e new %ategorie" or appl)

ei"ting taono$) 'ro$ P+



32/39



@4

Classification for a!er "ocuments

Cla""i'i%ation o' paper do%!$ent" o%%!r" in %apt!repro%e""

"e %a"e" 'or paper do%!$ent %la""i'i%ation

Re%ognition !"ing CRICR

Cla""i'i%ation to a""o%iate to 'older" or do% %la""

eparation to red!%e %o"t" and i$pro=e pro%e""



33/39



@$

Three rimar* T*!es of Images GThe "ocument 5ecognition ro#lem

•

3ess Adanced

More Adanced

Semi+Semi+

StructuredStructured

StructuredStructured

Un+StructuredUn+Structured



34/39



@'

The "ocument Se!aration ro#lem in Image Ca!ture

Se!aration of documents is asignificant e1!ense for a

high+olume ca!ture s*stem

T)pi%al "tr!%t!red< re%ognition te%hnologie" are not appli%a#le

Man!al in"ertion o' "eparator "heet" i" the pri$ar) wor5aro!nd toda)

E0 o' do%!$ent preparation la#or i" "pent "orting do%!$ent" and

in"erting "eparator page" source: T!"#

Where does one document stop and the nextbegin?

Here?Here? Here?Here? Here?Here? Here?Here?


35/39



36/39



@8

aterfall A!!roach to Classification and Se!arationTwoFpa"" ")"te$

;st !ass? Classification

o!timies !erformance #* using fastest classification techniDuesfirst

Adanced Te1t Classification final catch+all

1 2Page # 3 4 5 6 7 8

Image!assi"cation

$%& ? ?? ? ?

'u!es

(ased $%& $%& $%&

?

)ext!assi"cation

$%&$%&$%&$%& $%&$%&

(arcode'ecognition ? ?? ? ? ? ?

; ms

20 ms

200 ms

;000 ms

*irst

*orm +

*irst*orm ,

*irst*orm -

.ast

*orm +

.ast

*orm ,

.ast

*orm -

/idd!e*orm +

/idd!e*orm ,

?



37/39


o at o a age e t So t a e | e p "e Co e a age e

@7

h* Inest in Automated Classification&

Accelerate the time to alue in *our

inestment in CM

9ree u! *our su#Hect matter e1!erts

nsure more accurate content

catalogs

Ma-e *our content easier to find and

leerage



38/39


g | p g

40

Summar*

1. %%elerate *CM tandardi8ation"oor content classification undermines ECM value – maximi$e your ECM

potential and time%to%value &ith automated classification

2. !to$ating Cla""i'i%ation lwa)" Pa)"

Typical employees spend '( hours)&ee* searching for information – slashthat time and increase productivity

/. Cla""i'i%ation Te%hnologie" !to$ate Cla""i'i%ation toDri=e De=elop$ent o' Be"t Pra%ti%e"

I,M Classification Module for I,M 9ileet 8 utomatically o"#aniin# you" content %y unde"standin# it



39/39

g | p g

Contact Re##ie T&i## 5 "t&i##6us7i%m7com 8 fo"

mo"e info"mation o" to a""an#e a demonst"ation

IBM - 2007 - The Challenges of Building Enterprise Content Taxonomies and the Role of Classification...

Documents

Transcript of IBM - 2007 - The Challenges of Building Enterprise Content Taxonomies and the Role of Classification...