Typical Data Integration Scenario
5
1 1 Typical Data Integration Scenario Enterprise D ata R epository (C ollection ofC ustom ers, V endors, Em ployees, Products… ) Phase 2 R ider’s Edge ~ 90,000 records R entals ~ 300,000 H -D O nline ~ 800,000 U sed B ikes ~ 18,000 H O G /B R AG ~ 1 m il CSCS M illions of records SW R M illions of records HDDS Talon T2 D CI-M ~ 3.5 m ilrecords HDDS Talon ES 5a – O nline Profile 5b – O nline Lead G eneration 5c – Vehicle O w nership 2a - RentalEvent 4a – U sed B ikes Lead 7a – Consum ers 7b – Vehicle purchase 6a – Consum ers 6b – V ehicle purchase 3 rd Party 8a - Suppressions 1a - Print Lead G eneration 1b – Phone Lead G eneration 1c - H D M C H osted B uellD em o R ide 1d - HD M C H osted H D D em o R ide 1e - D ealer H osted B uellD em o R ide 1 f - D ealer H osted H D D em o R ide 1g - B uellProm otions 1h - IM S Show s 1i- NHRA: M obile R eg. W aiver 1 j - NH R A : M obile Photo (future) 1k - N H R A : Fan C lubs (future) 1l- N H R A : Sw eep Stakes 1m - NH R A : H ospitality (future) 1n – Q PR 1p - R ide Plan M aintenance (R PM ) 1q - Enterprise C hange (M anual) 1 s - S portster (C onversion O nly) 1 t - Phone Catalog Request 1u - D irect M ailH and R aiser 1v - Enthusiast H and R aiser 1w - S hoptalk Enthusiast 1x - Factory Tours 3a – R egistration 3b - Enrollm ent 3c - C om pletion 3d – Consum er __Update 3e -Evaluation H D FS ~ 870,000 loans ~ 190,000 ins 3 rd Party (N CO A & D ata Enrichm ent IS ky D ealer W ebsite (PS N ) H -D InternalSources ExternalSources ~9 or10 m il records betw een 2 system s
-
Upload
amela-harrell -
Category
Documents
-
view
25 -
download
0
description
Typical Data Integration Scenario. CRM Integration Architecture with an issue (?). CONNECT Solution Architectural Overview. Harley-Davidson consumer related business transactions for CLOSER Phase I . - PowerPoint PPT Presentation
Transcript of Typical Data Integration Scenario
1 1
Typical Data Integration Scenario
Enterprise Data Repository (Collection of Customers, Vendors, Employees, Products…)
Phase 2
Rider’s Edge~90,000 records
Rentals~300,000
H-D Online~800,000
Used Bikes~18,000
HOG/BRAG~1 mil
CSCSMillions of
records
SWRMillions of
records
HDDSTalon T2
DCI -M~3.5 mil records
HDDSTalon ES
5a
– O
nlin
e P
rofile
5b
– O
nlin
e L
ead
Genera
tion
5c –
Vehic
le
Ow
ners
hip
2a -
Renta
l Event
4a
– U
sed B
ikes
Lead
7a
– C
onsu
mers
7b
– V
ehic
le
purc
hase
6a
– C
onsu
mers
6b
– V
ehic
le
purc
hase
3rd Party
8a -
Suppre
ssio
ns
1a -
Pri
nt
Lead G
enera
tion
1b
– P
hone L
ead G
enera
tion
1c -
HD
MC
Host
ed B
uell
Dem
o R
ide
1d
- H
DM
C H
ost
ed H
D D
em
o R
ide
1e -
D
eale
r H
ost
ed B
uell
Dem
o R
ide
1f
- D
eale
r H
ost
ed H
D D
em
o R
ide
1g
- B
uell
Pro
moti
ons
1h
- I
MS
Show
s
1i -
NH
RA
: M
obile
Reg.
Waiv
er
1j
- N
HR
A:
Mobile
Photo
(fu
ture
)
1k -
NH
RA
: Fa
n C
lubs
(futu
re)
1l -
NH
RA
: S
weep S
takes
1m
- N
HR
A:
Hosp
italit
y (
futu
re)
1n
– Q
PR
1p
- R
ide P
lan M
ain
tenance
(R
PM
)
1q
- E
nte
rpri
se C
hange (
Manual)
1s -
Sport
ster
(Convers
ion O
nly
)
1t
- Phone C
ata
log R
equest
1u
- D
irect
Hand R
ais
er
1v -
Enth
usi
ast
Hand R
ais
er
1w
- S
hopta
lk E
nth
usi
ast
1x -
Fact
ory
Tours
3a –
Regis
trati
on
3b -
Enro
llment
3c -
Com
ple
tion
3d –
Consu
mer
__
Update
3e
-Evalu
ati
on
HDFS~870,000 loans~190,000 ins
3rd Party(NCOA & Data
Enrichment
ISky
Dealer Website(PSN)
H-D Internal Sources
External Sources
~9 or 10 mil records between 2 systems
2 2
CRM Integration Architecture with an issue (?)
SAP XI
SAP CRM Application
Phase 2
Master Data
Business Partner/ Consumer
Transactional Data
Rider’s Edge~90,000 records
Rentals~300,000
H-D Online~800,000
Used Bikes~18,000
HOG/BRAG~1 mil
CSCSMillions of
records
SWRMillions of
records
HDDSTalon T2
DCI -M~3.5 mil records
HDDSTalon ES
5a
– O
nlin
e P
rofile
5b
– O
nlin
e L
ead
Genera
tion
5c –
Vehic
le
Ow
ners
hip
Activity/ Interaction Lead Opportunity
2a -
Renta
l Event
4a
– U
sed B
ikes
Lead
7a
– C
onsu
mers
7b
– V
ehic
le
purc
hase
6a
– C
onsu
mers
6b
– V
ehic
le
purc
hase
3rd Party
8a -
Suppre
ssio
ns
Installed Base/Product Ownership
1a -
Pri
nt
Lead G
enera
tion
1b
– P
hone L
ead G
enera
tion
1c -
HD
MC
Host
ed B
uell
Dem
o R
ide
1d
- H
DM
C H
ost
ed H
D D
em
o R
ide
1e -
D
eale
r H
ost
ed B
uell
Dem
o R
ide
1f
- D
eale
r H
ost
ed H
D D
em
o R
ide
1g
- B
uell
Pro
moti
ons
1h
- I
MS
Show
s
1i -
NH
RA
: M
obile
Reg.
Waiv
er
1j
- N
HR
A:
Mobile
Photo
(fu
ture
)
1k -
NH
RA
: Fa
n C
lubs
(futu
re)
1l -
NH
RA
: S
weep S
takes
1m
- N
HR
A:
Hosp
italit
y (
futu
re)
1n
– Q
PR
1p
- R
ide P
lan M
ain
tenance
(R
PM
)
1q
- E
nte
rpri
se C
hange (
Manual)
1s -
Sport
ster
(Convers
ion O
nly
)
1t
- Phone C
ata
log R
equest
1u
- D
irect
Hand R
ais
er
1v -
Enth
usi
ast
Hand R
ais
er
1w
- S
hopta
lk E
nth
usi
ast
1x -
Fact
ory
Tours
3a –
Regis
trati
on
3b -
Enro
llment
3c -
Com
ple
tion
3d –
Consu
mer
__
Update
3e
-Evalu
ati
on
HDFS~870,000 loans~190,000 ins
3rd Party(NCOA & Data
Enrichment
ISky
Dealer Website(PSN)
AC
–
Genera
te
Lead
AD
–
Genera
te
Opport
unit
y
AE –
Cre
ate
/U
pdate
Ass
et
AB – Lead Only Information
AA - Interaction Information
H-D Internal Sources
External Sources
SAP Enterprise
Portal
SAP Business
Warehouse
~9 or 10 mil records between 2 systems
3 3
CONNECT Solution Architectural Overview
Harley-Davidson consumer related business transactions for CLOSER Phase I.
Transaction Flow: Customer >> SAP XI >> DS/QS CDI Middleware >> SAP XI >> SAP CRM Application
SAP XI
SAP CRM Application
Phase 2
Master Data
Business Partner/ Consumer
Transactional Data
Rider’s Edge~90,000 records
Rentals~300,000
H-D Online~800,000
Used Bikes~18,000
HOG/BRAG~1 mil
CSCSMillions of
records
SWRMillions of
records
HDDSTalon T2
DCI -M~3.5 mil records
HDDSTalon ES
5a
– O
nlin
e P
rofile
5b
– O
nlin
e L
ead
Genera
tion
5c –
Vehic
le
Ow
ners
hip
Activity/ Interaction Lead Opportunity
2a -
Renta
l Event
4a
– U
sed B
ikes
Lead
7a
– C
onsu
mers
7b
– V
ehic
le
purc
hase
6a
– C
onsu
mers
6b
– V
ehic
le
purc
hase
3rd Party
8a -
Suppre
ssio
ns
Installed Base/Product Ownership
1a -
Pri
nt
Lead G
enera
tion
1b
– P
hone L
ead G
enera
tion
1c -
HD
MC
Host
ed B
uell
Dem
o R
ide
1d
- H
DM
C H
ost
ed H
D D
em
o R
ide
1e -
D
eale
r H
ost
ed B
uell
Dem
o R
ide
1f
- D
eale
r H
ost
ed H
D D
em
o R
ide
1g
- B
uell
Pro
moti
ons
1h
- I
MS
Show
s
1i -
NH
RA
: M
obile
Reg.
Waiv
er
1j
- N
HR
A:
Mobile
Photo
(fu
ture
)
1k -
NH
RA
: Fa
n C
lubs
(futu
re)
1l -
NH
RA
: S
weep S
takes
1m
- N
HR
A:
Hosp
italit
y (
futu
re)
1n
– Q
PR
1p
- R
ide P
lan M
ain
tenance
(R
PM
)
1q
- E
nte
rpri
se C
hange (
Manual)
1s -
Sport
ster
(Convers
ion O
nly
)
1t
- Phone C
ata
log R
equest
1u
- D
irect
Hand R
ais
er
1v -
Enth
usi
ast
Hand R
ais
er
1w
- S
hopta
lk E
nth
usi
ast
1x -
Fact
ory
Tours
3a –
Regis
trati
on
3b -
Enro
llment
3c -
Com
ple
tion
3d –
Consu
mer
__
Update
3e
-Evalu
ati
on
HDFS~870,000 loans~190,000 ins
3rd Party(NCOA & Data
Enrichment
ISky
Dealer Website(PSN)
AC
–
Genera
te
Lead
AD
–
Genera
te
Opport
unit
y
AE –
Cre
ate
/U
pdate
Ass
et
AB – Lead Only Information
AA - Interaction Information
H-D Internal Sources
External Sources
DS/QS CDI Match/Merge, Data Quality SOA
Interface
Search Customer
SAP Enterprise
Portal
SAP Business
Warehouse
~9 or 10 mil records between 2 systems
Create Customer
4 4
DS/QS Match-Merge Solution Overview – Search Customer
SAP XI Receives customer information & consumes ds/qs customer search webservices
DataStage SOA Interface exposes DS/QS Customer Search WebServices
DataStage Job encapsulates, wraps and binds all stages of QualityStage Match Functionality
QualityStage Match Framework
Identify Country
HD Customer Search Mexican Customers
(follows similar framework as US address)
Mexico
Search Canadian Customers
(follows similar framework as US address but uses different
address validation
Canada
Search US Customers
US & Hawaii
Standardize
NameAddressPhone NumbersEmailDOB
CASS Address Validation
Validate & Certify US Addresses
Build Candidate List
Build Potential Search List from CRM Repository using Last Name & other attributes
Advanced Fuzzy Identity Matching(Identity Resolution? Anyone)
Perform Advanced/Fuzzy Identity Matching using the following combinations:
Business Partner NumberName & AddressName & EmailName & Daytime PhoneName & Work PhoneName & Mobile Phone
Return the best matches to SAP XI through Datastage SOA interface
5 5
DS/QS Match-Merge Solution Overview – Create Customer
SAP XI Receives customer information & consumes ds/qs customer create webservices
DataStage SOA Interface exposes DS/QS Customer WebServices
DataStage Job encapsulates, wraps and binds all stages of QualityStage Match/Merge Functionality
QualityStage Match/Merge Framework
Identify Country
HD Customer Search Mexican Customers
(follows similar framework as US address)
Mexico
Search Canadian Customers
(follows similar framework as US address but uses different
address validation
Canada
Search US Customers
US & Hawaii
Standardize
NameAddressPhone NumbersEmailDOB
CASS Address Validation
Validate & Certify US Addresses
Build Candidate List
Build Potential Search List from CRM Repository using Last Name & other attributes
Advanced Fuzzy Identity Matching
(Identity Resolution? Anyone)
Perform Advanced/Fuzzy Identity Matching using the following combinations:
Business Partner NumberName & AddressName & EmailName & Daytime PhoneName & Work PhoneName & Mobile Phone
Return A SURVIVED, best Customer record to SAP XI through Datastage SOA interface
Merge the matched records to survive the best Customer
(Build a best customer system of record by merging matched
records)
What full attribution? No Way!
Build one customer system of record by taking the most latest and valid information from all the matched records.
