Data Integration for Microsoft Dynamics 365/CRM Made Easy
of 50
/50
Embed Size (px)
Transcript of Data Integration for Microsoft Dynamics 365/CRM Made Easy
PowerPoint PresentationMade Easy
2
Who We Are
A leading provider of data integration and migration software solutions. We specialize in providing the tools necessary to move data from one system to another.
We understand the pains of data integration and migration challenges and offer up solutions to solve those challenges and pain points.
Jessica Petta Client Services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
3
migration, integration and integrity
within today’s digital landscape
Solution Demo A hands on look at SSIS Integration Toolkit for Microsoft Dynamics 365 and some of the many features which can be used to solve complex data integration scenarios
Session Objective Data Integration for Microsoft Dynamics Made Easy
Tools & Strategies Tools and strategies you can use to solve any current and future data challenges you may face.
Get introduced to powerful, easy to use data migration/integration for Microsoft Dynamics 365/CRM.
Learn how to use the SSIS Integration Toolkit to integration Microsoft Dynamics 365/CRM data with virtually any other application or database system and how it can scale to support constantly evolving business requirements.
Learn how to create the fastest data integration yet and receive other tips for getting the most out of your data integration solution.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
4
• Upgrading and migrating from legacy systems
• Rapidly evolving data landscape • More systems to be added and integrated • Constantly growing data size • Evolving application metadata
• Constantly evolving APIs • New SDKs • New Service Endpoints • New Capabilities
• Data integration is not just about data • Business process integration can be facilitated by data integration • Actions in one system often need to trigger actions in other systems
• Data integrity and data quality
• Shift to the cloud • Limited or expensive storage • Performance
• Troubleshooting and Maintenance • Troubleshooting can be difficult • Making changes to existing integration code can be costly
Today’s Data Challenges
5
5
One Solution How one tool can solve all your data integration & migration challenges
SSIS Integration Toolkit
Powered by SSIS ETL Engine
• We know exactly where the pain points are in terms of your data integration needs, and we try to offer a solution that is cost effective and easy-to-use.
Performant, Feature-Rich & Easy-to-Use
Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product. – Mark Fox, Project Manager
Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product. – Mark Fox, Project Manager
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
6
6
ongoing integration tasks on a scheduled basis
extract data from CRM server for offline reporting, and business analytics
Integrating
Automating
Analytics
SSIS Integration Toolkit for Microsoft
Dynamics 365 & Beyond
CRM with any other application or database system
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
7
Codeless Integration
You don't have to write a single line of code to make data integration happen so your development can be
done in a matter of minutes.
Flexible & Easy-to-Use
We make the most flexible integration solution on the
market. Our software offers intuitive user interfaces that are flexible and easy to use.
Cost Effective
With a streamlined development experience, and an extremely simple licensing model, our solution offers the
best value for your investment.
Unparalleled Performance
Our software offers many specifically designed features that help you achieve the best possible performance without
hijacking your budget.
8
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
9
Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
10
A full suite data integration solution for Microsoft Dynamics 365/CRM that is cost effective & easy to use.
Utilizes and takes advantage of SQL Server Integration Services (SSIS) capabilities.
Handles all intricate details working with Microsoft Dynamics 365/CRM interfaces.
Works with virtually any other data sources or systems.
SSIS Integration Toolkit For Microsoft Dynamics 365/CRM
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
How SSIS Integration Toolkit Works
A quick walkthrough of SSIS Integration Toolkit features.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
12
• Provides the capability to create new OptionSet value
when a match cannot be found
CRM Connection Manager Manage connections with the CRM servers.
CRM Source Component Facilitate reading data from Dynamics CRM server using Entity, FetchXML, EntityChanges, or AuditLogs mode
CRM Destination Component Facilitate writing data to the CRM Server through CRM Web
Services with an option of nine different action types.
Four Main Components SSIS Integration Toolkit for Microsoft Dynamics 365/CRM
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
13
Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.
Select and drag out your Microsoft Dynamics CRM Source Component.
Configure the component through an easy, visual, user interface.
Select only the data you will need to push to your target system.
Retrieving Data From Microsoft Dynamics SSIS Integration Toolkit for Microsoft Dynamics 365
Microsoft Dynamics 365/CRM
14
Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.
Select the Microsoft Dynamics CRM Destination and connect your desired source to it.
Select how you would like the data to be written to the target Dynamics 365/CRM entity (Create, Update, Delete, Upsert, etc.).
Map the fields from your source system to the target field in Microsoft Dynamics 365/CRM.
Writing data to Microsoft Dynamics SSIS Integration Toolkit for Microsoft Dynamics 365
Microsoft Dynamics 365/CRM
15
Migration/Integration
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
16
• Basic Connection Information • Authentication Type
• Enabling support of all CRM deployment types
• Discovery Server URL
• Home Realm Uri
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
17
18
server
• Reading all records for the specified entity without filtering
• FetchXML • Any complex FetchXML query • Filtering is possible, so are JOINs • Open View option
• EntityChanges • Utilize CRM delta API to retrieve latest changes since last pull
• AuditLogs • Reading CRM audit logs in a structured way
• Options • Batch Size
• Regardless of batch size, we will page through all records
• Impersonate As • Useful for reading from entities that requires impersonation
• Output Timezone • Standardize the output of datetime fields
Source Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
19
20
21
22
23
Dynamics 365 / CRM server
• Many options designed for specific integration scenarios
• Many productivity features offered to help you be more productive when working with the mapping
Destination Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
24
• A bulk delete job that deletes selected records in bulk
• Runs asynchronously
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
25
• Batch Size option
• Support of createdby, modifiedby fields
• Set a optionset/picklist field value by either its integer value or its label value
• Support for CRM many-to-many relationship
• Support for writing to principalobjectaccess (POA) entity
• Text Lookup
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
26
27
28
29
30
31
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
32
values from the source system to CRM
• Offers the capability to create new options when no match is found
• Supports both global or local option set fields
• Works for nvarchar or varchar columns
• Import / Export of the mapping in XML format
• Various action available when mapping fails
OptionSet Mapping Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
33
34
35
36
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
37
38
39
• Use of an Azure VM when targeting 365 Online
• Minimize the number of CRM fields that you want to write to CRM
• Avoid using the Duplicate Detection option if you can
• Manually Specify for Update/Upsert – make sure matching fields are covered by database indexes
• Sort input data when createdby, modifiedby or impersonateas field is mapped
• Properly designed CRM plugins & workflows
• See 365 FAQ page for more
Maximize Performance SSIS Integration Toolkit for Microsoft Dynamics 365
Batch Size & Multithreaded Writing
40
Single Thread vs Multithreading
Writing to CRM 100,000 records, 100 batch size, using a Create action with a total of 5 fields
Single Thread 100,000 records in 4761 seconds 21 records/second
Multithreading (20x threads) 100,000 records in 425 seconds 235 records/second
11 times faster when using multithreaded writing
The performance testing was done in a laptop with everything installed in the same box, the processor was heavily throttled, it should perform a lot better with a real production system
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
41
Solves all your data integration challenges within one unified platform
Greatest flexibility, performance and ease of use
SSIS Integration Toolkit Data Integration Made Easy
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
42
SSIS is a performant ETL platform, and we offer many options to help you achieve best possible performance.
Performance
SSIS is a very scalable platform.
You have many ways to scale your data integration solutions when using our software combined with the power of SSIS platform.
Scalability
Productivity
As part of Microsoft BI technology stack, SSIS offers the most transparent development experience for BI developers.
Unified BI Tools
SSIS offers many options to achieve one particular integration requirement.
We offer many options that are specifically designed for particular integration requirements.
Flexibility
Azure Service Bus
44
• Microsoft Dynamics 365 for Customer Engagement
• Microsoft Dynamics 365/AX • Microsoft Dynamics AX (4.0 – 2012 R3)
• Microsoft Dynamics 365 for Finance and Operations, Enterprise Edition
•
• Microsoft Dynamics 365 for Finance and Operations, Business Edition
Technical Requirements: Microsoft SQL Server 2017, 2016, 2014, 2012, 2008 R2, 2008, or 2005. Microsoft Dynamics 365/CRM Online requires SQL Server 2012 or above.
Supported Versions SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
45
• Works within development tool (BIDS,
SSDT, or Visual Studio) without
requiring a commercial license
development tool (BIDS, SSDT, or
Visual Studio)
connections, users, processors, etc.
connections, users, processors, etc.
• Maintenance & Upgrade are included
Annual Maintenance & Upgrade
• Direct access to our technical
resources with personalized services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
46
• Works within development tool (BIDS,
SSDT, or Visual Studio) without
requiring a commercial license
development tool (BIDS, SSDT, or
Visual Studio)
users or processors, or whatsoever
• One-Year Maintenance & Upgrade
application users or processors, or
whatsoever
Annual Maintenance & Upgrade
• Direct access to our technical
resources with personalized services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
A Solution for an Evolving Landscape Data Integration Made Easy
A data integration solution that supports constantly evolving applications, databases, and business requirements.
A solution that evolves with those landscapes • We are always adding new features & enhancements to our solutions
to support all the latest upgrades. • We are constantly adding support for new data integration scenarios
• As business requirements change and new data integration requirements are added, the SSIS Integration Toolkit will easily support these changes.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
48
to clean up duplicate and mis-
formatted data with your database
systems.
system into Microsoft
accurate. Use Upsert during
integration and additional tools
to automatically manage bad
prem applications and integrating
Data Integration for Microsoft Dynamics Made Easy
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
Q&A
[email protected] 1-855-999-5288 www.kingswaysoft.com
Oakville, ON L6H 5R2
2
Who We Are
A leading provider of data integration and migration software solutions. We specialize in providing the tools necessary to move data from one system to another.
We understand the pains of data integration and migration challenges and offer up solutions to solve those challenges and pain points.
Jessica Petta Client Services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
3
migration, integration and integrity
within today’s digital landscape
Solution Demo A hands on look at SSIS Integration Toolkit for Microsoft Dynamics 365 and some of the many features which can be used to solve complex data integration scenarios
Session Objective Data Integration for Microsoft Dynamics Made Easy
Tools & Strategies Tools and strategies you can use to solve any current and future data challenges you may face.
Get introduced to powerful, easy to use data migration/integration for Microsoft Dynamics 365/CRM.
Learn how to use the SSIS Integration Toolkit to integration Microsoft Dynamics 365/CRM data with virtually any other application or database system and how it can scale to support constantly evolving business requirements.
Learn how to create the fastest data integration yet and receive other tips for getting the most out of your data integration solution.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
4
• Upgrading and migrating from legacy systems
• Rapidly evolving data landscape • More systems to be added and integrated • Constantly growing data size • Evolving application metadata
• Constantly evolving APIs • New SDKs • New Service Endpoints • New Capabilities
• Data integration is not just about data • Business process integration can be facilitated by data integration • Actions in one system often need to trigger actions in other systems
• Data integrity and data quality
• Shift to the cloud • Limited or expensive storage • Performance
• Troubleshooting and Maintenance • Troubleshooting can be difficult • Making changes to existing integration code can be costly
Today’s Data Challenges
5
5
One Solution How one tool can solve all your data integration & migration challenges
SSIS Integration Toolkit
Powered by SSIS ETL Engine
• We know exactly where the pain points are in terms of your data integration needs, and we try to offer a solution that is cost effective and easy-to-use.
Performant, Feature-Rich & Easy-to-Use
Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product. – Mark Fox, Project Manager
Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product. – Mark Fox, Project Manager
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
6
6
ongoing integration tasks on a scheduled basis
extract data from CRM server for offline reporting, and business analytics
Integrating
Automating
Analytics
SSIS Integration Toolkit for Microsoft
Dynamics 365 & Beyond
CRM with any other application or database system
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
7
Codeless Integration
You don't have to write a single line of code to make data integration happen so your development can be
done in a matter of minutes.
Flexible & Easy-to-Use
We make the most flexible integration solution on the
market. Our software offers intuitive user interfaces that are flexible and easy to use.
Cost Effective
With a streamlined development experience, and an extremely simple licensing model, our solution offers the
best value for your investment.
Unparalleled Performance
Our software offers many specifically designed features that help you achieve the best possible performance without
hijacking your budget.
8
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
9
Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
10
A full suite data integration solution for Microsoft Dynamics 365/CRM that is cost effective & easy to use.
Utilizes and takes advantage of SQL Server Integration Services (SSIS) capabilities.
Handles all intricate details working with Microsoft Dynamics 365/CRM interfaces.
Works with virtually any other data sources or systems.
SSIS Integration Toolkit For Microsoft Dynamics 365/CRM
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
How SSIS Integration Toolkit Works
A quick walkthrough of SSIS Integration Toolkit features.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
12
• Provides the capability to create new OptionSet value
when a match cannot be found
CRM Connection Manager Manage connections with the CRM servers.
CRM Source Component Facilitate reading data from Dynamics CRM server using Entity, FetchXML, EntityChanges, or AuditLogs mode
CRM Destination Component Facilitate writing data to the CRM Server through CRM Web
Services with an option of nine different action types.
Four Main Components SSIS Integration Toolkit for Microsoft Dynamics 365/CRM
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
13
Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.
Select and drag out your Microsoft Dynamics CRM Source Component.
Configure the component through an easy, visual, user interface.
Select only the data you will need to push to your target system.
Retrieving Data From Microsoft Dynamics SSIS Integration Toolkit for Microsoft Dynamics 365
Microsoft Dynamics 365/CRM
14
Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.
Select the Microsoft Dynamics CRM Destination and connect your desired source to it.
Select how you would like the data to be written to the target Dynamics 365/CRM entity (Create, Update, Delete, Upsert, etc.).
Map the fields from your source system to the target field in Microsoft Dynamics 365/CRM.
Writing data to Microsoft Dynamics SSIS Integration Toolkit for Microsoft Dynamics 365
Microsoft Dynamics 365/CRM
15
Migration/Integration
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
16
• Basic Connection Information • Authentication Type
• Enabling support of all CRM deployment types
• Discovery Server URL
• Home Realm Uri
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
17
18
server
• Reading all records for the specified entity without filtering
• FetchXML • Any complex FetchXML query • Filtering is possible, so are JOINs • Open View option
• EntityChanges • Utilize CRM delta API to retrieve latest changes since last pull
• AuditLogs • Reading CRM audit logs in a structured way
• Options • Batch Size
• Regardless of batch size, we will page through all records
• Impersonate As • Useful for reading from entities that requires impersonation
• Output Timezone • Standardize the output of datetime fields
Source Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
19
20
21
22
23
Dynamics 365 / CRM server
• Many options designed for specific integration scenarios
• Many productivity features offered to help you be more productive when working with the mapping
Destination Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
24
• A bulk delete job that deletes selected records in bulk
• Runs asynchronously
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
25
• Batch Size option
• Support of createdby, modifiedby fields
• Set a optionset/picklist field value by either its integer value or its label value
• Support for CRM many-to-many relationship
• Support for writing to principalobjectaccess (POA) entity
• Text Lookup
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
26
27
28
29
30
31
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
32
values from the source system to CRM
• Offers the capability to create new options when no match is found
• Supports both global or local option set fields
• Works for nvarchar or varchar columns
• Import / Export of the mapping in XML format
• Various action available when mapping fails
OptionSet Mapping Component SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
33
34
35
36
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
37
38
39
• Use of an Azure VM when targeting 365 Online
• Minimize the number of CRM fields that you want to write to CRM
• Avoid using the Duplicate Detection option if you can
• Manually Specify for Update/Upsert – make sure matching fields are covered by database indexes
• Sort input data when createdby, modifiedby or impersonateas field is mapped
• Properly designed CRM plugins & workflows
• See 365 FAQ page for more
Maximize Performance SSIS Integration Toolkit for Microsoft Dynamics 365
Batch Size & Multithreaded Writing
40
Single Thread vs Multithreading
Writing to CRM 100,000 records, 100 batch size, using a Create action with a total of 5 fields
Single Thread 100,000 records in 4761 seconds 21 records/second
Multithreading (20x threads) 100,000 records in 425 seconds 235 records/second
11 times faster when using multithreaded writing
The performance testing was done in a laptop with everything installed in the same box, the processor was heavily throttled, it should perform a lot better with a real production system
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
41
Solves all your data integration challenges within one unified platform
Greatest flexibility, performance and ease of use
SSIS Integration Toolkit Data Integration Made Easy
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
42
SSIS is a performant ETL platform, and we offer many options to help you achieve best possible performance.
Performance
SSIS is a very scalable platform.
You have many ways to scale your data integration solutions when using our software combined with the power of SSIS platform.
Scalability
Productivity
As part of Microsoft BI technology stack, SSIS offers the most transparent development experience for BI developers.
Unified BI Tools
SSIS offers many options to achieve one particular integration requirement.
We offer many options that are specifically designed for particular integration requirements.
Flexibility
Azure Service Bus
44
• Microsoft Dynamics 365 for Customer Engagement
• Microsoft Dynamics 365/AX • Microsoft Dynamics AX (4.0 – 2012 R3)
• Microsoft Dynamics 365 for Finance and Operations, Enterprise Edition
•
• Microsoft Dynamics 365 for Finance and Operations, Business Edition
Technical Requirements: Microsoft SQL Server 2017, 2016, 2014, 2012, 2008 R2, 2008, or 2005. Microsoft Dynamics 365/CRM Online requires SQL Server 2012 or above.
Supported Versions SSIS Integration Toolkit for Microsoft Dynamics 365
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
45
• Works within development tool (BIDS,
SSDT, or Visual Studio) without
requiring a commercial license
development tool (BIDS, SSDT, or
Visual Studio)
connections, users, processors, etc.
connections, users, processors, etc.
• Maintenance & Upgrade are included
Annual Maintenance & Upgrade
• Direct access to our technical
resources with personalized services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
46
• Works within development tool (BIDS,
SSDT, or Visual Studio) without
requiring a commercial license
development tool (BIDS, SSDT, or
Visual Studio)
users or processors, or whatsoever
• One-Year Maintenance & Upgrade
application users or processors, or
whatsoever
Annual Maintenance & Upgrade
• Direct access to our technical
resources with personalized services
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
A Solution for an Evolving Landscape Data Integration Made Easy
A data integration solution that supports constantly evolving applications, databases, and business requirements.
A solution that evolves with those landscapes • We are always adding new features & enhancements to our solutions
to support all the latest upgrades. • We are constantly adding support for new data integration scenarios
• As business requirements change and new data integration requirements are added, the SSIS Integration Toolkit will easily support these changes.
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
48
to clean up duplicate and mis-
formatted data with your database
systems.
system into Microsoft
accurate. Use Upsert during
integration and additional tools
to automatically manage bad
prem applications and integrating
Data Integration for Microsoft Dynamics Made Easy
www.kingswaysoft.com © KingswaySoft Inc. All Rights Reserved.
Q&A
[email protected] 1-855-999-5288 www.kingswaysoft.com
Oakville, ON L6H 5R2
