Data Integration for Microsoft Dynamics 365/CRM Made Easy

www.kingswaysoft.com© KingswaySoft Inc. All Rights Reserved.

Data Integration forMicrosoft Dynamics 365/CRM

Made Easy


2

Who We Are

A leading provider of data integration and migration software solutions. We specialize in providing the tools necessary to move data from one system to another.

We understand the pains of data integration and migration challenges and offer up solutions to solve those challenges and pain points.

Jessica PettaClient Services

Coordinator

Jeremy JiTechnical Solutions

Specialist

CRMUG|D365UG 2018 Chapter Sponsor


3

ChallengesChallenges associated with data

migration, integration and integrity

within today’s digital landscape

Solution DemoA hands on look at SSIS Integration Toolkit for Microsoft Dynamics 365 and some of the many features which can be used to solve complex data integration scenarios

Session ObjectiveData Integration for Microsoft Dynamics Made Easy

Tools & StrategiesTools and strategies you can use to solve any current and future data challenges you may face.

Get introduced to powerful, easy to use data migration/integration for Microsoft Dynamics 365/CRM.

Learn how to use the SSIS Integration Toolkit to integration Microsoft Dynamics 365/CRM data with virtually any other application or database system and how it can scale to support constantly evolving business requirements.

Learn how to create the fastest data integration yet and receive other tips for getting the most out of your data integration solution.


4

• Upgrading and migrating from legacy systems

• Rapidly evolving data landscape• More systems to be added and integrated• Constantly growing data size• Evolving application metadata

• Constantly evolving APIs• New SDKs• New Service Endpoints• New Capabilities

• Data integration is not just about data• Business process integration can be facilitated by data integration• Actions in one system often need to trigger actions in other systems

• Data integrity and data quality

• Shift to the cloud• Limited or expensive storage• Performance

• Troubleshooting and Maintenance• Troubleshooting can be difficult• Making changes to existing integration code can be costly

Today’s Data Challenges


5

5

One SolutionHow one tool can solve all your data integration & migration challenges

SSIS Integration Toolkit

• Microsoft SQL Server Integration Services• Flexible and scalable

Powered by SSIS ETL Engine

• We know exactly where the pain points are in terms of your data integration needs, and we try to offer a solution that is cost effective and easy-to-use.

Performant, Feature-Rich & Easy-to-Use

Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product.– Mark Fox, Project Manager

Product works as advertised and the company stands behind the product with prompt support and continuing updates to the product.– Mark Fox, Project Manager


6

6

ongoing integration tasks on a scheduled basis

extract data from CRM server for offline reporting, and business analytics

Integrating

Automating

Analytics

ReplicatingCRM data for archival requirements

SSIS Integration Toolkit forMicrosoft

Dynamics 365& Beyond

Data IntegrationWith SSIS Integration Toolkit

CRM with any other application or database system


7

The BenefitsSSIS Integration Toolkit

Codeless Integration

You don't have to write a single line of code to make data integration happen so your development can be

done in a matter of minutes.

Flexible & Easy-to-Use

We make the most flexible integration solution on the

market. Our software offers intuitive user interfaces that are flexible and easy to use.

Cost Effective

With a streamlined development experience, and an extremely simple licensing model, our solution offers the

best value for your investment.

Unparalleled Performance

Our software offers many specifically designed features that help you achieve the best possible performance without

hijacking your budget.


8

Azure Service Bus

SSIS Integration ToolkitProduct Family


9

SSIS Integration Toolkit forMicrosoft Dynamics 365

Microsoft Dynamics 365

Customer Engagement

Finance & OperationsEnterprise Edition

Finance & OperationsBusiness Edition

Dynamics CRMDynamics NAVDynamics AX


10

A full suite data integration solution for Microsoft Dynamics 365/CRM that is cost effective & easy to use.

Utilizes and takes advantage of SQL Server Integration Services (SSIS) capabilities.

Handles all intricate details working with Microsoft Dynamics 365/CRM interfaces.

Works with virtually any other data sources or systems.

SSIS Integration ToolkitFor Microsoft Dynamics 365/CRM


How SSIS Integration Toolkit Works

A quick walkthrough of SSIS Integration Toolkit features.


12

CRM OptionSet Mapping Component• Manages CRM OptionSet value mapping

• Provides the capability to create new OptionSet value

when a match cannot be found

CRM Connection ManagerManage connections with the CRM servers.

CRM Source ComponentFacilitate reading data from Dynamics CRM server using Entity, FetchXML, EntityChanges, or AuditLogs mode

CRM Destination ComponentFacilitate writing data to the CRM Server through CRM Web

Services with an option of nine different action types.

Four Main ComponentsSSIS Integration Toolkit for Microsoft Dynamics 365/CRM


13

Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.

Select and drag out your Microsoft Dynamics CRM Source Component.

Configure the component through an easy, visual, user interface.

Select only the data you will need to push to your target system.

Retrieving Data From Microsoft DynamicsSSIS Integration Toolkit for Microsoft Dynamics 365

Microsoft Dynamics 365/CRM

Virtually any application or database system


14

Connect to your Microsoft Dynamics 365/CRM instance through the CRM Connection Manager.

Select the Microsoft Dynamics CRM Destination and connect your desired source to it.

Select how you would like the data to be written to the target Dynamics 365/CRM entity (Create, Update, Delete, Upsert, etc.).

Map the fields from your source system to the target field in Microsoft Dynamics 365/CRM.

Writing data to Microsoft DynamicsSSIS Integration Toolkit for Microsoft Dynamics 365

Microsoft Dynamics 365/CRM

Virtually any application or database system


15

Migration/Integration

Sample Uses CasesSSIS Integration Toolkit for Microsoft Dynamics


16

• Functionality• Manage connections with CRM server

• Reusable across SSIS package or project

• Basic Connection Information• Authentication Type

• Enabling support of all CRM deployment types

• Discovery Server URL

• Service Endpoint

• Authentication Information / Login credentials

• Timeout

• Selection of CRM Organization

• Advanced Settings• Alternate CRM Server URL

• Home Realm Uri

• Retry on Intermittent Errors

• Optional Proxy Configuration

Connection ManagerSSIS Integration Toolkit for Microsoft Dynamics 365


17


18

• Functionality• Facilitate reading data from Microsoft Dynamics 365 / CRM

server

• Support of four Source Types• Entity

• Reading all records for the specified entity without filtering

• FetchXML• Any complex FetchXML query• Filtering is possible, so are JOINs• Open View option

• EntityChanges• Utilize CRM delta API to retrieve latest changes since last pull

• AuditLogs• Reading CRM audit logs in a structured way

• Options• Batch Size

• Regardless of batch size, we will page through all records

• Impersonate As• Useful for reading from entities that requires impersonation

• Output Timezone• Standardize the output of datetime fields

Source ComponentSSIS Integration Toolkit for Microsoft Dynamics 365


19


20


21


22


23

• Functionality• Facilitate writing data to Microsoft

Dynamics 365 / CRM server

• Support of nine write actions

• Many options designed for specific integration scenarios

• Many productivity features offered to help you be more productive when working with the mapping

Destination ComponentSSIS Integration Toolkit for Microsoft Dynamics 365


24

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

•

Write Action TypesMicrosoft Dynamics 365 Destination Component

• A bulk delete job that deletes selected records in bulk

• Runs asynchronously

in the background without blocking other activities


25

• Support of CRM Bulk Data Load API

• Batch Size option

• Support of createdby, modifiedby fields

• Set a optionset/picklist field value by either its integer value or its label value

• Support for CRM many-to-many relationship

• Support for writing to principalobjectaccess(POA) entity

• Text Lookup

• Lookup becomes painlessly easy

• Several optional settings for specific integration scenarios

Highlighted FeaturesMicrosoft Dynamics 365 Destination Component


26


27


28


29


30


31

Migration/Integration Data Transforming/Cleansing



32

• Functionality• Provides a consistent way to translate OptionSet

values from the source system to CRM

• Offers the capability to create new options when no match is found

• Supports both global or local option set fields

• Works for nvarchar or varchar columns

• Import / Export of the mapping in XML format

• Various action available when mapping fails

OptionSet Mapping ComponentSSIS Integration Toolkit for Microsoft Dynamics 365


33


34


35


36

Migration/Integration Data Transforming/Cleansing

Business Process Expand Storage

ERP CRM

Marketing



37


38


39

Further Tips• Upsert & Ignore Unchanged Fields

• Use of an Azure VM when targeting 365 Online

• Minimize the number of CRM fields that you want to write to CRM

• Avoid using the Duplicate Detection option if you can

• Manually Specify for Update/Upsert – make sure matching fields are covered by database indexes

• Sort input data when createdby, modifiedbyor impersonateas field is mapped

• Properly designed CRM plugins & workflows

• See 365 FAQ page for more

Maximize PerformanceSSIS Integration Toolkit for Microsoft Dynamics 365

Batch Size & Multithreaded Writing

http://www.kingswaysoft.com/products/ssis-integration-toolkit-for-microsoft-dynamics-365/faq#MaximizedPerformance


40

Performance MetricsSSIS Integration Toolkit for Microsoft Dynamics 365

Single Thread vs Multithreading

Writing to CRM 100,000 records, 100 batch size, using a Create action with a total of 5 fields

Single Thread100,000 records in 4761 seconds21 records/second

Multithreading (20x threads)100,000 records in 425 seconds235 records/second

11 times faster when using multithreaded writing

The performance testing was done in a laptop with everything installed in the same box, the processor was heavily throttled, it should perform a lot better with a real production system


41

Solves all your data integration challenges within one unified platform

Greatest flexibility, performance and ease of use

SSIS Integration ToolkitData Integration Made Easy


42

SSIS is a performant ETL platform, and we offer many options to help you achieve best possible performance.

Performance

SSIS is a very scalable platform.

You have many ways to scale your data integration solutions when using our software combined with the power of SSIS platform.

Scalability

Enjoy the immersive productivity improvement using our easy-to-use user interfaces with a streamlined development experience.

Productivity

As part of Microsoft BI technology stack, SSIS offers the most transparent development experience for BI developers.

Unified BI Tools

SSIS offers many options to achieve one particular integration requirement.

We offer many options that are specifically designed for particular integration requirements.

Flexibility

Why SSIS Integration Toolkit


Azure Service Bus

43


44

• Microsoft Dynamics 365/CRM• Microsoft Dynamics CRM (3.0 – 2016)

• Microsoft Dynamics 365 for Customer Engagement

• Microsoft Dynamics 365/AX• Microsoft Dynamics AX (4.0 – 2012 R3)

• Microsoft Dynamics 365 for Finance and Operations, Enterprise Edition

•

Microsoft Dynamics 365/NAV• Microsoft Dynamics NAV (2009 – 2017)

• Microsoft Dynamics 365 for Finance and Operations, Business Edition

Technical Requirements: Microsoft SQL Server 2017, 2016, 2014, 2012, 2008 R2, 2008, or 2005.Microsoft Dynamics 365/CRM Online requires SQL Server 2012 or above.

Supported VersionsSSIS Integration Toolkit for Microsoft Dynamics 365


45

Developer License

FreePerpetual License

1995$per integration server

Licensing Model for 365Simple and Straightforward

• Works within development tool (BIDS,

SSDT, or Visual Studio) without

requiring a commercial license

• Cannot be used outside of the

development tool (BIDS, SSDT, or

Visual Studio)

• Perpetual commercial license

• No limitations on the number of

connections, users, processors, etc.

• One-Year Maintenance & Upgrade

included

One-Year Subscription License


• Subscription-based commercial

license


connections, users, processors, etc.

• Maintenance & Upgrade are included

for the entire subscription period

Annual Maintenance & Upgrade


• Optional for perpetual license

• All software upgrades (including

major or minor) for one year

• Direct access to our technical

resources with personalized services

All prices valid until 4/8/2018


46

Developer License

FreePerpetual License


License Upgrade OptionSSIS Integration Toolkit – Ultimate Edition

• Works within development tool (BIDS,

SSDT, or Visual Studio) without

requiring a commercial license

• Cannot be used outside of the

development tool (BIDS, SSDT, or

Visual Studio)

• Perpetual commercial license

• No limitations on the number of application

users or processors, or whatsoever

• One-Year Maintenance & Upgrade

included

One-Year Subscription License


• Subscription-based commercial

license


application users or processors, or

whatsoever

• Maintenance & Upgrade are included

for the entire subscription period

Annual Maintenance & Upgrade


• Optional for perpetual license

• All software upgrades (including

major or minor) for one year

• Direct access to our technical

resources with personalized services

All prices valid until 4/8/2018


A Solution for an Evolving LandscapeData Integration Made Easy

A data integration solution that supports constantly evolving applications, databases, and business requirements.

A solution that evolves with those landscapes• We are always adding new features & enhancements to our solutions

to support all the latest upgrades.• We are constantly adding support for new data integration scenarios

• As business requirements change and new data integration requirements are added, the SSIS Integration Toolkit will easily support these changes.


48

Cleaning DataTools and stratetgies you can use

to clean up duplicate and mis-

formatted data with your database

systems.

Migrate DataMigrating data from any legacy

system into Microsoft

Dynamics 365

Integration between Dynamics

applicationsBuild bi-directional integrations

between Microsoft Dynamics

applications and virtually any

other application or database

system.

Maintain Data Integrity

Ensure data remains clean and

accurate. Use Upsert during

integration and additional tools

to automatically manage bad

data.

Integration between Cloud &

On-PremIntegration between cloud and on-

prem applications and integrating

to local servers for archiving data

Data Integration for Microsoft DynamicsMade Easy


Q&A


[email protected] 1-855-999-5288 www.kingswaysoft.com

KingswaySoft Inc.

408 North Service Rd W, Suite 200

Oakville, ON L6H 5R2

Canada

Contact Us

Data Integration for Microsoft Dynamics 365/CRM Made Easy

Documents

Transcript of Data Integration for Microsoft Dynamics 365/CRM Made Easy