Lobster_data

Data Integration with Lobster_data

Lob

ster

_dat

a

It is necessary to make use of electronic data integration (EDI) in order to run business processes smoothly and to link service providers, partners and customers to in-house IT. This is done by software solutions that integrate internal and external electronic data into the business processes. They convert existing data into any format and enable data exchange between different systems.

Lobster´s Lobster_data is such a tool. However, unlike other software, Lobster_data provides one single solution for what is normally only possible by combining several different software products. Serving as a central data hub, the software enables connectivity, remote transfer and even data communication between ERP and CMS systems, data bases, web platforms, customers and suppliers – without any need for programming skills and fully documentation of all operations automated.

The following pages show how surprisingly simple data integration, data conversion and data communication can be with Lobster_data!

Data Integration – Data Conversion – Data Communication with Lobster_data

© Lobster GmbH 2015 | 3

Lobster_data – The central Data Hub Page 4

The Advantages of Lobster_data Page 5

Data Integration with Lobster_data Page 6

Lobster_data: 7 steps to Data Integration Page 7

SAP Integration using Lobster_data Page 10

Useful optional modules:Content Inspection, Fax Service, DataFlow Page 11

Data Security with Lobster_data Page 12

Lobster_data makes all the Difference Page 14

Contents

_data

ERP

CRM

PPS

PIM

BDE

etc.

AS2

OFTP1/2

EDIFACT

Excel

SAP IDOC

AS/400 DataQueue

VDA

PDF

POP3

SMTP

(S)FTP

X.400

HTTP(S)

PRICAT

BMEcat

Fortras

Fax

WebService

INTERNAL SYSTEMS DATA HUB EXTERNAL

Databases

Customers

Webplatforms / portals

Authorities

Suppliers

Service providers(freight forwarders etc.)

Branch offices / Network

Lobster_data

Nowadays, most business communication happens electronically. No matter whether internal departments are exchanging data, if ERP and CRM systems need connecting to each other, or if you need to integrate data formats and structures of external service providers, business partners or customers with your own infrastructure: speed, automation, fl exibility and, above all, security are of the essence.

Lobster_data – the central Data Hub

Thus Lobster_data offers:

• Universal data conversion

• Clear data mapping using tree structures

• Data manipulation without programming

• Data transfer via direct or remote connection

• Detailed monitoring and integrated data backup

The Advantages of Lobster_data

Technical information

• Support of all common protocols for data transfer (FTP(S), OFTP, OFTP2, SMTP, HTTP(S), SMS, SAP-ALE, IBM-Data-Queue, databases, AS2, X.400, WebDAV, SCP, SSH, ... as well as web services)

• Processing of all common data formats (XML, EDIFACT, SAP IDoc, CSV, FixRecord, VDA, binary Excel, ANSI X.12, TRADECOM, BMECat, PRICAT)

• More than 4,000 main templates for interfacing to ERP systems, as well as all major industry standards (EDIFACT, SAP IDoc, VDA, Fortras, ANSI X.12, etc.)

• Cluster capacity and load balancing allows for fast processing

Handling

• Direct access to subsystems (e.g. databases, SAP systems via ALE or IBM i-Series via DataQueue and direct program call)

• Clearly structured graphical user interface (drag & drop) with ergonomic operability

• Process automation – e.g. integration of partner systems

• Reducing IT administration – one system for all integration tasks

• AS2 and OFTP2 certifi ed – integration of existing standards

• Accelerated order processing

• Information retrieval from web platforms via WebServices

• Transaction-based information fl ow

Transparency

• Automated generation of comprehensive reports and statistics

• Reduction of manual (error-prone) input

• Monitoring of all processes

© Lobster GmbH 2015 | 5© Lobster GmbH 2015 | 4

Data Integration with Lobster_data

Lobster_data gathers all information required from any data sources defined by the user. It will actively request or accept delivery in an event-based process.

This step processes any common data format in any character regardless of its encoding. Additional functions allow for data pre-processing before mapping (e.g. PDF preparser).

The data from the source data tree (input data) is converted to the target data tree (desired output data). External systems, such as SAP, databases and so on, can be accessed during the mapping process.

Normally, data records are written to ERP or similar systems. Lobster_data allows writing records to any database in parallel.

So called “integration units” control business-specific processing steps, generate reports in PDF or Excel and so on.

The processed data is now transferred to selected target systems.

© Lobster GmbH 2015 | 7

Creating a profile

In Lobster_data, new interfaces are created as profiles. The user specifies a profile name and assigns the profile to a group (e.g. Customer A, Supplier B, ...).

Enter a validity period and click on <Continue>

Specifying the data source

By choosing the “input agent” you determine from where Lobster_data will obtain the data you need to process. For instance, for event-based processing, select FTP. If necessary, specify whether a ZIP file has to be unpacked or whether a time driven event is to be activated for time-critical data. By specifying “Cronjob” (time driven events), you determine when Lobster_data will collect data from chosen data sources.Click on <Continue>

TIP: You can store profiles as “master templates”. Modifications to the master templates will be automatically transferred to all profiles. A profile desired from a master template can be individually adapted, copied and modified.

Lobster_data: 7 steps to Data Integration

In seven simple steps, Lobster_data transfers data generated by conversion, mapping or manipulation directly to chosen target systems. The user is guided through the interface configuration by a wizard similar to that of Microsoft Wizard.

Step 1

Step 2

Data source origin

Data mapping

Optional: Write data to the database

Integration Unit

Data transfer

Data structure

Define data structure

By selecting the format (e.g. Excel, XML, CSV, EDIFACT, SAP IDoc, ANSI X.12, FixRecord, etc.), you define the type of data structure.

Select the appropriate character encoding and click on <Continue>

Preparation for mapping

To map the source data structure to the target data structure, either choose from the existing templates or create your own templates. All common industry formats (including EDIFACT, VDA, X.12, Fortras and many others) are available as standard.

Define manipulations or additional functions by selecting a definded or self-configured “filter” and click on <Continue>

Defining additional processing steps

This step will only be necessary if you want to introduce additional, business-specific processing steps. This can be PDF or Excel file generation, the creation of reports or other online transactions (customs, digital signature etc.).

Specify the appropriate settings and click on <Continue>

Data transfer

Now specify by which transfer route (file, email, FTP, OFTP2, SAP ALE etc.) data should pass to the target system. It is possible to select several different interdependent transfer routes.

Define the target(s) and click on <Continue>

TIP: If Lobster_data does not provide a predefined template for your individual mapping, you can create your own. As well as easy-to-handle functions for tree creation like drag & drop, copy & paste etc., templates can also be created in MS Excel and imported afterwards.

Lobster_data comes with more than 250 pre-defined filters that cover 98% of all required manipulations and additions. Customer-defined filters can be integra-ted easily as and whenever necessary. An additional time-saver is the import of entire tree-structures automatically, direct access to data-bases or third party systems (ERP, CRM, Warehousing … ) and much more.

Step 3

Step 4

Optional: Step 5

Step 6

TIP: It is very easy to define escalation scenarios depending on whether the transfer of data has been successful or not.

© Lobster GmbH 2015 | 8

Optional: Step 7

© Lobster GmbH 2015 | 11

Useful optional modules:

Content Inspection

The optional module “Content Inspection” allows to merge data from different data files or sources and to process them together. The contents can be analyzed and regrouped into different “data entities” following pre-defined rules. These can be processed afterwards with all the options available in Lobster_data and transferred to other systems.

FaxService

Also available as an option is the “FaxService” module which adds functionality for sending and receiving fax messages. Incoming faxes can be converted, stored or printed by Lobster_data. Processed data can be, among others, sent by fax. In this case, the Lobster_data module works as a fully functional “fax gateway”.

DataFlow

As you already know, data conversion is done in Lobster_data by using profiles containing all of the settings and manipulation rules. Having processed the data, you can perform various tasks: if a profile is configured for an ERP system, it can afterwards transfer data to other target systems too, or generate reports etc. Profile A can directly trigger Profiles B and C etc. or can be routed from profile to profile.

DataFlow provides a graphical overview of this process. The profile inter-dependencies are displayed similarly to an organizational chart and can be modified within this chart.

If many profiles exist in a system, it could be that the user assigns the wrong profile to incoming data. In this case, processing would not be correct. DataFlow’s simulation tool shows which profile would process which data in which order in a clearly laid-out way. This makes the selection of the correct profile remarkably easy.

Another feature of DataFlow is the Process View in the ControlCenter. By selecting individual jobs, the user gets an overview of how a profile is embedded into the entire process. Errors or interruptions in the process can be – they are marked in red by the system.

Every step in Lobster_data is surprisingly simple, efficient and secure. All the steps are documented automatically in the system, they can be tracked at any time and edited whenever necessary.

SAP-Integration using Lobster_data

Integration of data from SAP systems is becoming exceptionally easy. Lobster_data is able to communicate in an SAP ALE environment with one or more SAP systems and to send and receive IDocs. Moreover, the data converter is capable of making RFC calls directly to an SAP system and of processing the resulting data. The converted data can be sent to SAP via RFC or SAP ALE, and IDoc and RFC structures can be requested online.

Lobster_data provides ready-made tree structures for all standard SAP IDocs – an enormous time saving for you!

Notification in case of error

In this step you define the persons to be notified by email or SMS in case of data entry error (e.g. mandatory fields not filled in, data not readable ... ). Click on <Save> when finished.

This process can also be specified in the ControlCenter.

With the aid of Lobster_data, you have now performed successful data integration starting from any data source to defined targets in just a few mouse clicks.

Monitoring

Conventional “logging” means that extensive log files are searched using a text editor. This is complex and often confusing. Lobster_data offers another approach: only the information on the selected profile is displayed – limited to a specified period of time. Errors are displayed in a separate list, along with all related messages. In addition, detailed search functions and a clearly arranged display make finding information easy. Logs can be defined at field level.

WebMonitor

Lobster`s WebMonitor clearly displays the information provided by the ControlCenter using any web browser. Thanks to the integrated user access management, business units, customers or suppliers can be granted specific user rights and would be able to correct faulty input data or start search queries.

Data Backup

Lobster_data stores all data in a backup. If an error occurs during further processing – perhaps caused by network failures or incomplete data – the entire processing operation can be tracked back, the error isolated, cor-rected and the processing can be repeated.

Messages

On successful or faulty profile processing, Lobster_data sends messages to the number of specified recipients. By using configuration filters, it is even possible to trigger messages during the mapping process. This allows for an immediate and precise response to the current data.

Data Security with Lobster_data

The automation of business processes requires detailed control of the individual tasks or operations. A comprehensive, user-friendly logging system is as important as proactive functions that notify relevant staff of the data processing status. Moreover, it is essential to ensure that no data is lost at any time.

These requirements are met by Lobster_data throughout the entire process and guarantee the highest possible transactional security.

Central monitoring for IT personnel via ControlCenter

Simplified monitoring via WebMonitor for business units, customers, suppliers etc.

SmartPhone monitoring for out and about

© Lobster GmbH 2015 | 12

MultifunctionalityAs a central data communication hub, Lobster_data represents a single solution for all requirements: integration, data transfer as well as data communica-tion between ERP and CMS systems, databases, web platforms, customers and suppliers.

Lobster_data should be regarded not only as a conventional data converter but rather as a “middleware” between IT systems (ERP, PPS, PIM, accountancy, CRM, web shop ...) and customers, suppliers, service providers, authorities, banks; irrespective of the nature of the data or the target system.

Message structuresLobster_data provides automated pre-processing of complex message structures. For example, messages can be split up into header and position records, and source data can be read starting from a defined line number or column.

Platform neutralityAs an open, platform-neutral system the graphical front-end of Lobster_data is compatible to the opera-ting systems Windows, MacOS and Linux. The server application supports all common platforms, starting with Java 5 (as well as Windows and Linux, among others AIX and IBM i ) and can be installed to virtualised server environments. Integration with common databases (JDBC) is guaranteed.

PerformanceEven when processing several operations in parallel or dealing with enormous amounts of data, Lobster_data offers extremely high performance.

Schedules (Crons)Lobster_data provides very flexible options in configuring jobs through crontab-syntax (e.g. “every last day of the month”, “every Friday” etc.).

Lobster_data makes all the Difference

UsabilityA survey of users showed that 90% of our customers rate Lobster_data`s installation and usability as “very simple”. Thanks to a clearly structured graphical user interface, programming skills are not required.

A wizard (similar to the Microsoft Wizard) guides you through the easy to understand and intuitive appli-cation. Data manipulation is performed using a filter system similar to that of MS Excel: instead of script programming, functions are assigned to appropriate fields or nodes. A “release-safe” implementation of business-specific functions is subsequently very easy.

DocumentationLobster_data automatically documents each creation of an interface and/or a profile. In this way, there is documentation for every interface which can be added easily to your own comments. Independent of this automatic function, it is very easy to check up on an interface that has been created with standard filter functions. This can be compared to MS Excel, where the functions assigned to the spreadsheet or the cells are easy to understand.

Of course, special business-specific functions can be added to Lobster_data. These are also described in the automatic documentation function.

MappingEspecially when configuring mapping, Lobster_data offers considerable time-saving in comparison with other systems, i.e. by providing pre-defined filters, the automatic import of tree structures, direct access to databases and third-party systems (ERP, CRM, warehouse systems etc.) and many more.

The connection between source and target data can be established using “drag & drop”, by simply dragging values from the input data to the target data structure.

To write data directly to a database or to read data for further conversion, Lobster_data immediately integrates the fields of any database (e.g. MS SQL Server, Sybase, Oracle, Informix, MAX DB, DB2, PostgreSQL and more) as a target structure. In fact, Lobster_data imports the table structures from the database and visualises them as a tree structure, including all their relevant attributes.

Inside the mapping designer, all data structures (e.g. standard structures such as EDIFACT, VDA, Fortras, PRICAT, but also individual structures from XML, MS Excel, CSV etc.) can be freely modified in structure, field definition and so on.

During mapping and subsequently, Lobster_data allows selective splitting, conversion and output of large amount of data, following individually defined criteria.

In the development phase of mapping, it is possible to test step by step and view the contents of variables and mapping results in a preview. You can also load test data into the source structure (this often facilitates the identification of source fields) in order to visualise the up-to-date data flow from data source to target.

If you need different versions of the same mapping for different data transfer partners, it is easy to copy an existing processing profile, mapping included. If necessary, partner information and relevant mapping parameters can be modified in the copy (input/output) – another considerable time-saver.

In contrast to other software solutions, Lobster_data follows the philosophy of mapping data from the target data structure to the data source. This saves unnecessary creation of innumerable variables, because source data can be addressed directly from the target field.

ServiceLobster is not only renowned amongst its customers for excellent software products for data conversion and integration, but also its highly personal level of support: Fast. Reliable. Outstanding technical expertise. In addition to that, Lobster_data has an exhaustive online help function, as well as the “TeamViewer” connection.

Standard settingsThe Lobster_data standard package contains over 4,000 interface templates to ERP systems, as well as all relevant industry standards (EDIFACT, SAP IDOC, VDA, Fortras, ANSI X.12, &c.).

Lobster_data supports all common data transfer protocols (e.g. (S)FTP(S), OFTP, OFTP2, SMTP, HTTP(S), SMS, SAP-ALE, IBM-DataQueue, AS2, X.400, WebDAV, SCP, SSH, Fax, WebServices (SOAP) ... ).

Version managementThe Lobster_data´s approach to handling versioning in relation to process and profile offers many significant advantages. A change in mapping will not necessarily have an effect on all the other data transfer partners. Moreover, several process versions are available as backup. It is very easy and simple to re-activate one or more of the previous mapping or processing versions.

Lobster UKDunston Innovation Centre Dunston Road ChesterfieldDerbyshireS41 8NG

PHONE +44 (0) 114 3 991 551 MAIL info@lobster-uk.com

For more information visit www.lobster-uk.com