SaaS Data Services Applications...data, from various sources, both structured and unstructured is a...

SaaS ShopService Descriptions

SaaS Data Services Applications for the Cloud

September 18V1.1

VCL SaaS Shop Data Services Applications Service Description

Introduction

Data is one of the most important assets that an organisation owns, arguably its mostimportant. How organisations access and use that data is critical to the effectivenessof their operations. It identifies threats and also opportunities. It identifies strengthsand weaknesses. How that data can be turned into valuable, decision makinginformation can determine how an organisation might grow and develop. Access todata, from various sources, both structured and unstructured is a modern businessimperative. Our Data Services applications are designed to identify, access, processand capture the logic and data that is critical to the business operation. Of particularconcern for modern business is the vulnerability of business data to cyber attackwhich can be extremely costly as many organisations have found to their cost.

Viewdeck provide a number of secure data and data management services that arepresented as cloud delivered managed services offerings. These provideorganisations with options for providing their data services whilst taking away thesecurity management overhead.

SaaS Data Services Applications for the CloudThe services offered by Viewdeck are outlined below.

SaaS Applications for the Cloud • Reporting Server as a Service (VRSS). • Extract, Transform and Load Server as a Service (VETL). • Viewdeck Big Data Analytics Service (VDAS). • Viewdeck Data Ingester Service - Logstash® (VDIS) • Viewdeck Single View of Data as a Service (VSVS). • Viewdeck Search and Discovery Service - Elasticsearch® (VSDS). • Viewdeck Visualisation of Data Service Kibana® (VSVL)Additional Information • Support • Terms and Conditions • Viewdeck Cloud Software Catalogue • Why Viewdeck?Document: VCL-SaaSShop-Data-Services-Applications-Sep18-1.0Date: September 18Status: Final ReleaseTitle: SaaS Applications for the Cloud

Key Services● Reporting Server as a Service (VRSS)- Our enterprise class Reporting

Service, is designed to pull together Management and Operationalinformation, Multi-dimensional data and presentational information throughOffline and Online reports and Dashboards. The Service works across a widerange of standard data sources providing simple and efficient BusinessIntelligence, OLAP, Reporting and Dashboards for use across the business.

● Extract, Transform and Load Server as a Service (VETL) - Our enterpriseclass Extract, Transform and Load Solution, supports Big Data integration.The Service is suitable for one-off migrations or constant datatransformation. It provides a simple to use Visual data manipulation tool thatenables you to join sources and data together. The Service providesintegration and migration services across a wide range of sources including,SQL, Hadoop HDFS, HBase, Hive, Pig, Sqoop, Google BigQuery and NoSQLdatabases.

● Viewdeck Big Data Analytics Service (VDAS) - VDAS delivers analysistechniques developed over many years in the private sector, to the publicsector. The service provides a Single View of the data required to analyseand correlate information delivering unprecedented levels of informationalanalysis and automated process support to identify trends and patterns inthe data.

● Viewdeck Data Ingester Service - Logstash® (VDIS) - VDIS is aLogstash® cloud service, that enables the ingestion of data from a

©Viewdeck Consulting Limited 2018 of 31


multitude of sources simultaneously. It provides the ability to ingest a varietyof inputs to pull in large quantities of data from common sources. VDISsupports transformation and provides the ability to visualise in services suchas Elasticsearch®.

● Viewdeck Single View of Data as a Service (VSVS) - This Service supportsthe presentation of business data, both structured and unstructured frominternal and external sources, providing a data platform for detaileddiscovery. Its leading cloud based design avoids the need to move large datasets or create staging environments, enabling additional data to be addedquickly and efficiently.

● Viewdeck Search and Discovery Service - Elasticsearch® (VSDS) - TheVSDS Service is an Elasticsearch® based, distributed search and discoverysolution, capable of solving a wide range of data indexing and retrieval usecases. The Service enables you to store and index large quantities ofstructured and unstructured data, and use keyword or natural languagetechniques to retrieve records.

● Viewdeck Visualisation of Data Service Kibana® (VSVL) - This Serviceuses Kibana®, the data visualisation plug in for Elasticsearch making it easyto understand large volumes of data. It has a simple, browser-basedinterface enabling you to quickly create and share dynamic dashboards.Users can create bar, line and scatter plots, or pie charts and maps on top oflarge volumes of data.



SaaSShop-SDS-RSS1: Reporting Server as a Service (VRSS)

Enterprise class Reporting Service, designed to pull together Management Reports,Operational data and presentation information in Offline, Online and Dashboards.Works across a wide range of standard data sources. Simple and efficient BI, OLAP,Reporting and Dashboards for wide business use.

Features Stand-alone or embeddable reporting server, online, mobile and dashboards. Client Tool to help create reporting templates. Business Intelligence Platform, capable of OLAP, Data Exploration Cubes. Integrate with identity systems such as AD, LDAP and CAS. User and Role based access to reports, dashboards, resources, folders. Simple and Efficient, Low bandwidth and secure networks supported. Secured, audited, managed, and under configuration control. Wide range of output formats including PDF, XML, HTML, MSOffice etc. Resilience and Highly Available configurations, to support service levels. Based on the industry leading JasperReports®.

Benefits Self-service access to reporting and data informatics. HTML, XLS, XLSX, PDF,CSV, DOCX, RTF, Flash, ODT, etc. Central report scheduling and distribution based on calendar schedules. Secure server platform, production ready for Public, Tier1 Services. Suitable for Public, Private and Shared Cloud environments. Integrates into a wide range of web and collaboration tools. Works with UKCloud, AWS, Azure and private clouds. Self administer via Web interface, or fully managed service. Supports Digital Service delivery process (Discovery, Alpha, Beta, Live).

Service DescriptionOur enterprise class Reporting Service, is designed to pull together Management andOperational information, Multi-dimensional data and presentational informationthrough Offline and Online reports and Dashboards. The Service works across a widerange of standard data sources providing simple and efficient Business Intelligence,OLAP, Reporting and Dashboards for use across the business.

The service is based on JasperSoft, the world’s most widely used and proven self-service business intelligence, reporting and analytics platform. It provides a range offeatures including:

Reporting across a range of platforms – allows the creation and exploration of summary and detail data from relational, NoSQL or Big Data sources using a highly interactive browser based service.



Utilisation of Open standards – the service uses a REST and SOAP-based web service architecture.

Multiple delivery platforms – information can be deployed to web and mobileplatforms, both IOS and Android.

Intuitive dashboard designer - Web-based, drag-and-drop user interface enabling the combination of different types of data and graphical indicators. This provides summary and detailed information to all types of user within an organisation.

Free-form layout designer - for customised dashboard design allowing combination of internal and external data sources. This provides the ability to gain a deeper insight into your data.

Designed for use across an enterprise - easy to use by Business users or Report analysts inn both online or offline mode.

Reporting Output to wide range of formats - including PDF, HTML, Microsoft Excel, RTF, ODT, Comma-separated values or XML.

Widespread industry support - with many 3rd party tools and applications able to re-use. JasperSoft empowers more than 130,00 apps with millions of users.

Resilience - can operate with the Viewdeck Resilient Database Service to provide a High availability, segregated reporting solution.



SaaSShop-SDS-ETL1: Extract, Transform and Load Server as a Service (VETL)

VETL is an Enterprise class Extract, Transform and Load Solution, supporting BigData integration. Suitable for one off migrations or constant data transformation.Visual data manipulation to join sources and data together. Integration and migrationservices across wide range of sources SQL, Hadoop HDFS, HBase, Hive, Pig, Sqoop,Google BigQuery and NoSQL databases.

Features Data Integration via fast interactive visual data presentation. Ideal for analysts and data engineers. Ability to connect to wide range of data sources. SQL, noSQL, legacy, mainframe, proprietary data sources. Ideal as Data Quality tool, migration legacy services to Cloud. Data Cleansing, Fix and resolve inconsistencies and omissions. Client Tool to help create reporting templates. Secured, audited, managed, and under configuration control. Ideal Legacy to Cloud Data Migration /Integration tool. Based on Talend® Open Studio, Data Quality and integration toolset.

Benefits Resilient and Highly Available configurations, to support service levels. Secure server platform, production ready for Public, Tier1 Services. Suitable for Public, Private and Shared Cloud environments. Works with UKCloud, AWS, Azure and private clouds. Self administer via Web interface, or fully managed service. Extensive support for wide range of data sources. Supports Digital Service delivery process (Discovery, Alpha, Beta, Live). Enables Data Synchronisation between legacy and modern services. Available as an Appliance or part of a structured Service.

Service DescriptionOur enterprise class Extract, Transform and Load Solution, supports Big Dataintegration. The Service is suitable for one-off migrations or constant datatransformation. It provides a simple to use Visual data manipulation tool that enablesyou to join sources and data together. The Service provides integration and migrationservices across a wide range of sources including, SQL, Hadoop HDFS, HBase, Hive,Pig, Sqoop, Google BigQuery and NoSQL databases.Simplifying the loading,extraction, transformation and processing of large and diverse data sets.

Extract, Transform, Load (ETL) is is the process of gathering data from an unlimitednumber of sources, organising it together, and centralising it into a single repository.The concept was first developed in the 1970s and has since been a trusted process



for taking data out of its existing format, making changes to ready it for relocation,and placing it in its new database home. But far from a one-size-fits all science, smartETL must be highly customised for each businesses needs. Below is a look at thethree phases of ETL, how it applies to business, and popular tools for simplifying theprocess.

The Value of ETLToday more than ever businesses gather data from disparate sources and use it tomake decisions. The data warehouse concept gained popularity because it provides acentral location for ingesting, sorting, and storing all this information and turning itinto usable information called business intelligence.

ETL-based data warehouses became the standard for producing businessintelligence that works interactively with various departments like marketing, sales,customer service, and other traditional team divisions so organisations can bothrespond to customers and gain better insight to their business.ETL tools help create business intelligence by sorting, combining and providingaccess to data in three steps:Staging — Staging is the docking area of an ETL-based data repository or warehouse.As the data comes in, it is sorted and processed based on previously defined rules,before moving on to the next part of the process.Data integration — At this stage, the data is combined and blended, handlingexceptions and issues with the outlined rules you have defined. The data is preparedfor presentation in a unified, easy-to-understand format.Access Layers — The access layers are the front-end interface options provided tousers for connecting and interacting with the data you want them to have.The business intelligence distilled from this cycle can be the critical insight you needin today’s high-speed market. The ETL process collects from many sources of dataand turns it into regular and consistent informational views.

How the ETL Process WorksETL is a process driven by three ordered, defined steps.Step 1: ExtractThe aim of ETL is to produce consistent and valuable business intelligence. Raw data,often in huge quantities, must be mined from an array of sources, including:

Existing databases Activity logs like network traffic, error reports, and audit information Application performance and anomalies Security events Other transaction activity that must be reported for compliance

This is the phase where all the data is presented to the data warehouse or repository.The extraction process ordinarily assumes that as much data as possible is better forinformational purposes, and therefore the quantities of data would be beunmanageable without the next step in the ETL process.Step 2: Transformation



The transformation stage of ETL is where the most critical work takes place. The datathat has been presented through the extraction process has to be reduced, refinedand sorted, before it becomes valuable.Transformation is achieved through a series of rules and regulations that you define.Fundamental goals during this stage should include:

Standardisation — Define what data is relevant, how it will be formatted and stored, and other considerations that will define every step that follows.

Deduplication — Excluding and discarding redundant data will significantly reduce the working dataset.

Verification — Run automated checks to compare similar information like transaction times and access records. Verification tasks further remove unusable data and can identify anomalies in your network.

Sorting — Modern data repository techniques maximise efficiency by grouping, storing and aggregating raw data, audio, multimedia, and other objects in categories. Transformation rules determine how each piece of data is classified and where it will go next.

Other tasks you define and set to automatically execute.These transformation steps reduce the mass of previously unusable material into adata product you can present in the final step of ETL, the load phase.Step 3: LoadLoading this extracted, transformed data into the repository is the last stage of theETL process. Running as a series of automated procedures, data loads in a variety ofways. Depending on storage and throughput considerations, the loading procedurecan run in two main ways:Full Loading — In an ETL full loading scenario, everything that comes from thetransformation process goes into new, unique records in the repository. Though theremay be times when this is useful for research purposes, full loading produces datasets that grow exponentially and can quickly become difficult to maintain. Fullloading, which was once the aim of most data warehousing soutions can significantlylimit the agility and effectiveness of your ETL process.Incremental Loading — Incremental loading is a less comprehensive but moremanageable approach.. Incremental loading compares incoming data with what’salready on hand, and only produces additional records if new and unique informationis found. This architecture allows smaller, less expensive data warehouses to maintainand manage business intelligence.The load choice and rules that define it are critical, as they will inform what data isavailable to users and how they can work with it.Once the decisions and design are in place, executing a lone ETL cycle or ascheduled series of them is as simple as executing a task from a command line orGUI interface.

The key features of our VETL Service include: Integration solution with teamwork and management features. Hugely scalable. Powerful and versatile integration and data quality solution.



Data integration job design with a graphical development environment. Reduce duplicate sources of data into trusted stores of consolidated

information. Unify data, application and service integration solution simplifying change

and migration. Resolution of inconsistent information across organisation into a single,

reliable single source. An open source data profiling tool: content, structure and quality of complex

data structures. Widespread industry support, with many 3rd party tools and applications

able to re-use. Can operate with the Viewdeck Resilient Database Service to provide a High

availability, segregated ELT solution.



SaaSShop-DSA-VDA1: Viewdeck Big Data Analytics Service (VDAS)

VDAS delivers analysis techniques developed over many years in the private sector,to the public sector. The service provides a Single View of the data required toanalyse and correlate Information delivering unprecedented levels of informationalanalysis and automated process support to identify trends and patterns in the data.

Features Provides a Single View of the data. Delivers data from internal and external sources. Simplifies structured and unstructured data. Can include social media data. Uses advanced machine learning techniques. Identifies patterns and trends across data sets. Isolates spikes in data trends. Identifies anomalies and inconsistent activities. Real-time and near real-time process support capability.

Benefits Simplifies the analysis of disparate data sets. Identifies patterns of activity and association in the data. Easy to use, adapt and change. Machine learning allows patterns to be understood and shared. Dynamic interrogation of data. Dashboard identifying changes in patterns in real-time. Secure service. Enables cross agency cooperation.

Service DescriptionVDAS delivers analysis techniques that have been developed over many years in theprivate sector, to the public sector. The service provides you with a Single View of thedata required to analyse and correlate Information delivering unprecedented levels ofinformational analysis and automated process support to identify trends and patternsin the data. VDAS uses advanced machine learning and predictive analysistechniques to provide deep insights in the data.

The Service is based on Visallo® which helps intelligence analysts, law enforcementdetectives, and fraud investigators produce more rigorous and defensible conclusionsby helping them discover, visualise, and understand complex relationships hidden inmassive amounts of data.

These services are suitable for Private, Community or Public Cloud hosting, on theInternet, and in Tier 1 or higher environments.



Technology designed for investigationIt is recognised that the best investigative analysis continues to be done by people.We are still better than computers at making analytical judgements in ambiguoussituations, but can’t handle the massive amounts of data that we are accumulating.That’s where Visallo comes in, helping people leverage huge quantities of data usinginvestigative analytics and rich data visualisations.

Visallo’s unique indexing architecture allows you to find all types of media. You’ll beable to search for images, photos, and other non-text data just like you do fordocuments today. Your videos, audio files and images will never get lost again. TheService provides:Full-Text Search - Visallo extracts content from documents, images, videos andmany other content types, making them easily searchable. You can integrate customanalytics to extract text from any format.Property Filters – You can narrow searches with filters, for example: all photos takenin the last three days that have a geolocation.Search Related – You can search around relationships of an entity, including similaritems or entities in common.Saved Searches - Reuse searches for later execution and optionally, display theresults on the Dashboard.

Identifies relationships you were not aware ofGraphical visualisation is at the core of Visallo's user interface. Data is organisedthrough a rich set of layout options. You can experiment with what-if scenarios in theconfines of a private sandbox, and find connections within your data that you didn’teven know existed.Graph - Graphical visualisations are the ideal display for understanding data and therelationships among things in the real world.Map - Visallo can extract geographic information from your data and show it to youon map.Dashboard - Combine multiple visualisations into a perfect landing page that worksfor you.Selection Histogram - Select multiple entities to generate automatic histograms oftheir properties and easily drill down for more detail.Timeline - Display all the temporal data in your workspace within a histogram to findoutliers or drill down using time.Find Path - Find deep connections between any two pieces of data within secondswhile using the graph to visualise them.

Promotes Faster Collaborative WorkReal-time collaboration is built into the core of our service. Your data is organisedinto cases and easily shared with co-workers where everyone sees updates as theyhappen. It’s collaborative editing for teams of investigators, analysts, and theirmanagers.



Live Updates - All changes to the system are sent to connected users to keep theirview fresh.Case Sharing - You can choose to share your case to any number of users withappropriate privileges. All changes to the graph or properties are immediately visibleto everyone who is connected.Publish - All changes inside a case are in a draft state until a user with appropriateaccess publishes those changes for other users to see.Comments - Add comments to entities and relationships to keep notes or askquestions right alongside the content.

Keeps Everything SecureA fine-grained access control model allows you to restrict any data property orrelationship individually, ensuring that no one sees something they shouldn’t. Evenwhen sharing cases, Visallo ensures that everyone sees only the data they’reauthorised to see.Property-Level Security - Security labels can be applied as fine-grained as needed,either at the entity, relationship, or property level.Workspace Sharing - Sharing a workspace will only give access to entities orproperties that those users have access to.Visallo was designed with extension and customization in mind. From the underlyingdata store to data processing algorithms and UI plugins, the service providescomplete flexibility.



SaaSShop-DSA-VIS1: Viewdeck Data Ingester Service - Logstash® (VDIS)

VDIS is a Logstash® cloud service, that enables the ingestion of data from amultitude of sources simultaneously. Ability to ingest a variety of inputs to pull inlarge quantities from common sources. VDIS supports transformation and the abilityto visualise in services like Elasticsearch®.

Features Integrates with Elasticsearch. Dynamically transforms and prepares data regardless of format or

complexity. Transforms structured and unstructured data. Based on NOSQL Data Engine. Decipher geo coordinates from IP addresses. Anonymise data, exclude sensitive fields completely. Simplifies processing independent of the data source, format, or schema. Rich filter library with Flexible output routing. Standard plug ins for many data sources. Automated log data ingestion.

Benefits Simpler, accelerated analysis with clear business value. Derives structure from unstructured data. Allows you to unlock valuable data discovery. Part of your DPA, Data compliance service. Manages data retention Provides geo data storing, retrieving and analysis Supports a variety of repository sources. Reduces time and effort to prepare data and produce visualisations.

Service DescriptionVDIS is a Logstash® cloud service, that enables the ingestion of data from amultitude of sources simultaneously. It provides the ability to ingest a variety ofinputs to pull in large quantities of data from common sources. VDIS supportstransformation and provides the ability to visualise in services such asElasticsearch®.

Logstash is a tool to collect, process, and forward events and log messages.Collection is achieved through configurable input plugins including rawsocket/packet communication, file tailing, and several message bus clients. Once aninput plugin has collected data it can be processed by any number of filters whichmodify and annotate the event data. Finally logstash routes events to output pluginswhich can forward the events to a variety of external programs includingElasticsearch, local files and several message bus implementations.




Single ViewLogstash is an open source, server-side data processing pipeline that ingests datafrom a multitude of sources simultaneously, transforms it, and then sends it to yourchosen repository. Data is often scattered or siloed across many systems in manyformats. Logstash supports a wide range of inputs, including:

AWS CloudWatch CouchDB Elasticsearch query results GitHub Google Cloud IMAP server email Java applications via JMX Salesforce SOQL queries

and many more.

These inputs pull in events from a multitude of common sources, all at the sametime. This allows you to easily ingest data from your logs, metrics, web applications,data stores, and various AWS services, all in continuous, streaming fashion. As datatravels from source to store, Logstash filters parse each event, identify named fieldsto build structure, and transform them to converge on a common format for easier,accelerated analysis and business value. Logstash dynamically transforms andprepares your data regardless of format or complexity. This is achieved through:

Deriving structure from unstructured data with grok Deciphering geo coordinates from IP addresses Anonymising PII data, excluding sensitive fields completely Easing overall processing independent of the data source, format, or

schema.

The service provides a huge library of filters to assist this process. These include: Aggregation Date comparisons and evaluating the difference between two dates Removal of special characters Truncation

and many, many more.

Although, as part of the ELK suite, Logstash naturally outputs to Elasticsearch, it canalso output to a variety of other products to provide a flexible platform opening up ahost of search, investigation and analytical possibilities. These include:

AWS CloudWatch Specific email addresses based upon predetermined criteria Google BigQuery



MongoDB Zabbix

and many more.Logstash modules orchestrate a turnkey ingest-to-visualize experience with populardata sources like ArcSight and Netflow. With the power to instantly deploy ingestionpipelines and sophisticated dashboards, your data exploration starts in minutes. Ithas a pluggable framework featuring over 200 plugins. You can mix, match, andorchestrate different inputs, filters, and outputs to work in pipeline harmony.

If you are ingesting from a custom application and a plugin doesn’t exist we can buildone for you or you can build yourselves. Logstash plugins are easy to build and thereis an API for plugin development and a plugin generator to help you start and, if youwish, share your creations with the broader Logstash community.

If Logstash nodes happen to fail, Logstash guarantees at-least-once delivery for yourin-flight events with its persistent queue. Events that are not successfully processedcan be shunted to a dead letter queue for introspection and replay. With the ability toabsorb throughput, Logstash scales through ingestion spikes without having to usean external queueing layer.

Whether you’re running 10s or 1000s of Logstash instances, we can fully secure youringest pipelines. Incoming data from inputs can be encrypted, and there's fullintegration with secured Elasticsearch clusters.

Logstash pipelines are often multipurpose and can become very sophisticated,making a strong understanding of pipeline performance, availability, and bottlenecksinvaluable. We provide monitoring and pipeline viewing capabilities so that you caneasily observe and study an active Logstash node or full deployment.



SaaSShop-DSA-VSL1: Viewdeck Single View of Data as a Service (VSVS)

VSVS is a Logstash® cloud service, that enables the ingestion of data from amultitude of sources simultaneously. Ability to ingest a variety of inputs to pull inlarge quantities from common sources. VSVS supports transformation and theability to visualise in services like Elasticsearch®.

Features Provides a Single View of the data. Based on Kibana® providing visualisation capability for Elasticsearch®

cluster indexes. Delivers and presents data from internal and external sources. Simplifies structured and unstructured data, identifying relationships. Efficient data handling to integrate with existing data stores. Enables business to Identify patterns and trends across data sets. Real-time and near real-time process support capability. No requirement for traditional data warehouse/ mart approach. Data security classification remains intact.

Benefits Simplifies the presentation and discovery of disparate data sets. Rapid presentation of data, multiple 'What If's' quickly generated. Cost effective extension of Single View, near real-time. Single version of the "truth", no multiple copies of data. Simple to implement and extend, web-based delivery, cloud solution Reduced IT costs. Share analysis and reports efficiently across your organisation. On-Prem and Cloud solution, to join up data discovery. Supports Data protection regulation and compliance needs. Wide range of plugins and additional capabilities.

Service DescriptionOne of the largest issues facing Enterprises today both government and commercialis the number of unconnected “Silos” of data inside and outside the organisation.These silos have been produced due to the number of disparate systems deployedagainst different business requirements, each system utilising its own data storageenvironment and access mechanisms. In addition to the internal data areas agrowing number of external sources such as publicly available government data (e.g.Motor Vehicle Records), subscription based data (e.g. Financial Scoring) form part ofthe query and the problem gets worse. It is an increasing requirement to gain a viewacross these various silos to provide a “Joined Up” perspective from an individual or abusiness area. This we call a “Single View”.



Single ViewVSVS combines the capabilities of Logstash to provide a single view of data with thegraphical analysis capabilities of Kibana, both integral components of the ELK stack.The Service provides a Logstash® cloud service, that enables the ingestion of datafrom a multitude of sources simultaneously. It provides the ability to ingest a varietyof inputs to pull in large quantities of data from common sources. VDIS supportstransformation and provides the ability to visualise in services such asElasticsearch®.

Logstash is a tool to collect, process, and forward events and log messages.Collection is achieved through configurable input plugins including rawsocket/packet communication, file tailing, and several message bus clients. Once aninput plugin has collected data it can be processed by any number of filters whichmodify and annotate the event data. Finally logstash routes events to output pluginswhich can forward the events to a variety of external programs includingElasticsearch, local files and several message bus implementations.

Kibana gives you the freedom to select the way you give shape to your data.Particularly when you don’t always know what you're looking for. With its interactivevisualisations, you can start with one question and see where it leads you.Kibana has a standard range of graphical representations including:

histograms, line graphs, pie charts, sunbursts,

and more. You can also design your own visualisations should the wide range ofavailable representations not suffice. All leverage the full aggregation capabilities ofElasticsearch.

Typically organisations use Data Warehouses to combine various data elements intoa single location that can then be queried to extract the data elements required.Data Warehouses tend to be batch loaded via an Extract – Transform – Load (ETL)process, such as VETL, and then the data has an access layer added to provide agateway into the various elements of the warehouse. Also the data is typically pre-processed providing aggregated subsets for easier reporting. These may be referredto as Data Marts.

While useful for analysing large sets of predetermined data, a Data Warehouseapproach incurs additional costs from an IT Infrastructure supply/support andmanagement perspective. As the data is loaded in a batch process it will almostalways be “Historical” and not up to date. Consequently Data Warehouses can proveexpensive where real time and near real time analysis is required.



SaaSShop-DSA-VSD1: Viewdeck Search and Discovery Service - Elasticsearch® (VSDS)

The VSDS Service is an Elasticsearch® based, distributed search and discoverysolution, capable of solving a wide range of data indexing and retrieval use cases. TheService enables you to store and index large quantities of structured andunstructured data, and use keyword or natural language techniques to retrieverecords.

Features Horizontally Scalable and performant to support very large data sets. Full-text querying via a range of language and business rules. Automatic failure detection and recovery. Numeric and geo data search capabilities. Multiple search capability across wide set of databases. Central Data store, working with Logstash and Kibana products. Rapid, production ready service suitable for a wide range of needs. Integral part of ELK stack. Supports wide-range of Iaas platforms. Aws, Azure, UKCloud, Private Cloud. Secure meeting regulatory and compliance requirements.

Benefits Handles huge quantities of data, in the Cloud. Provides for full information discovery, capability. Identifies relationships between structured and unstructured data. Delivers wide range of data mining possibilities. Supports Web. RESTFul and microservices architectures. Elastic scalable service, supporting operational and data mining use cases. Wide range of plugins available to support Language, search, etc. Close integration with JSON data, to support NOSQL structures.

Service DescriptionThe VSDS Service is an Elasticsearch® based, distributed search and discoverysolution, capable of solving a wide range of data indexing and retrieval use cases. TheService enables you to store and index large quantities of structured andunstructured data, and use keyword or natural language techniques to retrieverecords.

VSDS delivers search and data exploration techniques that have been developedover many years in the Private sector, to the public sector. The service provides aSingle View of the data required to analyse and correlate Information deliveringunprecedented levels of informational analysis and automated process support toidentify trends and patterns in the data.



VSDS uses advanced machine learning and predictive analysis techniques to providedeep insights in the data. These services are suitable for Private, Community or PublicCloud hosting, on the Internet, and in Tier 1 or higher environments.

Single ViewOne of the largest issues facing Enterprises today across the public and privatesectors is the number of unconnected “Silos” of data inside and outside theorganisation. These silos have been produced due to the number of disparatesystems deployed against different business requirements, each system utilising itsown data storage environment and access mechanisms. In addition to the internaldata areas a growing number of external sources such as publicly availablegovernment data (e.g. Motor Vehicle Records), subscription based data (e.g. FinancialScoring) form part of the query and the problem gets worse. It is an increasingrequirement to gain a view across these various silos to provide a “Joined Up”perspective from an individual or a business area. This we call a “Single View”.

New technologies continue to address this requirement and the issues that cause it.In recent years the Elastic Stack, often known as the ELK Stack, has gained a marketdominant position and provides search and analysis solutions for thousands oforganisations, covering a wide range of use cases.

"ELK" is the acronym for three open source projects: Elasticsearch, Logstash, andKibana. Elasticsearch is a search and analytics engine. Logstash is a server-side dataprocessing pipeline that ingests data from multiple sources simultaneously,transforms it, and then sends it to a repository such as Elasticsearch. Kibana letsusers visualise data with charts and graphs in Elasticsearch.

Elasticsearch is an open source, distributed, RESTful, JSON-based search engine. It isdesigned to be easy to use, scalable and flexible, and it has continued to grow inpopularity among and ever increasing number of users. Although initially a searchengine at heart, users started using Elasticsearch for logs and wanted to easily ingestand visualise them. This led to the development of Logstash, the powerful ingestpipeline, and then Kibana, the flexible visualisation tool. This created the ELKplatform.

The product set continues to advance delivering more power and capability to theever growing user community. The Service provides a range of sultions to handle:Logging – This ELK based Service is the most popular open source logging solutionwith out-of-the-box support for common data sources and default dashboards asstandard.App and Site Search – Supporting a range of algorithm features including SpellingCorrection, Bigram matching, Stemming, Synonyms and Phrase Matching.Security Analytics – The Service is designed for speed and indexes data as it isingested resulting in a very rapid time to information with the ability to run ad hocqueries and real-time visualisation.



Metrics Analysis – Can manage a range of metrics form a wide variety of sourcesfrom sensor data to CPU usage.Application Performance Monitoring – Application metrics and visualisationthrough pre-configured dashboards.



SaaSShop-DSA-VSV1:Viewdeck Visualisation of Data Service Kibana® (VSVL)

The VSDS Service is a Kibana® based, distributed search and discovery solution,capable of solving a wide range of data indexing and retrieval use cases. The Serviceenables you to store and index large quantities of structured and unstructured data,and use keyword or natural language techniques to retrieve records.Kibana makes it easy to understand large volumes of data. Its simple, browser-basedinterface enables you to quickly create and share dynamic dashboards that displaychanges to Elasticsearch queries in real time.

Features Horizontally Scalable and performant to support very large data sets. Full-text querying via a range of language and business rules. Automatic failure detection and recovery. Numeric and geo data search capabilities. Multiple search capability across wide set of databases. Central Data store, working with Logstash and Kibana products. Rapid, production ready service suitable for a wide range of needs. Integral part of ELK stack. Supports wide-range of Iaas platforms. Aws, Azure, UKCloud, Private Cloud. Secure meeting regulatory and compliance requirements.

Benefits Handles huge quantities of data, in the Cloud. Provides for full information discovery, capability. Identifies relationships between structured and unstructured data. Delivers wide range of data mining possibilities. Supports Web. RESTFul and microservices architectures. Elastic scalable service, supporting operational and data mining use cases. Wide range of plugins available to support Language, search, etc. Close integration with JSON data, to support NOSQL structures.

Service DescriptionThe VSVL Service uses Kibana®, the data visualisation plug in for Elasticsearchmaking it easy to understand large volumes of data. It has a simple, browser-basedinterface enabling you to quickly create and share dynamic dashboards. Users cancreate bar, line and scatter plots, or pie charts and maps on top of large volumes ofdata.

Kibana is an open source analytics and visualisation platform designed to work withElasticsearch. It provides visualisation capabilities on top of the content indexed onan Elasticsearch cluster. Kibana is used to search, view, and interact with data storedin Elasticsearch indices. You can easily perform advanced data analysis and visualise



your data in a variety of charts, tables, and maps.


Single ViewKibana gives you the freedom to select the way you give shape to your data.Particularly when you don’t always know what you're looking for. With its interactivevisualisations, you can start with one question and see where it leads you.Kibana has a standard range of graphical representations including:

histograms, line graphs, pie charts, sunbursts,

and more. You can also design your own visualisations should the wide range ofavailable representations not suffice. All leverage the full aggregation capabilities ofElasticsearch. Functionality includes:Geographical Data - visualise geospatial data, or visualise custom location data on aschematic of your choosing.Time Series - Perform advanced time series analysis on your data with a range oftime series UI’s. Describe queries, transformations, and visualisations with powerful,easy-to-learn expressions.Analyse Relationships with Graphs - Take the relevance capabilities of a searchengine, combine them with graph exploration and uncover the uncommonlycommon relationships in your data.Explore Anomalies with Machine Learning - Detect the anomalies hiding in yourdata and explore the properties that significantly influence them.

Improve and enhance collaborationYou can easily distribute Kibana visualisations to your team members, peer groups,Managers and individuals. You can:Embed Dashboards and Send Links - Insert dashboards into your internal wiki orwebpage. Or send your co-workers a URL to a dashboard.Share Dashboards – You can provide access to your dashboards to a broaderaudience without worrying about accidental changes with Dashboard Only mode.Export to PDF’s and CSV’s – You can create, schedule, and share PDF reports ofyour visualisations and dashboards and can also export ad-hoc search results to aCSV file quickly and easily.



Appendix 1Terms and Conditions

1. In all products Support is calculated on the basis of a remote (ie not on site)basis, and where necessary, a secure access service to the services isrequired at additional cost. For UKCloud Tier 1 Elevated services, the SecureRemote Access solution provides such a service.

2. Change Requests, Change Boards, and Change Management are notincluded and will be calculated at normal SFIA rates. As a service, patchingand updates will be managed and coordinated by Viewdeck and unless thereis an impact to service, no notification will be provided. Regular, pre-approved change windows for minor outages will be agreed to upfront.

3. Rates do not include ITHC activity. Most components have been checkedpreviously, and where possible information will be made available. Wherepossible, and as required, supporting an ITHC and the outcomes of the ITHCwill be managed as a fixed price (the size depending on your accreditationrequirements).

4. Regular Service Reviews are not included, but can be added as a fixed costpackage, depending on the integration required. Standard 'out of the box'reporting from service management tools will be provided for 2nd and 1stline support packages only. 3rd line support functions are not included(assumed to be part of a 2nd line support function). Where tailored oralternative reporting is required, these will be provided as an additional item.

5. Inline with our Security Policy, Patches will be applied when appropriate, andunless of High Priority (CESG or other body), at the discretion of Viewdeck.We aim to patch all systems within 30 days for Repository or packagedapplications. Third party application software will only be upgraded if majorfailures or issues exist, impacting usability, or on annual renewals. Upgradescan be done at the client's request as a chargeable item.

6. 1st Line support assumes clients can self serve via the Support Portal, andwill always be directed towards email/online support functions.

7. 2nd Line support assumes interfacing and triage is handled by a separate(client) Service desk, with Viewdeck acting as a Resolver Group. Email andOnline Service portal will help manage and coordinate.

8. 3rd Line support assumes all end user management, and investigation isprovided by client’s ICT support function/organisation, and liaison isrestricted to technical, authorised and available resources.

9. Additional Support tasks that are passed down to Viewdeck inappropriatelywill be charged at the normal SFIA Rates.

10. Viewdeck takes no responsibility for the functionality or the performance ofthese applications, open source solutions or their components. Wherepossible, software functionality will be baselined and agreed atcommissioning. Downstream operational issues will be fixed, and bestendeavours used to maintain service, but responsibility for third party



software does not lie with Viewdeck. Liability is limited to the Value of theTermination of the Contract.



Appendix 2Viewdeck Support

The Viewdeck Support and Service desk provides a range of options to meet yourspecific needs, based upon the service and business need. Our support channelsinclude telephone, web, Slack and email support to users of the service. This providesan ITIL aligned help desk, with standard reporting, incident management andproblem management processes using an application tool-set, with an SLA reportingback to the customer. Our support helpdesk is available, during normal workinghours, to log support calls for any incidents. Standard support hours can be extendedby agreement. Each customer call is logged, in our remote management system, andthat provides a unique call reference number track the incident, to enable you totrack your issue, providing ease of exchange during incident resolution.

Our fully trained team work directly with our clients to manage and resolve supportqueries using telephone support, remote access and on-site were requested.

Our Standard Support provides clients with monthly reports, remote problemmanagement enquiries and monthly client engagement to provide integration intothe client’s service architecture and federated service models.

Incident ManagementViewdeck follows a traditional P1-P5 problem management prioritisation andresponse model, providing integration and escalation as you would expect to deliverto the agreed service levels.

P1 Total loss of service. P2 Some loss of service. P3 Small loss of service or work around. P4 Tasks are made more difficult, but are not impossible to complete. P5 Interferes with non-operational use.

Urgency of responsePriority

codeUrgency of response Target response (within

core hours)Target

resolution(within core

hours) (M-F x 9-5)

P1 Immediate, sustained effort using all necessary and available resources until service is restored.

Immediate response, actionwithin 15 Mins (Enterprise 24x7) , 1 hour (Outside Support Hours)

4 hours

P2 Immediate response to assess the situation, staff

Immediate response (withincontracted Service Hours),

1 working day



may be interrupted and taken away from low or medium priority jobs.

action within 2 hour

P3 Response using standard procedures and operatingwithin the normal frameworks

Email notification of call being logged (within contracted Service Hours) 1 hour. Response by email or phone within 1 working day.

2 working days

P4 Response using standard procedures and operatingwithin the normal frameworks as time allows.


5 working days

P5 Response using standard procedures and operatingwithin the normal frameworks as time allows


10 working days

Our Service Level Objective aims to resolve 90% of incidents within the targetresolution time.

All P1 and P2 events are allocated an Incident Manager to see and manage incidentsthrough to successful resolution. Where necessary, client help desks will be informedand updated as the incident resolution evolves. The Incident Manager will provideSPOC for the client, provide regular reporting back, and coordinate activity betweenvarious resolver groups as necessary to ensure successful resolution.



Appendix 3Viewdeck Cloud Software Service Catalogue

Code SaaS Summary Notes Per



Appendix 4

About UsWhy is Viewdeck Different?

Value - As a specialist SME, we can bring big company/ex Big 4 consultancy experience with niche specialist value.

Insight - Having delivered across the Public and Private Sector, Client Side and Supplier Side, our senior team bring more than just delivery capability, they bring insight and a network of relationships.

Experience - Wide range of technical delivery support to MOD, SIA, Cabinet Office, NCA, Home Office, DVLA.

Win - Our team have delivered £100m’s of savings to HMG in the past few years by re-negotiating ICT contracts.

Diligence - Our team worked regularly in secure government agencies. Our people, processes and capabilities support secure quality and assurable deliveries. ISO 27001 certified.

Energy - Uplift your programme with new skills, new experiences and new insight.

Collaboration - Proven client support, skills transfer. Delivery through client/Viewdeck joint collaborative working.

Knowledge - Specialist in Architecture, Cloud Solutions, HMG Transformation, and Leaders in HMG ICT programmes.

Offering Value for MoneyApproach Outcome

Our team have provided skills and advice to awide range of public and private sector clients.Here is a small selection of them.

Expert skills and resources, Real world experience.

Efficient coherent delivery, with less time reworking or ‘learning on the job’

Strong domain knowledge. Swift subject understanding, minimise learning and false assumptions

Buddy/duplication of services/capabilities.

Risk reduction of delays through singlepoints of knowledge and absence

Utilise existing staff, skills transfer, embed, upskill,.

Minimise Consultant spend, ensuring timely efficient handovers to client.

Iterative/Agile, rapid reaction to changes

Speedy product creation, less time pursuing wrong directions

Re-use where applicable Less time re-inventing capabilities, bestvalue for money in delivery

Strong Comms, lasting legacy, easy to adopt, real artifacts.

Investments reused create more downstream value for the client

New Ways of working Enthused and interested workforce, more able to rapidly accommodate change and hence increased efficiency




Viewdeck Consulting Limited 3rd Floor, 207 Regent Street,London,W1B 3HH+44(0)203 384 [email protected]

SaaS Data Services Applications...data, from various sources, both structured and unstructured is a...

Documents

Transcript of SaaS Data Services Applications...data, from various sources, both structured and unstructured is a...