LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report...

Post on 14-Jul-2020

5 views 0 download

Transcript of LDBC SOCIAL NETWORK Benchmark - Full Disclosure Report...

LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT 20/04/2015

Social Network Benchmark Interactive Workload Full Disclosure Report Moritz Kaufmann

20/04/2015

LDBC SOCIAL NETWORK BENCHMARK - FULL DISCLOSURE REPORT <DATE>

Table of Contents

3

4

5 5 5 5 6

7 7

7 Error! Bookmark not defined. Error! Bookmark not defined. 7

Error! Bookmark not defined. 7

8 8 8 8 Error! Bookmark not defined.

9

11

12

13

Preface

This is the Full Disclosure Report for the LDBC SNB interactive audit results for Sparksee 5.1.1 by Sparsity Technologies, Scale Factor SF30 on a single server configuration.

General Terms Test sponsor of this benchmark is Sparsity Technologies, Spain. Sparsity technologies is a leading provider of graph database and applications that use the graph to add value to our customers. Our high end technologies, based on top research, combine the experience of University researchers and Industrial professionals. We have a vast Industrial experience to push your development to a more competitive customer solution. Sparsity was created based on the technologies developed at DAMA-UPC, and have successfully provided solutions to clients such as Barclays, Acceso, CA Technologies, MPG and contributed to leading European Projects such as LDBC and CoherentPaaS. This report contains an audited LDBC benchmark run. The results have been gathered by an independent and impartial auditor, who has validated the implementation of the queries and the overall system's configuration conform to the description of the benchmark and his strict requirements.

1. System Description

1.1 Database System

Vendor Name Sparsity Technologies

Database Name Sparksee

Version No 5.1.1

Table 1: DBMS Characteristics

1.2 Database Engine Configuration

Cache Configuration Default

Transaction Isolation Level/Model Serializable

Special settings sparksee.io.rollback=false sparksee.io.recovery=true sparksee.io.recovery.checkpointTime=0

Table 2: Database Engine Configuration

1.3 Platform Description

Table 3: System Configuration

Model

Processors 2X INTEL XEON E5-2630 V3

Memory 8X 32GB LRDIMM, 2133 MT/S

No Disks/Type/Storage Configuration

2X80GB SSD SATA MLC 6GB/S IN HOT-PLUG

DRIVE 1X2TB SATA 6GB/S 7,2K RPM 3,5" HDD

Network Adapters BROADCOM 5720

Operating System DEBIAN GNU/LINUX 7.8 (WHEEZY)

File System EXT4

No Threads 32

No Cores 16

Memory 256 GB

Total Disks Capacity 2.16 TB

Storage Intel Corporation Wellsburg 6-Port SATA Controller

RAID/HBA controller Not installed

Table 4: No Disks/Type/Storage/Configuration

1.4 Network Infrastructure Information

Model Not applicable

Network Switches Not applicable

Wiring Information Not applicable

Table 5: Network Infrastructure Information

2. Data Generation & Loading

2.1 Dataset Information

2.1.1 Description

Scale Factor 30

Data Format CSV

Data Generator Version v.0.2.0

Time Compression ratio 0.61

Table 6: Dataset characteristics

2.1.2 Data Generator Parameters

ldbc.snb.datagen.generator.scaleFactor: 30

ldbc.snb.datagen.serializer.compressed:false

ldbc.snb.datagen.serializer.personSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonSerializer

ldbc.snb.datagen.serializer.invariantSerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVInvariantSerializer

ldbc.snb.datagen.serializer.personActivitySerializer: ldbc.snb.datagen.serializer.snb.interactive.CSVPersonActivitySerializer

ldbc.snb.datagen.generator.numThreads:4

ldbc.snb.datagen.serializer.updateStreams:true

2.3. Bulk Loading

Loading Time 216min 48s

Table 7: Bulk Loading Time

3. Benchmark Test Driver

3.1. Basic test driver configuration details

No of worker threads 16

No of write streams 8

Table 8: Basic Test Driver Configuration Details

3.2. Configuration Parameters for Driver Warmup

Warmup using the first 160,000 operations

3.3. Configuration Parameters for Driver Execution

See user_parameters.properties, startup with 16 worker threads and TCR = 0.61

4. Performance Metrics

Duration Operations Throughput % above threshold

72.5min 377,000 86.5 3.89%

Query Count Mean % Execution

Complex 1 2,955.0 331.2 2.61%

Complex 2 2,076.0 354.7 1.96%

Complex 3 725.0 725.4 1.40%

Complex 4 2,134.0 326.8 1.86%

Complex 5 1,068.0 405.7 1.16%

Complex 6 243.0 984.0 0.64%

Complex 7 1,601.0 333.5 1.42%

Complex 8 8,537.0 351.8 8.01%

Complex 9 200.0 3,451.4 1.84%

Complex 10 2,076.0 449.7 2.49%

Complex 11 3,841.0 362.1 3.71%

Complex 12 1,746.0 383.0 1.78%

Complex 13 4,043.0 1,137.6 12.27%

Complex 14 1,566.0 2,010.3 8.40%

Short 1 41,220.0 40.9 4.49%

Short 2 41,221.0 27.8 3.06%

Short 3 41,222.0 31.2 3.43%

Short 4 41,027.0 45.0 4.93%

Short 5 41,029.0 19.7 2.16%

Short 6 41,030.0 19.0 2.08%

Short 7 41,033.0 18.0 1.97%

Update 1 17.0 964.6 0.04%

Update 2 8,776.0 187.8 4.40%

Update 3 15,423.0 189.5 7.79%

Update 4 242.0 179.9 0.12%

Update 5 21,901.0 188.9 11.04%

Update 6 3,031.0 176.5 1.43%

Update 7 6,166.0 189.2 3.11%

Update 8 851.0 176.0 0.40%

Table 10: Execution Summary

Query Min Max Mean 50th 90th 95th 99th

Complex 1 2.0 3,055.0 331.2 98.0 896.0 1,007.0 2,122.6 Complex 2 2.0 3,431.0 354.7 112.5 927.0 1,027.0 2,146.5 Complex 3 2.0 3,496.0 725.4 606.0 1,329.4 1,501.4 2,207.6 Complex 4 1.0 2,998.0 326.8 103.0 884.4 1,003.4 1,923.0 Complex 5 2.0 3,452.0 405.7 242.5 993.6 1,329.0 2,060.3 Complex 6 2.0 2,814.0 984.0 820.0 1,622.8 1,757.8 2,359.8 Complex 7 1.0 2,887.0 333.5 91.0 898.0 1,022.0 1,851.0 Complex 8 11.0 3,572.0 351.8 109.0 922.0 1,032.0 2,115.1 Complex 9 1,554.0 5,808.0 3,451.4 3,392.5 4,427.2 4,711.2 5,032.0 Complex 10 1.0 3,575.0 449.7 215.5 1,041.0 1,144.5 2,238.8 Complex 11 2.0 3,264.0 362.1 125.0 941.0 1,049.0 2,220.6 Complex 12 2.0 3,290.0 383.0 155.5 954.0 1,063.3 1,915.5 Complex 13 6.0 4,657.0 1,137.6 1,139.0 1,911.8 2,005.0 2,946.4 Complex 14 15.0 6,324.0 2,010.3 1,878.0 3,511.0 3,935.5 4,623.8

Table 11: Complex reads detail

Query Min Max Mean 50th 90th 95th 99th

Short 1 1.0 3,767.0 40.9 12.0 56.0 98.0 995.0 Short 2 1.0 3,593.0 27.8 18.0 43.0 57.0 112.0 Short 3 1.0 3,057.0 31.2 19.0 42.0 52.0 119.0 Short 4 1.0 3,775.0 45.0 12.0 58.0 102.0 1,003.0 Short 5 1.0 3,509.0 19.7 11.0 30.0 44.0 98.0 Short 6 1.0 3,586.0 19.0 11.0 30.0 40.0 81.0 Short 7 1.0 3,777.0 18.0 10.0 27.0 34.0 73.0

Table 12: Short Reads detail

Query Min Max Mean 50th 90th 95th 99th

Update 1 14.0 3,827.0 964.6 702.0 2,948.6 3,781.4 3,817.9 Update 2 6.0 5,669.0 187.8 24.0 796.0 1,073.3 2,510.0 Update 3 6.0 5,996.0 189.5 24.0 821.0 1,105.0 2,457.7 Update 4 7.0 4,145.0 179.9 25.0 561.1 1,031.8 2,626.2 Update 5 6.0 5,831.0 188.9 24.0 817.0 1,069.0 2,424.0 Update 6 9.0 3,897.0 176.5 28.0 757.0 1,014.5 2,229.1 Update 7 7.0 4,065.0 189.2 29.0 823.0 1,046.0 2,333.6 Update 8 6.0 3,682.0 176.0 24.0 764.0 1,004.0 2,243.0

Table 13: Updates detail

5. Recovery

Table 14: Recovery

Time to Recover 1.281s

6. Pricing Summary

Item Price

SPARKSEE 5.1.1 SME LARGE 3Y 21,600.00 €

DELL R730 8,827.94 €

TOTAL 30,427.94 €

Table 15: Pricing Information

7. Attachment's CheckList

DATAGEN PARAMS.INI Attached

DRIVER’S LDBC-CONFIGURATION.PROPERTIES Attached

DRIVER’S LDBC-RESULTS.JSON Attached

VENDOR SPECIFIC CONFIGURATION FILES sparksee.cfg

Table 9: Checklist